I think Banri wishes for his current self to be recognized, but even so, he still finds the fact that Linda acting indifferently and blatantly lying to him displeasing. I think the approach Linda should have done was to openly introduce herself to Banri, yet still see the current Banri without pressuring him to recover his memories.
Rather than caring about his old self, I think it is simply the deception and his confusion as to the reason for it that caused his outburst towards Linda.