Just because Tobi played off like he knows Kakashi and Gai, doesn't mean that he's from Konoha. I'm sure all of Akatsuki were quite familiar with the two of them.