So far all we know in the anime is that Oro said Kabuto could take on Kakashi. Just because he can use a powerful genjutsu doesn't mean he is way stronger than Kakashi. Kakashi, Gai, and even Sakura were able to break out of it.
Also he didn't put the entire stadium to sleep, only the section Naruto was in.