"You and I aren't well-matched right now."

I guess that's better than, "It's not you, it's me," since you can read it as, "I'm going to come back, so be sure to keep up."