I think Imber is a moe lover, and for that reason, he cant really not like Haruka, the ribbon bubbly semi-idiotic clumsy character archetype. I think he just misses Misato a bit.