You're right. There's no such thing as being "too logical", your actions are either logical or not. What people are actually complaining about are morals (or the lack there of), which our actions are based off (logical or not).