he has two decent(ish) siblings who didn't have much screen time due to not being awefull people. they managed (tyrion even said so himself, 2 out of three).
and he seemed to like his father, actually, and robert did care for him (at least, he didn't know he was an insect boy).

although, the pressure of being king probably made it worse.