I always wondered why the public doesn't hate him for that.

More or less, Heroes are the famous people of our world. If someone like that abuses his children and word came out (and I'm sure word will come out when someone is constantly exposed to the public like that) they would get shit for that (rightfully so)