I don't think his dad did anything evil to him, aside from ruining his career as a basketball player in a fit of drunken rage, and the fact that he acted distant from him since then (probably from guilt rather than any ill feelings, but Tomoya doesnt understand that yet)