I don't know. It's a sound theory, but I think it is something else about why he dislikes/is afraid of Wakaba. That said, I can't think of what.

I'm more concerned that now Wakaba is attracting malevolent spirits that are still alive.