Nah, Goryomaru was a monk.

When Akago (Baby) was split in half, one half was taken by Kagura and the other half by Kanna. The half with Kagura grew up and became Hakudoshi and the half with Kanna stayed a baby.