I doubt Jozu is injured by it, but that doesn't mean he's able to move. Being made of diamond would make you invulnerable, it wouldn't make you strong.
Luffy is much the same way. Rubber doesn't take damage from a lot of attacks, but there's nothing keeping you from simply tying Luffy up.
I don't think Jozu is harmed, he's just trapped.