Moria is a Shichibukai, so even without his zombie army, he probably has other tricks and powers that he could use to be a threat. Didn't Moria used to rival one of the Yonkou, before he started building his Zombie army, anyway? I mean, he was still defeated by (I think) Kaidou, but being said to rival a Yonkou must mean he isn't a pushover.