Just because you're a wanted criminal doesn't mean you constantly have bounty hunters beating down your door. When was the last time we saw a powerful bounty hunter come after the Straw Hats? They've all been nameless bums.
Maybe some of these guys are just really good at evading capture, it doesn't mean they're really strong fighters.