Dunno. This little slaver island might not be any major plot location. Zoro even isn't in any condition to fight, and moreover, there aren't enough tough enemies for all of them. Maybe this is just a small joke, perhaps leading in one way or another to the real deal.