Bart would be his first one to join. But no i don't see it. Roger didn't have a fleet and he became the pirate king. He competed against people like Whitebeard and Shiki who had massive fleets and still conquered it all. So will Luffy. Small crew where everyone has a purpose and everyone is strong in their own way.