Jinbei has a point going on... at this moment Luffy could well 'destroy' Fishman Island by defeating Hordy... they either need to find another way, or convince Jinbei and the general fishman population that they are there to help, despite being humans. Hard to do so when they supposedely 'captured' the King a few chapters ago.