Well they did agree that Tsunade would make a better Hokage than Jiraya but seeing that they didn't know her current location they went with him first.