Well, what I remember, was Luffy was all "those bastards left him here! Raaa!"

And then Zoro said something to the effect of "That was 50 years ago, don't you get it? They died on the Grand Line."

And then Crocus was all "Thats not it, afterwards, they fled the Grand Line".