They never tell ages of when the Hokages are named.

The anime makes it seem like the 3rd is the youngest, though the manga is more ambiguous, though.

The Fourth, however, was the youngest to die, so it's likely he was the Hokage for the shortest amount of time.