I vaguely remember someone specifically stating that Danzou was NOT the 6th, he was a temporary Hokage, he could only officially become the 6th if he gets elected, which didn`t happen, he would also get his own face monument if he were truly a Hokage.