This is Danzo had already got caught by the Third before with trying to kill Kakashi. I think they BOTH would have been put under more surveillance, which would be fine for Itachi but not fine for Danzo.
Also, has it been revealed in the anime yet what exactly those Uchiha secret stones say?