I'm still not sure if Eren simply confided in him because he overheard everything, or whether Eren saw something in him. Historia was involved primarily because she holds the royal bloodline.

It looks like he sidelined everyone else because he knew exactly what kind of people they were - and if Historia the "bad girl" couldn't handle it then they wouldn't be able to either.