I think a large part of it is that the alien races he's encountered have shown an unshakeable loyalty to their people and, to a lesser extent, him once he showed himself to be an ally. Humans, on the other hand, are greedy individuals who have no solidarity except when it suits their interests.