they should still brainwash them on board the colony ships. No-one will find out that way and you don't risk creating a bunch of civilizations that hate the empire to the core. It doesn't have to be strong brainwashing, they can just change the hatred to indifference