Hmmm. Think of it this way, he benefits from them being charmed since it’s not like it’ll harm them. It’s more or so just warping how they believe hogwarts to be. Instead of a magical school for wizards and witches? They think of it as a prestigious school