Hate is a strong word, I think it is quite the opposite. He must have really loved his sister and when she left you could imagine the pain he must have felt. So he thinks that distancing himself from Emilia means that he won't get as much hurt if/when she leaves again.
