This chapter just gives a feeling that sooner or later this novel will grow into a harem... I don't really mind harem but most harem (about 99% of them) gets boring in the long-term.
It doesn't matter if there's a harem - as long as MC prioritises. Power is what matters in the end of the day, if he has to sacrifice his 'beloved women' to achieve it, so be it. If there's no conflict of interest, then it's best to maintain a loving facade.