Do what you think is right, I only come for a decent plot and a large harem of slaves(?
Joking aside, whatever you do, could you create an aux chapter of the members/slaves?
If you do go through with this, why don't you start when the house of the dragon events were going on? Then, at a later date, you go back for the ice and fire event's