I can't say I know my lore for fate perfectly but doesn't Avalon always chose Artoria meaning that if that's where merlin sent her to he just basically handed his only hiding place to her and now he can no longer escape because he no longer has the control over it?