He can bestow it upon anyone he desires as long as they can handle the process and they have gemstone affinity. With those two easy conditions, he can easily bypass them through his greed sins and get rid of it without needing Carbuncle. My bad, I should have explained it a bit in the novel.
