The Author is just saying that most poorer people who got the class did not become successful with it. It is not like there weren’t any Entchanters among the not so well of people.
However, all of them were born in prestigious families.
Worldwide: I, the Enchanter, Grant 10,000 Times Enhancement