The ranks of Americans who fall on the extreme ends of the income spectrum has been growing steadily in recent decades.