The real complaint, as I see it, is "billionaires" not needing to pay taxes because they can readily avoid having any income. (They usually have some of course, but often it's not of consequence, or receives the lower capital gains rate.)
This isn't my complaint exactly, but I think of "the rich" as being someone with over $100 million.