I think everyone "deserves" to live at the same standard at which the most privileged person on the planet lives, and the only reason we're not elevating everyone else to that level is physical limitations.
It would probably be more constructive to frame it in language that makes it out as a negative thing that everyone else doesn't have it that good, rather than an aberration that a small group leads "privileged" lives. Because those are the lives we'd wish everyone could also have, if we could help it. The ideal isn't "no one can have these unrealistically nice things," the ideal is that everyone has them.
"Privilege" inherently connotes "having nice things is bad," and if nice things were bad, then it wouldn't even be a bad thing that only an elite few could have them. They're good things and we don't want to connote that their existence is a bad thing.