Money is a source of privilege, but it is important to understand that we have many forms of privilege in this world. If I am born rich, I get privilege from that. If am born white, I get privilege from that. These things do not cancel each other out. Being rich and black does not make you stop feeling the effects of race privilege. Being white and and a woman does not make you stop feeling the effects of gender privilege.
Privlege is not about whining. Privilege is about those who can simple presume that the world will work out for them in various ways, and especially when they do not even realize this is not so for others.
For example a rich black family cannot feel certain that their children will be exposed to positive examples of black people in their general school curriculum. A poor white family CAN be assured that their children will be exposed to positive examples of white people in their general school curriculum. That's an example of privilege.
Complaining is not what's going on. What's going on is that people are raising the bar, and saying that our interactions and our creations should be made in light of awareness that these issues do exist. They do not mean that we need to do penance, or feel guilt, or make a froth about our liberties being impugned. They mean, be aware, and act accordingly.
You should try it.