No one is accusing you of oppression or repression, they are only stating that you have privileges that you don't see. You just can't see your privilege because like everyone, you only live in your viewpoint.
I am a straight, white male raised by two educated, middle-class parents who valued education. This gives me an ENORMOUS advantage over 95% of the population. I work hard, but honestly I have NOT had to bust my ass too hard to become a successful, upper-income, white male. I get out of bad situations easily merely because I am not seen as a threat by anyone in power, but rather an ally, just because of the color of my skin.
You have to realize that the reason that YOU think your life is not privileged is because you live in the middle of it. You think that if you have problems you are not privileged, but even the 1% has problems. I have only in the past few years come to realize the advantages I have had all my life, and when you get older you will hopefully see the same thing.
So no one is accusing you of anything, they are just letting you know that you have it better than you realize.