Private companies just don't need the sorts of skills that the typical person has. Nobody wants to hire an average programmer (at least, not at US wages), or an average marketer, etc. Today we have hyper-specialization and if you're in the top 1% of whatever you do you'll have a job for life, and if not you'll be lucky to ever have a job. We're still in transition, but all the trends are there.
We life in a country which has a huge economy, and yet tons of people who are unemployed.
Oddly enough, a libertarian economist, Tyler Cowan, wrote a book that agrees with you. Average is Over.