It only depends on how you do it, just like anything else you have to learn to work the system. Go to a community college for all the classes you can, get good enough grades to go into a larger university, buy your books on amazon or anywhere else cheap, and work while you go to school (best way is to get a job on the university, talk and show interest to your professors and I guarantee they'll get you some lab job with flexible hours within a year). If you can't handle a large load of classes, so what, you'll be saving yourself time later by not being in debt.
I started that late, and I'll be graduating and starting grad school with under $10,000 in debt, all subsidized loans so I don't even pay interest. Granted, I have had some help from family, but not much the past two years, which has been where I accumulated all of the little debt I have.
But most college students want to party one way or another so they end up with that much debt or more in their first year. Like someone mentioned below, most people who will be successful probably don't need college, and those that don't really want to go but are only going because they want a job that pays for them to keep screwing around probably aren't ganna do nearly as well as they'd like.