Where I'm from, flyover country, poor people are much more likely to drive 15-20 year old clunkers (dodge durango's, jeep cherokee's, and other big heavy vehicles seem to be super popular with the poor here), they also tend to have longer commutes due to fewer job opportunities and less mobility when it comes to housing.
We're not even talking about the indirect costs. When the price of fuel goes up everything is affected. People like me will easily absorb those costs while the people living paycheck to paycheck will suffer. I drive a 7 year old Honda Civic, and I'm lucky enough that I telework. The mechanic who changes my oil, the AC repair guy who spends a large part of his income on fuel for service calls, and the people who work in the restaurants where I eat and the stores where I shop will probably be forced to give something up.
While your educated upper middle class white guy probably doesn't see much use for a large library there are a lot of people that do.
I recommend you go to a small town library and see how it's being used. My wife is a librarian at our local library, and I'm always surprised how many people are there when I go in to see her. There are kids using meeting rooms for school projects, people using the computers to fill out applications for jobs, and there's always at least a few people interspersed between the racks just browsing or even sitting on the floor reading something they've found. The local knitters club meets there once a week and last I checked there were about a dozen volunteers for the literacy program teaching people to read at various times of day depending on when their "student" is available.
Fortunately, our community values our library so she gets a lot of local support, but I'm sure there are people in our community like yourself who see something that they don't/won't use as a giant waste or prime real estate or something...