I couldn't disagree more.
I guess they're not worth your time and trouble as long as you can get to most of what you want. Nearly one in four Americans has some sort of disability, so savvy publishers who don't want to lose out on a big chunk of marketshare find it worthwhile to comply.
In the case of commerical sites, vendors find that disabled users are a loyal lot and will keep frequenting sites and businesses that support their needs. And they won't waste time struggling with a non-compliant site if the competition is compliant.
The argument that this puts undue burden on content providers is BS. The same thing was said about forcing car makers to include seat belts, and on and on. Like the cutouts in sidewalks, not just disabled people benefit from the efforts to accommodate their needs; the general public does, too.
Lastly, while it is well intentioned for general use, 508 applies only to things being provided to the (US) Government. If you didn't factor in the costs of accessibility into your bid, then too bad for you.