Creative Labs has that reputation, and they were dicks in general but funnily I had some real "audiophile" sound with Sound Blaster Live! and Audigy 1 cards.
Creative drivers were shit and I was even once stranded - I needed to download a CD image from unofficial source to get sound under Windows, whereas finding and using the DOS driver took me minutes (!). But a russian guy made a great driver that always worked and is perfect if you only care about getting an output (so no EAX gaming shit) and even the latency is low I think. It's still here http://www.kxproject.com/
One weird property of Live/Audigy cards is the output for rear speakers has better DAC and signal path, rated at 107dB signal/noise. The driver swaps front and rear speaker output by default. Sound quality was really fscking perfect as far as any regular usage is concerned. Now I have a Xonar DX which is much better (116dB SNR) but it feels like just the same and my sound is worse because I'm using it in a smaller, worse room.
So, to get cheap ass audiophile sound, old Live! and Audigy 1 are or were great. I would buy them for a pittance. Killed a great many of them though, they're easy to kill when you put them in another PC (be very careful and always fasten the screw even if you're thinking of running it temporarily unscrewed while setting up your PC hardware)