I have a good, yet older surround sound setup for the TV, but these days I'm all about the headphones because you can listen to those as loud as you want all day and night! If you keep an eye out on price-watching sites, it's really not that expensive for some quality stuff. I think I've spent about $450 on my DAC/amp/headphone setup by picking up things on sale or clearance, and it will last quite a while if you take care of it.
But if you go down the "wood knobs, voodoo magic cables" route, the situation would be quite different...