Hairyfeet, I think you and I are pragmatists and pretty much on the same page. I'm an IT pro,so I run Linux servers for my job, but I'm also a gamer, and dual booting is a pain in the ass. Trust me, I would love to make Linux my primary desktop, and every few months when I have some time, I give it another serious shot. But I always end up back to dual booting mostly due to the reason's you listed above. FOSSies and an lack of stable driver interfaces.
Years ago, I was happy with OSS audio system, but that is controlled by one company so the FOSSies have done their best to replace it with a far inferior ALSA. This caused me so many headaches back in the day. But lately my issue has been with the graphics subsystem. I have to chose between open source drivers with terrible performance or proprietary drivers that don't work with modern kernels.
Finally, X windows and gaming don't seem to mix. Here is a case, where I think Linux needs to change the interface. I think Wayland may be the answer. decent or at least X11 with decent full screen support would be a godsend.
So from my perspective for Linux to make it, it would have to use :
1) OSSv4 Audio Subsystem (FOSSies it's GPL'd already get over it)
2) Stable graphics driver interface ( or FOSSies stop breaking ATI and Nvidia's drivers )
3) Modern Display Server - maybe Wayland or throwing out all the kruff in X11 and fixing Full Screen graphics