Yes, it is definitely about what works best for you. I've been using *nix for about 20 years (SunOS, Ultrix, OSF/1, FreeBSD, Linux). I "switched" to MacOSX in 2006. In my experience, using MacOSX as a desktop OS was horribly painful, and I gave the Mac to my inlaws, switched back to Linux on a whitebox about a year later.
The main problem I had was that there was no way to configure the native window manager to my liking. I've spent 20 years with *TWM and KDE variants configured so that:
1) focus follows mouse
2) Meta-mouse1 moves a window, Meta-mouse2 resizes a window, and Meta-mouse3 moves a window
I'm so tied to these bindings that I even submitted a patch to KDE about 10 years ago when I switched from CTWM they would work with KDE (I also submitted a patch to Gnome, but they ignored me..)
Since I couldn't configure the native Aqua interface / window manager to do what I wanted, I ended up using CTWM and X for most of my work (xterms and emacs windows). The big problem I had was that when I wanted to switch from a native MacOSX app (like Mail) into an xterm, I'd forget to click on the xterm, and end up doing odd things because the Thunderbird mail window would still have focus. If I had a dollar for every email I accidentally deleted or replied to while typing in an xterm while Thunderbird still had focus, I'd be rich. I just could not train myself to work with a click to focus system.
I will say that lots of stuff that is a PITA in *nix worked quite well (suspend/resume, flash video, multimedia stuff, printing). But for me, not being able to customize the user experience to my liking forced me back to *nix. If I need commercial apps that don't run under linux, there is always a Windows VM..