I bought a Wii early. I bought 4 controllers. I have never experienced what you're talking about, either. Atleast, never any game other than the wii sports range. Even when I've managed to "scrounge" up three players, they've been non gamers and thus, no challenge - which for most of us would mean, no fun, either.
For me, what you're describing is a group of people akin to the dynamic potrayed in The Big Bang Theory. I'm sure it exists, but it surely is not in the mainstream and owing to the existence of the penis, extremely unlikely to last for very long, if infact you can score such a scenario.
(I mean, I almost went for a wank in the middle of this comment)