User friendliness is about being simple, not having more colors or fancy widgets - see Windows Vista as an example.
The way I see it, if Linux were to win in the consumer market, what it needs to do is not more, but less - and do those "less" things 100X better than Apple, Google or Microsoft.
The mess with X is actually being addressed, with project
Wayland. The philosophy behind Wayland is exactly simplification - most people don't need that network transparency logic, so re-factor it out and keep the core simple and fast. It's a different architecture than X and so it's gonna take time to get the whole UI software stack to work on that, but Ubuntu is behind it.
Configurations and integration between services in a Linux machine is still a pain in the ass, and sadly, I'm not seeing any project addressing that yet. I used to be an open source dev but now I have a tech company to manage. But that's where I'd really like to see progress on the FOSS front.
Finally.. I think the FOSS community may be setting their target too low with Windows, and the "I don't care about consumer market/we already own the server space" crowd are simply ignoring reality. Apple and Google are beating the shit out of Microsoft's products lately - Windows and Office are pretty much still there because of inertia. Having to compare Linux to Windows, is already implying Linux is in a very bad shape in the consumer market. On a higher level, none of the current high profile players (Google, Apple, Microsoft, Amazon - who's on the server side!!, even Facebook) or products (e.g. iOS, Android, Chrome,
...) are truly independent players like Mozilla Foundation or the Linux kernel community. So, it's really not a time to be content with Linux share on the server side and bash M$, Apple, etc. as proprietary... FOSS still has a long way to go and improve.