I use a half-a-year old extremely low power PC build for this purpose. Instead of being a media server, it is directly connected to the television and runs XFCE. It also acts as a fileserver, sometimes as a game server and hosts my and my friends shells etc.
I watch my media with mplayer, because VLC is so much worse.
I can't understand how anyone can live without a device like this.