As a bit of background, I'm a 100% telecommuter from my home on the East coast, with the vast majority of my company based in Silicon Valley. I don't get as much in the way of facetime with the team - in ~6 years working this way, I've met my boss (and the rest of the company) less than 5 times. We're friendly for sure, but the distance does occasionally make for strained work relationships.
A year or so back, during a weekly internal conf call, I heard several of the higher-ups talking about their WoW PvP experiences. I had no idea they were gamers, and they apparently didn't know I was either. I decided to share that, and found they were entirely cool with my gameplay, even enthused. At the time, I was a regular in a casual raiding guild (semi-weekly raids, months behind uberguilds), so I was able to share some tips with the gang about stat builds, leveling strategies etc. I even went so far as to critique the gear of my boss's boss's level 70 pally, giving him tips on what to pick up to prep for tanking for their guild.
Since then, we've all stopped WoW'ing regularly, but the experience and sharing was really worthwhile. It certainly wouldn't be appreciated at every company, but use your judgment, and perhaps discussing, even playing, with your coworkers is worth the risk.