This is what I do at my work, but ours is better (Score 3, Interesting)

At Pacific Northwest National Laboratory, we are implementing something we call the HI-Space table, which uses a camera to track hand motions as well. Ours doesn't need special gloves, though. You can walk up to the table and move your hands around and it watches any number of hands, doing any number of poses. It detects objects that are placed in the space and recognizes them if they are in the database. We have voice recognition, too, so it can respond to spoken commands.

One of the best things about our system is that it is completely untethered and intuitive. There is no training period, and no device to put on. You are interacting with the digital world by manipulating in the physical world.

I write applications for the table. There are a lot of issues that come up that you wouldn't normally think about. For example, with many hands in the space, it's easy to have people doing conflicting things. Actions are not so clearly defined, either. For example, when selecting a button, do you point to it? For how long? What if your finger moves a little?

We are currently conducting user studies to see in what ways the HI-Space table is better than the desktop and cave environments, and we're looking for other applications and organizations interested in using this technology.

http://www.hitl.washington.edu/projects/hispace//
http://www.pnl.gov/infoviz/hces//

contact me at bob [dot] baddeley [at] pnl [dot] gov