There are a number of markets/professions where the Google Glass would be ideal (a big one that I keep reading about is aircraft maintenance, have drawings and manuals available on command in front of the technician's eyes).
Rather than trying to come up with something that is designed for everybody on the planet, figure out who could get the most advantage out of it in the short term and, working with that demographic, develop the hardware, the UI and database operation and work with the users to understand exactly the human factors issues. A number of people indicated that the camera was the problem, but I suspect that there are much deeper issues that need to be addressed.
Once you have become indispensable in one area, others applications will start becoming obvious and the product will seem less "creepy" and intrusive for other areas.
myke