You've essentially just described the average person's interaction with smart phones. I see people constantly distracted by smart phones at every spare moment. On the elevator, on the bus, waiting for the train, etc. Technology gets between real life interaction with people constantly. GG isn't really terribly revolutionary in that respect
Yes, your attention to your phone makes it look like you aren't in the here and now. It's probably why people considered it rude even before phones were so multi-function.
But the glasses are even worse, because you *can't* indicate your complete attention without taking them off. You *can* look up from a smart phone, and people can see they have your attention. With the glasses, even if you intend to give your undivided attention, and even if the thing isn't displaying something at the moment, you still don't look like you're giving your complete attention. It's like holding your phone up in picture taking position. Even if you're not looking at it people will assume you're going to, or that you're taking pictures instead of paying attention to the conversation.
Try it. Hold your phone up at about cheek level, off to the side of your face, far enough in front of you that you could read it if you looked at it. I guarantee it will be extremely distracting to conversation and people will assume you are distracted and possibly recording them, even if you don't look at your phone. They will probably stop mid-sentence and ask you what you're doing.
With the glasses there's a constant reminder that there's a device between you and me, and I know it's capable of displaying stuff as I'm trying to talk to you, and I know there's a camera pointing at me. As if you were holding a cell phone up. Worse, the eye it partially obscures is the one most people focus on, so they can't even really look you in the eye.
GG is dorky because it LOOKS dorky.
Definitely. But even if they made it more fashionable I think it'd still be dorky.