One has only one chance to make a first impression. Google handled theirs badly. The customer base learned mainly two things from version 1:
1) We don't want them.
2) Others don't want them.
The first comes from the fact that people who uses them immediately gets the geek factor (in a bad way, if 'good' ever had a possible tone to it). Simply put: if you want people to take you seriously, don't wear Google Glass. Second point: shortly after their release, there were reports of public places where wearers were banned, such as pubs. People simply get scared of a revolution where they e.g. can be recognized on sight by a stranger if this would be a thing.
To wrap up: the best thing Google can put their efforts on next is NOT necessarily improving the hardware, but instead put their efforts on a really smart second release in terms of customer relationship. If they blow this chance, they won't recover.