I do wear glasses. I'm a cheap bastard so I generally buy from a place that sells an eye exam, regular glasses, and sunglasses for $99 if you can live with the frames they offer. If you pick nicer frames the price goes up, I usually get out of there for $150. I bought a pair of prescription polarized sunglasses years ago for $200 and I still use them, I treat them tenderly always keeping them in a hard case when I'm not wearing them. When I'm staring into bright water or road having an out of date prescription isn't very noticeable.
For swimming, I buy "off the shelf" prescription goggles for $20. They don't match my eyes perfectly, but at least I can walk around without banging into anything and I don't crash into stuff in the water. My eyes require different strength lenses, so I buy 2 pair and cannibalize them to make 2 custom pair that sorta fit my eyes.
If you have a current prescription you can shop online, there are some good deals out there.
If bright glare bothers you, do yourself a favor and invest in the polarized lenses. I've got pretty sensitive eyes and it's been totally worth it for me.