On the other hand, everyone knew we were going to find extra-stellar planets. The math dictated it. Actually finding them was tidying up loose ends.
Cite please. Cause I remember sitting in conferences discussing this with other people in the field, and we were apparently woefully underinformed.
I could, were I so inclined, find you numerous references to discussions of the Drake equation in the 80s and 90s when one of the unknown variables was \eta_{planet} and the explanation was, maybe planets are just rare. Maybe we're special. It's not the way anyone would have bet, but it was definitely a possibililty.
And dark matter is the new ether - it's so obvious until one day it's not.
One, I think you mean dark energy, and two, both dark matter/energy were stunningly unobvious when I was a grad student, even though we were dealing with the same problems that led to the experimental evidence supporting these theories. I don't think the solution was obvious and handed out when I wasn't paying attention in Weinberg's and de Witt's classes.
This isn't any sort of "golden" age.
Holy cow. We've built, launched, and observed so much more in the last 20 years, experimentally, than in the whole previous century. I could hand you my grad school copy of Peebles, and we knew nothing, nothing for certain. All speculation. Now we know, and know that we don't know, and that's old science. What an ingrate.
This is how science is done. I don't care that you didn't get space elevators or jetpacks or a GUT. You might have expected what all those bozos in Popular Science were predicting for five cents a word, but no one else did. Those guys didn't understand orbital mechanics, chemistry, or physics. Huh. Who knew? We don't have flying cars and robot detectives and blasters either. Turns out maybe they weren't such great idea. Or fusion, or cheap reliable nuclear energy. The Jetsons weren't a reliable predictor of the future. We don't get cheap travel to the asteroids. We get GPS and smartphones and digital photography. We don't get fusion. We get Google and cheap travel to other continents and super-reliable cars and global warming.
I don't know what we'll get in the future, but it won't be what you, or I, expect. My grandfather got cars, airplanes, world wars, nuclear energy, and moon travel. I get computers, internet everywhere, and to go almost anywhere in the world I want to go. And realizing that the universe that I was taught we almost understood is 96% unknown. That's pretty awesome. "Everything we knew yesterday is wrong!" That's exciting, if you're a scientist.
Nothing's been done since Einstein and Dirac? All that work towards making and validating a Standard Model and making it calculatable out to 11 decimal places is a big disappointment? Just for instance.
You want new science, and you want it to be done out of trailers in BFE, Texas, and you want it for no money by people who get paid nothing. Land is cheap out there. Go nuts. Elon Musk isn't doing it that way. He's got a pretty nice setup in Hawthorne.
If it were possible to do science that way, most of us would be doing it. I don't know anyone who's in it for the money.
Kickstarter is your metric for what should be done? Look at what's on Kickstarter now if you want a list that's 99% junk. It's worse than Sturgeon's Law! That's why scientists have peer review and decadal reviews when we want to spend a lot of money. I'm not letting Kickstarter decide what science gets done, else we'll all be working on robotic sex slaves and Death Stars.
As far as NASA goes, yeah. More (and maybe bigger) telescopes in different wavelengths, more outer planet probes, more solar system and earth study. Dozens of great ideas are unfunded for the price of peanuts, and would be cheap at the price. One of them might well give us the key that unlocks the beginning of the universe or a GUT, but that's the thing about science. We find things we didn't even know to look for.