You are assuming that we won't get the efficiency of solar panels and batteries up, or use dry sterile lands for our collectors. There's a lot of desert out there and we already have the grids to distribute energy from anywhere to everywhere (almost).
Just image the creation of a cheap solar panels that are also roof tiles. Every single home could potentially be it's own power source in the future, and if we're going to survive as a species, I sure hope it doesn't come down to "Oh well our view is better without sustainable energy so let's just die off instead."