I concur. The idea I've had is that we'll eventually get to a wearable visor that projects 360 degrees in 180 degrees, and as you move your head, changes the view. The middle 90 or 120 degrees will be real-space, and the remainder will be compressed to fill the visual field and give full 360 view.
I don't think that will happen for anyone other than perhaps fighter pilots, who actually wear visors. Maybe race drivers, they would certainly benefit. The rest of us would benefit more from the the driverless cars of the future you predict, anyway. I don't want to have to wear some shit on my head when I drive, sometimes I get headaches.
Eventually, when we get contact lenses with camera and display elements in them then that will be fairly compelling... for those of us who can tolerate contacts. I'm not even sure whether that includes me, I've never tried.