Between road detours, new red lights, which red light is mine in some cities... but the biggest issues are for those of us who live off in the north.
We have add things to avoid. Deer, turkeys, and lots of pot holes. I will swerve to miss a critter, but not at the cost of my life.
As a driver I'm smart enough to avoid the slippery leaves that land on the ground in the fall. There are bridges I can't cross because my truck is too wide to do it at the same time as another oncoming car. I can glimpse the car coming through the trees so I just stop and wait.
Half our roads don't even have a double yellow line, never mind the white line. Hell, we have dirt roads. What is a car going to see then? I have areas (mountains) where even my satellite radio will go out.
Lastly winter. There are times with the new snow fall that I have no idea where the road is and have to drive in the middle of the road. Not because that's where the lines might be but staying away from the edge is safer, driving in the lane where someone else has driven is safer, etc.
Lastly, for Google to originally think they weren't going to put a steering wheel in the car just shows their stupidity. After kids put cones in the road, and paint some lines via detour and watch the cars line up down a dead end street or something like that. It won't end well.