Comment Fail-safe (Score 1) 506
If I'm ultimately responsible for the vehicle, I'll stay in control of the vehicle. Because if there's a 10 second lag between when the computer throws up its hands and says "I have no idea" and when the user is actually aware enough and in control, that is the window where Really Bad Things will happen.
Have a look at how collision avoidance systems that are on the streets nowadays currently work:
- the car will sound an alarm signalling probable impending collision and asking the user to intervene.
- the car will also autonomously start to slow down and eventually brake and stop never the less.
The system is designed in such a way that, although human override is possible, the car will also try to autonomously to follow the best course of actions, unless overridden. You could take the control and do something, or you could also let the car follow its normal program (in traffic jams typically).
Same should be applied to fully autonomous cars one day:
in case of "I have no idea" situation, the user should be able to take over control, but lacking any intervention, the car should also react in a sane way ("I have no idea what to do, and instead I'm gona park on the side of the road and wait safely there until further instructions").