Here is a scenario where if a self-driving car can pass 100% of the time, then I would deem it safe to get into.
Driving on a mountain road around a sharp corner where there is a steep cliff on the right side. Auto-car is passed on the left by some *sshole "manual" driver, but then the *sshat driver cuts in short because of oncoming traffic at the last second. Robo-driver identifies there is suddenly a car intruding into its safe-T-zone (TM) and does what its programming tells it to do, avoid hitting other vehicles. So the self-driving wonder swerves right to avoid the other car and zooms off the cliff.
A human driver would recognize that hitting the other car in this instance is the safer solution then to go careening off the steep cliff.
I agree that a self-driving car can work, and 99% of the time will perform adequately to protect its occupants from disaster. But since we have not mastered true AI yet, all self-driven cars will be built with flaws in their logic that will fail catastrophically. "Avoid hitting all cars", for instance, is not a good enough directive to ensure the safety of the occupants in 100% of all situations.
Someone mentioned that the deaths caused by self-driven cars would be far less then manual drivers, but then I would disagree that any technology introduced on the highways would be adequate to allow any fatality, especially in scenarios where a human driver may have been able to avoid death.
Basically what I am waiting for is the inevitable 100 car pile up with massive fatalities that WILL occur at some point in time where investigation will identify that a self-driven car, or cars, was the cause of it. Any company involved in programming or manufacturing that self-driven car will be sued out of existence and the "love affair" everyone seems to have about auto-driving cars will end quickly.
I am amazed at how delusional governments are into so quickly allowing this technology on the roads, sounds to me like there is some massive lobbying going on to short-cut the necessary amount of time to test auto-driven cars under all senarios, not just ones in controlled and predictable setups like we have seen. 5 years ago robo-cars could not drive around a dirt track, now they are quickly being allowed on our highways. That just is irresponsible.