Do you have any evidence that self-driving cars are unsafe, or that human intervention has been necessary?
None at all, that's my only point. I'm extremely optimistic that automated cars will be safer than human drivers within the decade if they aren't already. It's not a very high bar to attain, really.
Their record so far is excellent, but the tests are still being done with professional drivers behind the wheel. We don't know what sort of weather conditions the cars have had to deal with, or how much the drivers have needed to intervene. Have they gone out in thunderstorms and blizzards and still have never needed driver intervention? It's possible, I don't know.