There are maybe 2-3 times a year I would actually use an autonomous car per year if it was perfect and free (big if's). Basically just on long full day road trips. The other 99% of the time driving is no burden, or would be less of a burden than having to sit in the car bashing in an address and other vital details into the infernal thing before getting out of the driveway.
How many folks actually have a sigh of relief when their spouse offers to drive? Very few I suspect, as this is a problem that mostly does not need to be solved. I mostly don't even use the navigation system in my car now.
Heck, the navigation system should be a huge warning sign of what these cars could be like. The interface (Nissan) is lousy, map updates are way overpriced (and still outdated), and they want a subscription if you want traffic information. The car has a 2G modem for its connection to Galactic Central that will be no longer be serviced by AT&T in a year and a half. An autonomous car would similarly fall victim to being orphaned after a few years due to either hardware or software, and would almost certainly require some sort of data plan fee to stay up to date. Cars should last at least 20 years, and frankly car companies don't have a clue how to design and maintain critical life supporting software for that type of lifespan across.
Autonomous driving should concentrate on trucking, and maybe taxi type services. The rush for sticking it in general passenger cars is either stupid, or a Trojan horse for some other motivation.