I happen to both like driving AND like the option of having the car take over if I'm tired etc.
Cars are a unique instrument because of the degree of freedom they provide. My big concern is that the advent of self-driving cars will be used by the state to heavily infringe on those freedoms.
My sense is that within months of approval of this technology for mass market use, it will become mandatory, and within a few years after that havens of the nanny state will prohibit humans from driving.
All in the name of public safety of course. The cars will be monitored, tracked, and subject to stop on order from advice at any time.
Tell me this isn't the future.