I don't trust software to take control away from the driver.
While I completely agree, subjectively, I also understand enough psychology and statistics to know that a) the feeling of control is mostly emotional, not rational. It's why your mother in the passenger seat is scared in situations where you as the driver are completely cool - you are in control, she is not. That she's more easily agitated only makes it more visible. It's a well-documented fact that experiencing the same situation once in control, or even just seemingly in control, and once not in control is experienced very differently.
Statistics, on the other hand, show that even at this early stage, autonomous vehicles have a better-than-average track record. So while you may feel less safe, the numbers say that you are actually more safe.
etc that won't be participating in this V2V conversation.
Which is why autonomous or semi-autonomous (assisted driving) vehicles do not rely on one input source alone. V2V is not intended to replace all the sensors and stuff, it's one more input source.
Great, but that doesn't mean you're now free to be inattentive! If anything, cars should be less safe and speed limits higher to force people to pay attention, or else.
Humans are really, really bad at paying attention to monotonous tasks for extended periods of time. The sooner our cars drive themselves completely, the better.