As for responsiblility, you're going to need rules for that too I'm afraid. When your untrained unlicensed driver runs over some pedestrian, and does not have enough money to pay for the pedestrian's health care, someone has to enforce that they have financial responsibility.
All too often, people like this beat their chest and rip grass up screaming about their rights... and secretly hope that nobody will notice their call for "right" is a call to avoid personal responsibility. There is no human right ever now, or in the past, that relieves one of their higher obligations to their own humanity. Part of that means accepting that we need to make social contracts, like licensure for driving, in order to ensure everyone's safety. Every right comes with its own responsibilities, just as all power comes with it as well. Disregard that, and you become a monster, a villain, a sociopath.
Driving isn't a right. You don't need a car to survive. You don't need it to be successful. It's a convenience, like a dish washer, or running water. People talked about human rights as far back as pre-greek times, and they didn't put in their treatise on the subject, "And Thou Shalt Preserve Thy Right To Locomote By Means Of Crushed And Fossilized Animal Remains."
People like this don't know the meaning of the word human right. They think it means "I get to do whatever I want." Human rights aren't for that; they're put there to ensure that greater evils do not take place, because several millenia of history tells us that if we don't accept that people need to be able to question authority, to defend themselves against it, to have equal partnership in the establishing of social contracts between themselves and those of other social classes... civilization doesn't happen.
Human rights, fundamentally, ensure that civilization happens... not that you get to drive 140 MPH in the fast lane. Perspective... some people need it.