Call it hokum if you like, but it's a fact (in the US at least) that driving is a privilege and not a right. If you disagree, then please explain where you think your right to drive comes from. There's certainly no right to operate a motor vehicle in the US Constitution, nor in any of the state constitutions that I know of, nor in any federal or state law.
Now, you may not LIKE the idea that driving is a privilege, and you might think that driving SHOULD be a right. None of that matters. The fact of the matter is that driving is currently a privilege in all 50 states, and you can lose that privilege for all sorts of reasons. Driving without a license is a pretty serious matter.