And that's different from walking and bicycling on the same roads how?
Walking and (to a lesser extent) bicycling are inherently less hazardous to other people, in that there is less mass moving less quickly in areas where other people might be. As a consequence, walking and bicycling are less heavily regulated than driving.
That said, there are also regulations governing walking and bicycling -- bicyclists have to obey traffic laws when on public roads, the same as any other vehicle, and even pedestrians are forbidden to jaywalk.
Or are those activities not rights either?
You seem to think that if there is a right to do something, then that activity cannot be regulated by the government for safety reasons. The law (and common sense) disagree with you.