Actually, the whole point of "inalienable" rights as defined by the Declaration were those instilled in us by "the Creator" (the higher power that made humanity exist.) So things like the right to live (and thus the right to eat, drink, breathe), the right to speak freely, the right to travel, the right to work and make use of your labor - these are things that when the word "inalienable" was written meant that they were not man's to give, nor man's to take away.
A lot of that stemmed from the early beginnings of the existential crisis, which at that time boiled down to, I don't have a choice to be created and exist on this earth, so all of my faculties must have some sort of higher purpose that is beyond me, so a life of solitude and selfishness (and nastiness and brutishness and thus shortness) is less ideal than one of community and the "common welfare." So the inalienable rights were declared - rights which were simply above man's pay grade.
Attributing any other meaning to that word, whether trying to shrink it (as you are), or enlarge it (as some more ardent socialists are), is beyond its scope.
We can argue about whether there are inalienable rights, but if you believe that such things exist, then no, there is no right of those around you to murder you in the street.
I mean, we had 500 years of philosophers arguing over these kinds of things, you're not the first to take a stab at it.