There kind of was, in a weird way.
In the way back 70s and 80s even, if i was being spied upon on a public street, it was pretty certain there was something specific about me. Maybe I was a crook, maybe I was a cheating spouse, or (very unlikely) maybe i just had a stalker. It was expensive to spy on someone. So only certain people could ever be targets.
Now, everyone can be targeted cheaply. That's a different world. that's a different world than the Founding Fathers could see. Maybe they'd specifically say "you should be able to disappear in public unless there was a warrant".