You might be OK with the concept and execution of Google Street View. However,
a lot of people most certainly are not happy. We don't want our houses plastered
up on an easily indexed, location linked, photography database.
And it's going to happen anyway, with or without Google. I've posted hundreds of geolocated photos in Earthscape and Picasa. More will come. In 5 or 10 years, perhaps every photographable thing on earth will have at least one geolocated, maps-searchable photo pointing at it.
You're worried about photos of your house. Have you bothered to check Picasa, Flickr, Imageshack, Photobucket, Bayimg? TerraServer? Real estate comparison sites? What of the hundreds of other image and geographic services I have not named?
If not, can you claim with a straight face that this issue is important enough to warrant government involvement in private photography? It is unclear to me that there should be an a priori restraint on publication simply because "a lot of people are not happy". If that's a problem, toddle on down your Congressman's office and see if you can get enough people interested to pass a law. If you don't care enough to bother, fine, but don't tell me it's important to you.
I'm a veteran of these wars. I fought Lotus Marketplace, I wrote letters to my legislators and to Lotus and to Mitch Kapor. That success was utterly irrelevant. What I have learned is that you need to pick your battles, and pick them only when there is real harm being done. Otherwise you risk creating an unwieldly, overbearing enforcement environment that hurts everybody.