The 4th amendment is suppose to protect you from government search and seizure in your own premise.
Where does it say that? All I see is this:
The right of the people to be secure in their persons, houses, papers, and effects, against unreasonable searches and seizures, shall not be violated
It doesn't state where you have to be to get those rights. It doesn't say you can be secure in your houses only. It lists those other things (persons, papers, and effects) precisely so the government can't wait around for you to leave your house and then search you or your stuff.