Because we all live in a club, called "society", where we make certain sacrifices to personal freedom to help everybody. As a society, we've decided that you can't be a jerkass by building unsightly properties next to others, because it takes too much away from property values and deprives others' of their own enjoyment of their property.
Unless you have enough money to ignore/change the regulations as you see fit. If you are rich you may ignore most of these sacrifices (as well as being able to outright buy yourself out of traffic tickets/other minor infractions). If you are poor you are out of luck, sorry.