Celebrities deal with what the majority thinks. Everyone else has to deal with the people around them, whose beliefs and actions can significantly deviate from the public at large. For a regular person, your sexual preference or religion (just to name two examples) can still invite prejudice and violence in some areas of the country.
Given how quickly and severely those prejudices can change, I would just assume keep my privacy. Just look at the reaction to those following Islam pre- and post-9/11. While my particular tastes and idiosyncrasies may not put me in any danger today, I'll make no bets about tomorrow.