If you're a white, well-off, adult male in a population that tends towards those people being in power (whether in politics or business) then you're not going to be hurt by a lack of oversight in the day to day operations of society.
If you're one of the groups sidelined by whatever the majority believes (whether that's racial supremacy, religious nuttery, etc) then having state protections can be good.
Making sure that the political machine has safeguards in place to prevent any group that ends up sidelined or in conflict doesn't become a target for abuse by the state also has to be a consideration.
It's a delicate balance.
I'd rather have a degree of protection for my neighbors who have a history of being stepped on, than an illusory freedom that lets robber barons run amok over us as well.
If we didn't have such a problem with greed / material wealth gathering, a lot of the issues that trickle out from that would likely end up with a society that has a lot fewer rules.