Unless you have the time and skill to generate your own utilities (water, electricity, telephone, internet) – and to home-school your children, then you NEED to have a governing power of some kind.
That "governing power" can be a simple private corporation or association. That means that the people making the decisions are the owners on the one hand, and the customers on the other.
HOA's have plenty of politics going on in them. . . to the point of some individuals trying to exert monopoly-like influence to their own personal ends. Strong President + weak res-of-board invites abuse. It happens all the time.
Give anyone or any sub-group power, and they will be in a position to abuse it – unless a system of checks and balances are put in place.
It is basic human nature. If you learn how to escape the effects of being an individual among a group of co-equals, then I and many philosophers, political scientists, and people in general will be delighted to hear it.