Again with the, "Why would you want privacy unless you had something to hide?" argument.
The answer is that even legal, ethical facts can be deeply embarrassing. If you enemy learns such a secret, he can use it to wound you or to turn your neighbors against you. Imagine that you had:
1. divorced a spouse because of their drinking problem or abusiveness
2. had a child who became a felon
3. been bankrupted by medical expenses / job loss
Don't talk to me about illogical. Don't pretend that my new community will treat me with fairness or compassion, or that I can magically find people who will. In real life, people keep secrets for good reasons. Because sometimes you just need a chance to start over and be known for what I am now.
And, don't tell me that I should submit myself to the judgment and compassion of the doxxers. It only takes one doxxer who values his cause more than justice and then the damage will be done.