The question is whether a particular tax at a particular level causes inappropriate economic disruption or hardship. Ultimately we need to tax where the money is, while balancing the degree of inevitable disruption and hardship with wisdom.
Of course, people avoid saying that out loud -- in America, surely it will be only a few nanoseconds before some whiner equates the federal gov't with a famous bank robber. Really the wise should not fear for being emulated by bank robbers, even if fools will insist every single thing a bank robber ever did cannot contain wisdom.
Whether you really "own" a house or car is an emotional factor that is a distraction. Should someone less well off than you pay higher taxes, so that you can enjoy a more perfected perception of your personal relationship with a housing unit? Would it be okay if someone else got driven out of their own home with other taxes, when hardship could be shared equitably between you two without great harm?