That's because it's flat out not true.
It's not your race that makes you a target, but the way you dress and act. I've visited no shortage of "ghetto" neighbourhoods in my life time, but I was always in a plain t-shirt and old jeans with ratty shoes, looking like I had not a dime to spare -- in other words, looking like a local.
i've also lived in a fair number of "ghetto" neighbourhoods because I didn't know better when moving to a new town, so just picked a place that was close to work. And you know what? I found the people in those poor neighbourhoods to be far more caring, far more helpful, far more generous, and generally a "better class" of people than those I've met in non-mixed neighbourhoods.
But I've also always had an ace up my sleeve. I'm Canadian, not American, so when I lived in those poor parts of the US, people soon knew "the white guy" was a Canuck and a foreigner, and thereby welcomed to the community as being another poor immigrant.