From my experience using several charge stations over the last year, I don't believe your concerns are that much of an issue. I haven't seen any charge stations vandalized in my area yet. If it did become a problem, I'm sure security cameras and law enforcement could deal with it.
As far as weathering, that should be a non-issue as charge stations are engineered to be outdoor rated (check out NEMA ratings).
What kind of "accidental damage"? Cars running into the charge station? I suppose this is a valid concern, but usually a bollards are installed in front of them.