That is the main problem with sexual harassement. Once a sexual harassement case appear, the consequences of being wrong will be terrible in either case:
1/ either you let a sexual harasser free.
2/ or you destroy the life of an innocent.
Neither of these options are preferable. And because it is so hard to get evidence of these, it often ends in "he said/she said". So everyone wants to tiptoe around it.
I've been wondering about the idea of changing how we deal with sexual crimes. I think there's a lot of women who don't report things because they're worried about the degree of consequences to the man, or of the process they'll be put through when trying to report and get charges filed.
For sexual harassment or assault women I wonder if women could have the option of making a report, having an investigation done, informing the defendant of the accusation, and then having the whole thing sit on the shelf.
Nothing happens that the defendant doesn't want to happen.... unless the defendant ends up reported again. Then all his (or her) past victims are notified that there's a new offense and they have a chance to pursue charges again or at least act as a character witness in the new trial.
Now two things happen. First the predator is warned and will hopefully stop after the first report. Second, if they do continue it's easier to find the ones who are actually guilty.