I'm a believer in free speech as much as the next guy, but there's a limit. If you're repeatedly harassing someone for having a different opinion/nationality/religious belief, you're not engaging in free speech. If you keep making throwaway accounts to flood a person (or persons) with abusive language, you're not engaging in free speech. If you're egging others on to keep harassing someone because they "deserve it" by virtue of not being a part of your group, you're not engaging in free speech.
If someone says "I believe in X", that's free speech. I can disagree with them vehemently, but I won't push for them to be banned. I might even think that a group is scum as far as their beliefs are concerned but so long as they are smart scum and they stay to one side of the line between free speech and harassment, I'd support their right to free speech. I might not like it, but the real test of free speech is protecting unpopular opinions. However, if the group started harassing anyone that they didn't agree with, they would lose my support and I'd be in favor of banning them. Free Speech isn't absolute. It doesn't give anyone the right to engage in any behavior and say "Free Speech" afterwards.