Government, and its adherents, also have a long track record of atrocity. Should we get rid of it too?
I think it's kind of hypocritical to treat religion as such an evil, when people are equally (or even more) likely to worship a TV celebrity, which often isn't even a good example in any way.
Religion, by itself, isn't evil. It is often full of good intentions (yes, I know the idiom). The problem is in the religious organizations. They get powerful, consequently they get corrupt (if they don't begin that way) and start attempting to manipulate people.
If someone is religious independently of any institution, they are much less likely to be led into doing something harmful.