If you're the moderator, just shadowban their account.
They can post, but nobody sees their posts except for the bully.
Eventually they leave, since they think that everyone is ignoring them.
"If you can, help others. If you can't, at least don't hurt others." -- the Dalai Lama