Include the solution or recommended course of action in the alert email. Don't just say there's a problem, tell them how to fix it.
Ex. download this hotfix at this link
Ex. enable/disable this setting
Ex. Be careful while using Internet Explorer and use an alternative browser such as firefox or chrome (I wouldn't include links here but thats just me)
Oh and no technical jargon, the unknown scares people, if your boss can understand it based on just your email (before you send it), you've achieved this.