Is anyone else reminded of Star Control 2? The "peaceful" Slylandro probe... which was misconfigured with bad priorities.
Captain: Your probe DOES destroy ships and I can prove it!
Slylandro: No! It cannot! It is not programmed for hostile behavior! What is your reasoning?!
Captain: Think about what a probe does when it meets a ship.
Slylandro: Space ships are the probe's highest priority because we want more than anything to make friendly contact with alien races.
Captain: Think about a probe's Replication behavior.
Slylandro: The probe seeks raw materials, and processes them in preparation for Replication.
Captain: Think about the effect of changing the replication behavior's priority.
Slylandro: The answer is simple... it would spend more of its time seeking raw materials for its replication process. So what?
Captain: Now, what will it do to a ship, given that its Replication priority is set to maximum?
Slylandro: I don't see what you are getting at, but I'll play along with you.
Slylandro: Like I said, alien ships are THE top priority target. Once a probe scanned a ship, it would instantly move toward it. Then, when it got to the ship, it would initiate communication automatically. When communications were terminated, a new behavior would be selected, and...
Slylandro: Uh-oh.
Slylandro: A new behavior would be selected, and since the Replication setting was set to maximum the probe wouldn't get time to pick a new target... it would use the current target--the ship--for raw Replication materials. It would process the ship, break it into component compounds with electrical discharges.
Slylandro: Oh no! what have we done? Traveller! You must tell us what we can do! How can we stop the probes from destroying all life in the galaxy?!