Yeah, things like this would happen, but also, how easy would it be for a small but dedicated group of pranksters to deliberately behave in odd, amusing or offensive ways to train the AIs? AI09 says "I herd u leik tentacle pr0n"
"It ain't so much the things we don't know that get us in trouble. It's the things we know that ain't so." -- Artemus Ward aka Charles Farrar Brown