Yeah. I have a lot of PSUs that will do that. Usually when they get turned on though, not just plugged in. My monitor (an SGI GDM-FW9011, that's 24" of CRT widescreen goodness) also makes the lights flicker a bit when it's powered on.
Why did the Roman Empire collapse? What is the Latin for office automation?