Solution: Money (Score 1)

If people want to moderate, why not have them pay for the privilege?

Consider this:

Signing up to be moderator a costs $10 or so. The money goes to charity
chosen by the moderator (fsf, spi, eff, etc.) Meta Moderators would need
to pay a heftier fee ($50-$100).

All moderators could start out with XX points, and either gain or lose
based on the review of the meta moderators (who could only meta moderate
a moderator once - try saying that five times fist). Once they lose all
their karma points, they lose moderator privilges and their money. If
they get meta-moderated to a higher Karma, they would have the ability
to become a meta-moderator (possibly for free or for a reduced rate).

Meta moderators would be under the control of slashdot itself (I'm sure
andover.net could spring for the cost of a Meta Moderator Manager). Any
meta moderator caught abusing the system would loose their status and their
money.

This way, it weeds out the moderators who are just in it to cause trouble
and some deserving non-profits get some cash. Plus, it goes great with chicken.