Journal: Karma

I have noticed that whenever I get modded + Funny my Karma goes down.
Is this normal? I can't seem to find anything in the FAQ about it.