Simple fix: don't ever set your voicemail password.
I went over 10 years without enabling my dreaded voicemail, some people complained but I never budged. My current Director told me to set it up about six months ago. I did and used a random integer set from random.org as the password.
I can honestly say "I forgot my voicemail password" and let the thing fill up.