In your post, I read an assumption that a physically secure password tracker implies secure passwords.
One advantage of password managers not captured with a physically secure password tracker is that you can employ more complex (including difficult to type?), changing passwords unique to each system. Some softare password managers do this for you automatically.
Physical security isn't the only attack vector on passwords.