Unfortunately, "man up and deal with it" is the only way to do this. That, and split up your keys in several bunches.
I've got a private bunch with my 3 house keys and my car key, and a work bunch with the 5 keys and 3 RFID tags that I need at work. The house bunch has a Toyota hanger from the dealership, and the work bunch has a nice metal hanger with the logo of my employer. Oh, and then I've got my bicycle key separately, with a handmade bronze crocodile hanger, souvenir from Sabou, Burkina Faso, where I sat the back of a live croc.
That way you generally only walk around with half your keys in the pocket, limiting the damage to your clothes. What's more, having a heavy bunch of keys in the pocket isn't very comfortable...