I think you are thinking of "whom". ;) I don't know any native English speakers who have problem with "whose", unless you confuse it with "who's", but that's just a spelling mistake. I only understood whom after learning German myself.