If I put the game down for a weekend or a week or two due to Real Life, and then come back and there's no way to get back into the character and remember what was going on in the story, then I'm done with the game.
This actually brings up an interesting thought for me. I wonder how well it would go over that, if you saved and walked away from a game, when you came back, it gave you one of those TV-esque 'Previously, on [game]...' intros (skip-able, of course). That might be a way to do a quick refresh of what was going on when you saved, perhaps what quests you were on or the point in the main story where you were at. So far I haven't seen any of that in games, and I know it would have helped me in quite a few instances to get back into the groove.
Lost Odyssey does something very similar - when you load a game it gives you a text run-down of recent events. Star Ocean TLH has a full text summary of everything that's happened so far available to read, which certainly comes in handy. Tales of Symphonia had a similar system. So they are out there, just need to see more of it.
I guess part of it is the game devs assuming the player will just be playing their game from start to finish, without any distractions whatsoever in between - something that's just not very likely to happen.