(My personal foible: I stop and start videos a lot, and hunting with the slider to find out where I left off is a royal pain, so I googled "how to make VLC remember position". Big mistake. VLC doesn't implement this simple feature, but you can get a plugin that does.
I encountered the same problem and VLC does seem to have some kind of built-in bookmark feature, but in my case the "go to bookmark" hotkeys did not work.
Woe is me! This FREE software that I don't pay anything for doesn't fulfill every niche requirement I want! Have you even submitted a bug report for this? Perhaps you could even contribute a fix if said issue irks you so?