Were there actual technical limitations to enabling a larger address space or was it just a lack of foresight?

Most Linux DEs are extremely limited and expect you to google a terminal command for a lot of settings. It's not uncommon for the GUI to omit some pretty basic settings such as monitor refresh rate or mouse acceleration.