Is it really a problem? If you really need to use an X server, you would frankly be better off doing so on a desktop or laptop machine, so you don't have to punish yourself with a touchscreen keypad. If all you actually need is a TTY with access to the usual *nix command line tools, you can use busybox (root required) with any of the terminal emulators already available.
Having said that, by the time I get around to buying myself a tablet, hopefully the Android versions of LibreOffice will be mature enough to be useful...