X through SSH for server admin? Really? If someone asked for this on one of my boxes I wouldn't let them touch it with a 10 foot pole. Best car analogy I can come up with is a mechanic who doesn't know how to drive a stick well enough to put my car on the lift. Funnily enough we have a DBA who insists on using remote X sessions, then opens up the console in the X session to do his work and wonders why we have memory overhead issues.
Also, I used an old Treo 600 for on the run server admin using TuSSH back in 2003/4. No 802.11 on it which I found annoying at times (once it was available on other/newer smartphones), but GPRS was fine for SSH. Full keyboard, good enough display that I didn't feel limited by it. If 6-7 years later smartphones aren't at least as capable, something's very wrong.