I run Debian on my server and Ubuntu on my laptop. I have no need for NVidia drivers or a web browser for my server. I also use more manually installed software on my server as there is no default server software configuration that will meet anyone's needs, while the default Ubuntu installation serves most of my productivity needs.