If you live in (or near) DC you should check out Advanced 2000 in Alexandria, VA. They dont build machines with Linux preinstalled but you can have custom built machines that come without an OS. And everything is wholesale prices, so you can build a really fast, cheap machine and not have to fork over any windows tax.