Our company, CodeLock Computers, provides high quality encrypted Linux computers/workstations. We would be willing to provide welded-shut computer cases. We can also do security screws, USB ports filled with epoxy, and hardware encryption to protect boot partitions from tampering. Best of all, they run Linux.
I have experience building workstations and servers that last. Nearly all of the ones I've built for customers are still functional more than 10 years after first install.
Experience counts so I suggest you use a system builder with a similar track-record.
The more powerful the system, the more challenges in building it to last. Many of the items on the check-list below need to be balanced against the needs of the customer, including noise, environmental conditions, performance aspects, and frequently budget.
Check-list for Building a Computer that Lasts
Before I get modded down I should explain.
It's not a traditional single flat-file, it's multiple ones.
A file system is a database.
An authority is a person who can tell you more about something than you really care to know.