Comment Re:That secure feeling. (Score 1) 21
If they're using the enclaves built into Intel and AMD, there may be side-channel issues to deal with. ARM is closer to what Apple is trying with their enclave.
ARM's TrustZone is definitely more secure than the alternatives on Intel/AMD, but TrustZone is also subject to side-channel attacks. To a first approximation, it's impossible to run two workloads on the same CPU and keep them perfectly isolated from one another.
However, I don't think any of these secure enclave concepts are relevant in this case. The way you'd build a private AI cloud is not to run it in enclaves (which are essentially just security-focused VMs) on CPUs that are running other tasks, the way you'd do it is to devote a bunch of CPUs solely to running the private AI workloads. Then your isolation problem becomes the traditional ones of physical access control to the secure machines and securing data flowing into and out of those machines over network connections.