Comment Re: M5 Max MacBook Pro with 128GB (Score 1) 14
Yeh, except then youâ(TM)re paying a bandwidth penalty for accessing ram over PCIe or SLI, and a bandwidth penalty for having old GPUs, and a performance penalty for having GPUs that arenâ(TM)t as fast, or as flexible. So the result overall is not capable of doing this. When you use multiple GPUs to run AI, you load the whole model onto each GPU, you donâ(TM)t split it across GPUs, because the entire game is about having all the bandwidth available.