Comment Bandwidth (Score 2) 213
These days all high performance computing is limited by just one thing: ram bandwidth. And with the tradition to AI on gpu this issue got worse. Apple is the only company that is making integrated gpu/cpu memory that is also high bandwidth. Not like the bad old days where integrated memory just meant cheapo motherboard without dedicated video memory.
Memory is in fact moving into the system chip for even better bandwidth so of course it has to be soldered! That's not even the right terminology.
The real question is do you want additional off chip memory or not? The off chip memory will be slower just as register and global
Memory must be used carefully on gpu to get performance the answer is that yes you could perhaps make use of the off chip slower ram or even slower sodimm ram. But at some point maybe the place to put that is instead on the solid state drive. Integrate the ram as a cache for the ssd. It's already doing that but make it even bigger. Then you can make it persistent as well.
Apple as usual is way ahead in adopting the future before the software exploiting it arrives .