Comment distributed workload (Score 2) 69
Gamer PCs can run inference on an open source LLM locally with good response time... As a society, we really only need datacenters for the model contruction (still an important issue). The idea that this infrastructure is necessary for end use is just corporate greed trying to prevent you learning the truth. If the world economy holds on another few years, our [new] laptops will have the right chips. The inference side of the game is going to fan out away from datacenters anyway.