Comment Re:Vizzini (Score 1) 64
I think the end state of all this looks like game cartridges. If people could buy the weights of a frontier quality model in a high density, high speed ROM that ran locally plugged into an PCI-E or M.2 slot, all you would need then is a reasonably fast tensor processor with a little RAM for context. This is possible, and there is even a company (Taalas) with an early product. They have an online demo that is crazy fast.
You would buy one and use it for some time, probably years, and then discard it when the value of some newer version makes sense to you.