Comment Re: This is getting to be ridiculous (Score 1) 99
Quantized to 2 bits you might just about be able to run it with 512GB of RAM and 24GB of VRAM. But it would lose a lot of its intelligence.
However, there are people who've been running big models on consumer hardware by streaming data from an SSD rather than keeping it all in RAM. Significantly slower but doable.