Comment Re: Begun, the AI price wars have... (Score 1) 38
As a local AI enthusiast I can tell you that it's not practical even with a large budget. For one thing the hardware is obsolete as soon as you buy it. In a few years that $30k compute card is worth $300.
This would be an awesome problem to have. My local AI enthusiast hardware is three years old and currently worth 4x what I paid for it at the time. At least when shit becomes worthless you can afford to buy better shit and get more value out of it.
With that said, even "old" AI is useful for some tasks but probably not what you'll want to use it for. The field is moving so insanely fast that newer models vastly surpass previous models and you want to be top top of that because the improvements are huge.
Personally don't see hardware requirements moving all that much. Much of it as I predicted three years ago is in large sparse models with limited numbers of active parameters. I can run everything I would want to run except K3 with good enough performance for my purposes. It is the sheer volume of RAM rather than compute or even memory bandwidth that seems to be the ascending limiting factor.