Submission + - Why AI token prices are about to plummet (businessinsider.com)
Nvidia's Blackwell GPUs are being installed in huge volumes right now. By the second half of this year, these systems, which are really supercomputers rather than chips, will be operating at scale, helping AI labs train new models and run them more efficiently.
These systems took a while to install properly, partly because they needed to be water-cooled and required other gnarly new data center setups. But the payoff could be huge.
50 x more, 35 x cheaper
SemiAnalysis, a respected AI research firm, compared Nvidia's top Blackwell system, the GB 300 NVL72, to Nvidia's previous system, called the Hopper HGX 200.
With the older system, each GPU generated 90 tokens per second, while the new Blackwell system generated 6,000. That's 65 times more.