How good is their game-streaming at cutting out the various 'filler' time(loading screens, startup animations telling you that Nvidia is the way it's meant to be played) and does it have some sort of 'suspend' state to handle cases where you would pause a game if it either doesn't have save on demand anywhere or takes a little while to load from save?

I know I have a bunch of games that I don't actually play all that much, in wall time terms; but Steam's 'executable run time' number is 2x-10x as high because I'm not necessarily going to save, quit, open, load if a game can be paused and alt-tabbed without crashing or continuing to eat all the GPU time to render a static image I'm not looking at; and I'm not necessarily going to do anything other than pause if I'm called away for 15 minutes by something else.

Unless the streaming service is impeccable at cutting out the various little waits it seems likely that people are going to start resenting the time limit even more than their level of seriousness and actual hand-on-controller-and-attention-locked time suggests.

Given that they already purchased Activision Blizzard King, including the "King" part of it, they clearly already have a considerable interest in casual players.

What is less obvious is how that is supposed to work for their streaming service. The stuff aimed at casuals, sensibly, is normally targeted at either potato-tier PC specs or the (pretty punchy in absolute terms) mobile devices that people worth targeting have.

It is much less clear whether there's a 'casual' market that demands current-gen console performance in very limited amounts rather than mobile or iGPU level titles. Given the extreme prevalence of various 'free to play' models that do sneaky monetization later it also looks like the 'casual' market's (significant) amount of money is largely locked up behind the sort of price sensitivity that requires clever psychological tricks to break through. I'm not sure that they'll be a good fit for something as obvious and psychologically burdensome as a ticking countdown timer hanging over every minute they play.

I have no particular reason to assume that Nvidia is lying about what this software does; but unless they've stumbled on a veritable miracle it's going to mostly be a mechanism for running largely separate models of whatever size your hardware allows; not anything close to what the datacenter comparison implies.

There's a reason why Nvidia sells most of their higher end models intended for parallel use with NVLink between the chips inside the chassis and a lot of either infiniband or RDMA-capable ethernet between multiple chassis; as well as shoving a considerable amount of RAM per GPU onto those parts. And it's because latency and bandwidth matter a lot.

As it is people seek out the unified memory parts, Apple's or strix halo, or nvidia's little GB10, because the GPU having to go to main memory over a mere x16 PCIe link is already a serious problem. If you think either 256 or 512 Gb/s directly to the PCIe root on the same die as the main memory controller doesn't cut it I have some...bad news...about how well NICs are probably going to work for you, especially with the Nvidia parts that don't support RDMA even if you have NICs that do.

"Death penalties should be public, should be quick, it should be televised. I think at a certain age, it’s an initiation... What age should you start to see public executions?"
"We need to have a Nuremberg-style trial for every gender-affirming clinic doctor. We need it immediately."
"You quote Leviticus 19, love your neighbor as yourself. The chapter before affirms God's perfect law when it comes to sexual matters... in Leviticus 18, is that thou shall lay with another man shall be stoned to death."
Stoning gay people to death is "God's perfect law"
Trans people are to blame for inflation: "There's a direct connection to inflation and the trans issue. You say, Charlie, come on. They couldn't be further apart. No, they're exactly the same. They're the same in this aspect—when you believe that men can become women, why wouldn't you also believe that you could print wealth? If you believe that someone can change their gender, why wouldn't you also believe that money is wealth?"
Blacks "were actually better in the 1940s. It was bad. It was evil. But what happened? Something changed. They committed less crimes." (yes, despite the Piers Morgan "fact check", while his reasons for believing black people were better off under segregation was unrelated to segregation itself, he very much did repeatedly argue that black people were better off in the 1940s)
"If I see a Black pilot, I’m going to be like, ‘Boy, I hope he’s qualified.’"
Juneteenth: "It is a neo-segregationist federal holiday, is what it is... The entire point of it, as per postmodernists do and deconstructionists, is to subvert July 4."
We should have "just took care of" trans people "the way we used to take care of things in the 1950s and '60s"
"The Haitians that are in Huntsville that are raping your women and hunting you down at night - it’s only gonna get worse.. There will be hundreds of thousands of Haitians brought into Alabama, and they will become your masters."
"Haiti is legitimately infested with demonic voodoo. I’ve talked to missionaries that have gone there and they say they’ve seen the darkest stuff... people levitating and turning into cats at night."
"Jewish donors have a lot of explaining to do.. Because Jewish donors have been the No. 1 funding mechanism of radical, open border neoliberal quasi-Marxist policies, cultural institutions and nonprofits. This is a beast created by secular Jews. And now it’s coming for Jews.. It’s the nonprofits, it’s the movies, it’s Hollywood, it’s all of it."
Calling Joy Reid, Michelle Obama, Sheila Jackson Lee and Ketanji Brown "affirmative action picks".
Calling the man who attacked Nancy Pelosi's husband with a hammer an "amazing patriot" and called on people to bail out the attacker.
"Submit to your husband, Taylor. You’re not in charge. "
"Happening all the time in urban America, prowling Blacks go around for fun to go target white people, that’s a fact. It’s happening more and more."
"MLK was awful. He’s not a good person... We made a huge mistake when we passed the Civil Rights Act in the 1960s."
"Transgenderism and gender 'fluidity' are lies that hurt people and abuse kids." Transgender identity is a "throbbing middle finger to God."
Gun violence as a "cost" to having no gun control: "I think it’s worth it. I think it’s worth to have a cost of, unfortunately, some gun deaths every single year so that we can have the Second Amendment to protect our other God-given rights. That is a prudent deal. It is rational."
"The 'Great Replacement' is not a theory, it's a reality."
"The great replacement strategy, which is well underway every single day in our southern border, is a strategy to replace white rural America with something different."
"Islam is not compatible with Western civilization."
"Islam is the sword the left is using to slit the throat of America."

On and on. Man, such a moderate centrist who never espoused bigotry or promoted violence!

The one being incorrect is you. Archie's representation is quite accurate, in the US context.

Yes, a very "middle of the road" supporter of far-right Tommy Robinson (who has a 17% positivity ranking among Brits). The guy who said "When wolves get out of control, you shoot them. When gypsies take over public spaces, you deport them." The guy who described diversity as an "ideological inferno", a "religion" led by "high priests". The guy who was so radical and repressive at Basecamp that at one point 1/3rd of its employees all walked out en masse. Truly, a remarkable centrist of our times!

Not talking about VRAM or unified memory. Regular DRAM.

There's been a lot of advancement recently on how to best manage MoE expert swapping (FreeToken is just one example).

How are you connecting to Slashdot from the year 2024?

If you have ~128 GB of RAM, consider Qwen 3.8 Flash + Freetoken. You'll only get half the tok/s as 27B but the quality is significantly higher than 27B - it beats it solidly in all compared benchmarks (for example, DeepSWE 1.1: 42,2% vs 58.7%).

Grok is a "discount model". It's cheaper than Claude Sonnet yet better than it. Doesn't compare to Fable or Opus, but then again, they're way more expensive models.

Note: I avoid using Grok - not just for the Musk factor, but because there are better options, e.g. GLM-5.3 and Qwen-3.8. Also, if you really want to save money, GLM-5.3 Flash and Qwen-3.8 Flash are amazingly good for their price range.

[ConfusedMathLady.gif]

Physical ones are definitely rare beasts. Hypervisors make having support for it a lot more generally useful, though. You can still run into weird edge case limitations(certain PCIe devices, under some circumstances, really don't like being detached from the host and popped onto a VM); but the hypervisor will definitely be able to tell guests stories of dynamic reconfiguration that the hardware isn't electrically or mechanically capable of supporting; and being able to add or remove CPUs or RAM without rebooting is nice.

Ed Zitron is a moron who has predicted the past nine out of zero AI crashes, who simultaneously gets paid to hate on AI while also getting paid to promote AI (DoNotPay).

The funny thing is that he openly acknowledges that inference is very profitable (~40% margins) for all parties - he just argues that you should count training. But that argument makes no sense, because if capital tightens across the AI industry, then everyone will cut back on training and scaleup, and... then what? Where's the implosion? Everyone is profitable then. You may lose certain players in competition against others (their as-mentioned profitable assets being gobbled up by others), but the industry remains healthy.

There are more dramatic types of possible contagion risk, but they all end up with *someone* holding onto the high-profit-generating inference assets, even if it's high-seniority investors, leaving the the low seniority investoors high and dry.

The enshittification of Cursor continues.

Maybe this will force them to support more open models.

While they're currently only applying this to people with extreme cholesterol problems, there's no reason the same treatment wouldn't work for anyone on statins. They use different dosages to impact a different percentage of the liver cells to adjust cholesterol levels, essentially introducing a mutation found in a small percentage of the population where a particular gene is inactive. For people with more manageable cholesterol levels, they would presumably just need a lower dosage to get levels below that where medication is required.

So for now, this will likely be only used in extreme cases, but over time, this could be an alternative to statins just like lasik is an alternative to glasses.

I would love to stop taking my statins, and I'm sure many other people would also opt for something like this. Once they get more experience in the more extreme cases, there's every reason to believe they'll open it up for wider usage. Apparently between 50% and 65% of people fail to take their statins consistently for various reasons, so this could be much more effective and reducing heart disease.