Forgot your password?
typodupeerror

Comment Re:If you're educating students for an "AI Era" (Score 1) 78

At present, no. I've done a number of experiments with LLMs' capabilities with generating fiction, and while they are impressive for a beginner writer -- because fo the lack of spelling and grammar mistakes, they are nowhere near being able to write competent fiction.

This is because they don't model reader or character minds, they're based on word probabilities, like a predictive text keyboard. The engineers can compensate for for this to a surprising degree by feeding it data to recognize specific situations (e.g. the car wash is 100 feet from my driveway; should I drive or walk?). But this is turd-polishing.

Comment If you're educating students for an "AI Era" (Score 4, Insightful) 78

AI technology practice isn't foundational. Critical thinking is. The closer AIs come to being able to do something that looks like them doing our thinking for us, the more capable we have to be at thinking without them. A human who can't outthink an AI adds nothing to an AI-human partnership.

This proposed school is a typical scheme by people who think because they have been educated, they understand how the education works. This is like thinking because you eat, you know how to cook. Project work in education is nothing new; it goes back well over a century. And in real life, you may get a STEM degree, but your real education in engineering comes from real life work. But that doesn't mean classes in calculus and physics don't do anything for you.

Or English classes, for that matter. Nobody doubts the value of project work in education, particularly *androgogy* -- the education of adults. But for *pedagogy* you have to establish foundational skills as the student matures intellectually and socially. Entering the high school years, a typical student has had *no* training in critical thinking skills. To develop critical thinking skills in an area, you need both general skills (epistemologicla literacy: research, location of orignial sources, dealing with conflicting evidence) and domain specific training in that area. In other words, *liberal arts* training is foundational in an AI-saturated world. "Liberal Arts" -- from *artes liberales*: literally the skills necessary to be a free person.

But I think these people have at least got the problem right: as AI drives the cost of elaborate projects down, we all have more projects in our future. Big, elaborate, faultlessly plausible-looking projects which may or may not have actual value.

Where they are completely wrong is the solution, which is to organize education around practicing using AI to make impressive projects. In a word of AI-enamored dunces this will put you at the head of a very sorry class of ignoramuses. The answer is to build fundamental cognitive and intellectual skils at every stage of a student's development. Project work is surely part of that, but it's just a technique, not a solution.

In a nutshell, the academy is training students to be the next step down the evolutionary scale from code monkeys. More like the pigeons B.F. Skinner trained in WW2 to peck at a screen, in an attempt to create a primitive guided missile without computers. They want to create "main characters"; and they'll probably create a few. There are always a few natural autodidacts in any moderately large group. But what they are set up is to produce a bunch of fragile, economically privileged narcissists trained to cover their lack of education with impressive-looking AI slop.

Comment Re:Its very puzzling, isn't it? (Score 1) 97

While the energy source of wind and solar are free, building and maintaining the plants is not free.

If all they were building were a single 100MW data center, sure: renewables would be cheaper to build. But they evidently are planning a major campus that will consume most of the plant's 615 MW output over the next 25 years.

A solar installation, in a favorable location, capable of supplying 600MW around the clock (with battery backup) would have to be roughly 1800MW in capacity. It would be among the largest inthe world, on the order of ten thousand acres in size at a build cost of maybe 2 billion. The battery backup system to ensure 99.9% uptime would be 9x the size of the largest li-ion grid storage system ever built, and set you back on the order of 4-5 billion dollars.

While it's probably cheaper to go renewable than build a *new* nuclear plant, if you can reactivate and one for just two billion that looks like a bargain, if you have a use for all that power. Inability to save money by load following is the financial Achilles' heel of this generation of reactors, but if you have a guaranteed customer for most of your output, years in advance, that's as close to an ideal economic case for them as anything could be.

Comment Re:So what? (Score 2) 86

ToS is the strongest argument, but the distillers are not parties to the ToS. They get their data from data brokers. It is possible that data brokers are violating the ToS, but it would be hard to write ToS that precluded running queries for third parties without creating problems for consultancies and other businesses. Even presuming the ToS could be written to preclude the data brokers doing that, it doesn't affect the resulting model.

But the general shape of the argument brings us right back to unclean hands: we worked hard on this model and it's not fair for you to profit off our work in a way that doesn't have our permission.

Comment Re:It's just like The Osbornes! (Score 1) 70

I think the fair-minded position is to see what people think when the documentary comes out. You're essentially arguing a negative here -- that there *can't* be anything of value that hasn't been said yet.

Also, I don't think saying something *new* is necessarily critical. Sometimes saying something obvious but in an interesting way is worthwhile.

In this case, Holmes gave access to the filmmaker. Obviously she has an agenda. If the filmmaker is smart, he has an agenda that's different from hers. If he knows his business he'll find something interesting to show you from that conflict.

Now looking at the trailer -- holy shit that woman gives off batshit crazy vibes. That's new to me. I expected her to be slick, persuasive, like Saruman in Lord of the Rings: someone. you'd need real strength of mind to resist being persuaded by. If I'd just handed someone like that my business card, I'd get it back on some pretext then head as fast as I could for the door.

Comment Re:So what? (Score 3, Interesting) 86

It doesn't make it *right*, but it does make claiming it is *wrong* inconsistent with their own behavior. This could prevent the US companies from suing the Chinese companies seeking an injunction (due to the "unclean hands" doctrine), and probably blocks them from seeking monetary damages in most US jurisdictions.

And suing may undermine the US companies own intellectual property claims by exposing their shaky foundations. An AI model isn't *expression*, so it can't be copyrighted. Insofar as the service allows the underlying model to be deduced through regular usage, trade secret protections don't apply because that's *reverse engineering*, which trade secrets don't prevent.

This leaves violations of terms of service. But setting aside the dubious enforceability of anti-reverse engineering provisions, the Chinese companies may not even be parties to the ToS agreement if they are obtaining the model data through a network of contractors and shell companies.With only moderate paranoia, they can effectively shield themselves from some kind of US tort claim.

Which leaves them with the model they've created from the US company's model, but which the US company has no IP claim upon. If I download a DeepSeek model that's been (hypothetically speaking) trained on Claude, Anthropic might not like that, but what can they do about it?

It's a strange situation. US investors are spending cumulatively on over half a trillion dollars a year in the hope of owning a breakthrough frontier model that is the end of the economic world as we know it. But the essence of the model might not be intellectual property at all.

Comment Re:Single dumbest way? (Score 5, Informative) 166

The logic is economic autarky -- the belief that we're always better off having complete political sovereignty over every part of our supply chains than having to depend on imports for anything.

This is likely also behind Trump's trade war with Canada. His demands with Canada aren't about discirimatory tariffs -- those were negotiated away with NAFTA then re-negotiated in his first term. His demands are now infringe on Canadian sovereignty, to give US control of Canada's external trade policy, and even on its internal markets (e.g., the use of French in Canadian internal commerce). Symbolically, that's why he wants to rename Lake Ontario to "Lake America". HIs establishment of US control over the Venezuelan oil industry is his greatest foreign policy achievement -- although it's not clear he understands the legal limits on what he can do with their money.

There's a foreign and military policy angle to this too: Taiwan is absolutely critical to the US economy, so we are absolutely committed to defend them if China invades. Semiconductor autarky would mean it's not our problem.

The problem with autarky is that even if it's a good idea (which economists don't believe), you can't conjure it into existence overnight. It will take many years, possibly decades for the US to replace the Taiwan's semiconductor industry. In effect, the administration is proposing to inflict the very damage on the US economy that a Chinese invasion of Taiwan would inflict.

And, once the US has voluntarily self-inflicted that damage, China would be free to invade Taiwan.

Comment Re:Heavy Lifting (Score 3, Interesting) 66

Investors are chasing a company that achieves some kind of AI singularity. Let's set aside the fact that there's no reason to believe there is anything but diminishing marginal returns by making marginal refinements to current frontier models. Let's imagine someone hits the jackpot and gets, not even AGI, but a system that's as far ahead of today's frontier model are ahead of 2020's GPT 2.0 in performance.

Globally AI revenues are 150 billion, against a cumulative burn rate of 450 billion. A model that is a generation ahead of others would almost certainly capture the lion's share of that revenue.

If AGI magically appears as a Sam Altman has promised investors it will, a hundred million is way too low. Add, maybe, another zero to the revenues.

Conservatively, a safer assumption is that frontier models will get marginally better based on refinements in training and reinforcement and the other bits and bobs that go into these systems. The nobody is winning the lion's share of anything, at least overnight. But you have to define "safe". By "safe" I mean unlikely to lose money. But some investors are clearly defining "safe" as "having the greatest chance of owning a piece of the biggest thing ever."

I'm not following this super-closely, but if Anthropic is pursuing adding multi-step model based reasoning to their system, that could be the basis of a generational leap in capability. But if that is an approach that looks like it has a chance of working, then their competitors are no doubt pursuing the same thing. In that case you'd expect the revenue pie to grow as the scope of model utilty increases, but that growth to be split among several competitors. This could credibly result in a revenue stream for some of them that is as big as the entire industry's revenue stream today. But there's going to be hell to pay on the data center impacts end of things.

Comment Re:Can I pay him not to post? (Score 2) 215

Well, yes. For many years, presidential candidates, both Democratic and Republican, referred to the United States as "the indispensible nation". And my reaction was always, "Doesn't that mean the US is a single point of failure for civilization?"

We are currently performing an experiment which addresses this question: can the US enjoy the benefits of soft power without the cost? That's the whole point of obeying *norms*. No individual force is going to punish you if you are treacherous, mercurial, foul-mouthed, disrespectful and generally unpredictable. Everyone will punish you.

I think an inevitable cost of this experiment will be that the world will decide that the US can't be a single point of failure for global democracy any longer. In many ways, that's something that will be good for us. But it's also going to cost us in painful ways. When the world decides to move away from the dollar as the international reserve currency, you will see both inflation and higher interest rates on everything from credit cards to mortgages, to business loans that will offset the export advantages. We will need *more* business investment to shift the economy to producing low value goods again, so the transition will be rocky.

Comment Re:Solar fricken roadways all over again (Score 1) 120

It's a trade off: you get abundant free energy to run the server, with extreme constraints on cooling because your server is running in the most perfect Thermos bottle ever.

Others are taking the opposite tack: undersea data centers for abundant free cooling at the expense of having to get the power down to your servers.

If had to bet on which one is more practial, I'd go with undersea servers. Build them off the coast of Chile, run cables out from batery-backed solar plants in the Atacama desert.

Slashdot Top Deals

Machines that have broken down will work perfectly when the repairman arrives.

Working...