The logic is economic autarky -- the belief that we're always better off having complete political sovereignty over every part of our supply chains than having to depend on imports for anything.

This is likely also behind Trump's trade war with Canada. His demands with Canada aren't about discirimatory tariffs -- those were negotiated away with NAFTA then re-negotiated in his first term. His demands are now infringe on Canadian sovereignty, to give US control of Canada's external trade policy, and even on its internal markets (e.g., the use of French in Canadian internal commerce). Symbolically, that's why he wants to rename Lake Ontario to "Lake America". HIs establishment of US control over the Venezuelan oil industry is his greatest foreign policy achievement -- although it's not clear he understands the legal limits on what he can do with their money.

There's a foreign and military policy angle to this too: Taiwan is absolutely critical to the US economy, so we are absolutely committed to defend them if China invades. Semiconductor autarky would mean it's not our problem.

The problem with autarky is that even if it's a good idea (which economists don't believe), you can't conjure it into existence overnight. It will take many years, possibly decades for the US to replace the Taiwan's semiconductor industry. In effect, the administration is proposing to inflict the very damage on the US economy that a Chinese invasion of Taiwan would inflict.

And, once the US has voluntarily self-inflicted that damage, China would be free to invade Taiwan.

If you were worried about being chased by kill bots, go and watch some videos from drone operators in Ukraine. Robots don't need feet for that job.

Investors are chasing a company that achieves some kind of AI singularity. Let's set aside the fact that there's no reason to believe there is anything but diminishing marginal returns by making marginal refinements to current frontier models. Let's imagine someone hits the jackpot and gets, not even AGI, but a system that's as far ahead of today's frontier model are ahead of 2020's GPT 2.0 in performance.

Globally AI revenues are 150 billion, against a cumulative burn rate of 450 billion. A model that is a generation ahead of others would almost certainly capture the lion's share of that revenue.

If AGI magically appears as a Sam Altman has promised investors it will, a hundred million is way too low. Add, maybe, another zero to the revenues.

Conservatively, a safer assumption is that frontier models will get marginally better based on refinements in training and reinforcement and the other bits and bobs that go into these systems. The nobody is winning the lion's share of anything, at least overnight. But you have to define "safe". By "safe" I mean unlikely to lose money. But some investors are clearly defining "safe" as "having the greatest chance of owning a piece of the biggest thing ever."

I'm not following this super-closely, but if Anthropic is pursuing adding multi-step model based reasoning to their system, that could be the basis of a generational leap in capability. But if that is an approach that looks like it has a chance of working, then their competitors are no doubt pursuing the same thing. In that case you'd expect the revenue pie to grow as the scope of model utilty increases, but that growth to be split among several competitors. This could credibly result in a revenue stream for some of them that is as big as the entire industry's revenue stream today. But there's going to be hell to pay on the data center impacts end of things.

Well, yes. For many years, presidential candidates, both Democratic and Republican, referred to the United States as "the indispensible nation". And my reaction was always, "Doesn't that mean the US is a single point of failure for civilization?"

We are currently performing an experiment which addresses this question: can the US enjoy the benefits of soft power without the cost? That's the whole point of obeying *norms*. No individual force is going to punish you if you are treacherous, mercurial, foul-mouthed, disrespectful and generally unpredictable. Everyone will punish you.

I think an inevitable cost of this experiment will be that the world will decide that the US can't be a single point of failure for global democracy any longer. In many ways, that's something that will be good for us. But it's also going to cost us in painful ways. When the world decides to move away from the dollar as the international reserve currency, you will see both inflation and higher interest rates on everything from credit cards to mortgages, to business loans that will offset the export advantages. We will need *more* business investment to shift the economy to producing low value goods again, so the transition will be rocky.

It's a trade off: you get abundant free energy to run the server, with extreme constraints on cooling because your server is running in the most perfect Thermos bottle ever.

Others are taking the opposite tack: undersea data centers for abundant free cooling at the expense of having to get the power down to your servers.

If had to bet on which one is more practial, I'd go with undersea servers. Build them off the coast of Chile, run cables out from batery-backed solar plants in the Atacama desert.

... sadly for the Americans, the rest of the world now knows they can't count on a US based provider for this kind of thing any more.

It was uncomfortable enough relying so heavily on American software back when it couldn't be switched off remotely on the say so of an idiot. Today it's an intolerable risk.

I think it may be evidence that Amazon has a shitty corporate culture that squeezes every penny it can out its employees.

Corruption can happen anywhere, but it's more likely to happen in totalitarian cultures where people feel like the system is rigged anyway. That's why countries like Russia and China have corruption problems. But I suspect the same feelings of me vs. the system occur in a capitalist enterprise like Amazon where employees are governed by dystopian, rigid, computerized metrics.

The restrictions are a mix of reasonable nuisance management and paranoia about who is flying drones, what they can do, and chain of custody.

Beijing proper is a city with a population density of over 21,000 / km^2 -- so you can imagine the chaos if any tech enthusiast resident could fly a drone without a permit. Except for a couple of free zones in the outer boroughs, New York City restricts drone launcing and landings within the city to flights with a permit and flight plan, because otherwise the sky would be black with drones. Many cities -- both red and blue -- have zone restrictions for drone flights, and those currently hosting World Cup matches have tightened them for the duration of the tournament.

...a lot of people online were saying there was an upcoming event called The Halvening that would change everything.

I guess this is it?

Seems to me 'dead' for a taxi isn't 'dead' for a static power bank. If I'm running a taxi I've got hard limits on how large my battery can be and how heavy, and I want to maximise the mileage I get between charges, because while my taxi is charging it's not out on the road earning money. When that battery is keeping only maybe 80% of its original design charge, and now I have to schedule one recharge too many per working day? Bang goes my business plan, so I'm replacing it.

If I'm storing energy for the grid I'm a lot less worried about that. It only stores 80% of what it did when new? Better than nothing, and the taxi firm is selling them off cheap. I'll stack them up!

Perhaps not, but if you pick your moment right then permanently stopping the work of some of the most talented researchers there could very well make a difference. A spectacular incident that makes the headlines might also deter others - bright graduates might decide it's far safer to take up a different line of work, subcontractors and suppliers might decide doing business with AI firms isn't worth the danger, investors might figure the increased risk of loss of premises and equipment into their projections, that kind of thing.

If people genuinely believed AI takeover was a real, present and imminent threat, then they wouldn't just be publishing essays online, they'd be forming direct action groups, along the full spectrum of campaigning: all the way from awareness raising publicity campaigns, through picketing, blockades and sit-ins, up through Black Bloc type actions, right up to menacing intimidation campaigns and terrifying physical force operations. But I don't see any Butlerian Jihad getting started. Which tells me they don't actually believe this at all; they're just bigging up their own importance. 'Oh yes, our technology is so incredibly powerful, if it were done wrong then imagine what could happen! Keep the money coming to make sure it's done right instead! Then all that power can be ours instead!... I mean, uh, yours, Mr Investor sir.'

AI stock valuations don't make a bit of sense unless the technology turns out to be every bit as powerful as that. If they don't keep that thought alive, then the bubble bursts right now. That's what all this hot air is about, and that's why nobody really pulls a Miles Dyson at the AI research lab.

The interesting thing about the Terminator movies is that when AI researcher Miles Dyson became convinced that his work had a high probability of resulting in an artificial general intelligence attempting to replace humanity, he did not go and post a ten thousand word essay on LessWrong about how he had updated his timeline and p(doom) estimates and discussing the full Bayesian analysis of the situation. He went to the lab that very night with some heavily armed companions and he blew the place up.

I keep hearing that one AI researcher or another claims that they believe as Dyson came to believe. Until one of them takes similar action, I simply do not believe that they actually think their research carries such a risk.

You have access to the lab where the work is being done? You regularly meet in person with leading researchers and talents driving the project forward? You are an American and you have the Second Amendment? And the entire future light cone is at stake? Quintillions of hypothetical future lives riding on the outcome of this project here and now?

What's the most effective, altruistic thing you could do for them?

Yeah, exactly. I've never heard of anyone shooting up their AI lab. Which tells me they don't believe their AI is at all likely to wipe us all out.

... and then to secure Ukraine into the European economic and defence structure as firmly as possible. At this point they're far ahead of NATO on how to use drones and robots in war, and they're clearly getting very, very good at building them too. European military and aerospace people both will have a lot to gain from cooperation with Ukraine after the war is over.

As cadets were so memorably told a generation ago: remember always, your duty is clear - to build and maintain those robots!

Sounds good - DDG is pretty bad lately, it typically just returns a list of AI generated SEO slop pages, so I've been switching back to Google in a private tab for a lot of things. Might be worth trying this one now!

If they leave them there, the next administration might be able to switch them back on and start gathering woke climate science data again.