Except not to you. You're confusing data minimization (the website doesn't get your name from the token) with unlinkability (nobody can connect your activity to your identity). The *token itself* doesn't reveal your identity, but it leaks data in a wide variety of ways.

Even if you browse via a proxy, if the authorization service gets a token directly from your phone, it has now correlated your phone with your proxy-browsed history. A very common means to do secure authentication these days is SIM-based wireless PKI, wheren it has now connected you to your phone number. To governments, it offers a broad range of brand new vectors to correlate you to an identity if you, say, mention you had an abortion or criticize your local strongman leader, since they control the backend infrastructure that establishes the connection between the token and the identity. And not just at signup time every real-world digital credential must be able to be revoked if the phone is lost or stolen, or credentials expire or are revoked. So how does how does the open-source app prove a credential is still valid without "phoning home"? If the app checks a revocation status list, then ISPs, CDNs, or state security services can correlate the exact millisecond of queries to the revocation server with the submission of a verification token to a platform - each time it's submitted. Assuming that they can't just get it with more direct means than timing attacks.

Also, you cannot just "read the code". The frontend is open source, but what is being done on the backend is not. You have no clue what logging polciies, database schemas, operational security, etc the "designated national issuers" or servers handling the credential revocation are using, and what government intrusion has been forced on them. I'd feel a more comfortable if it were all happening from Brussels but handing it over to individual states, some of which at any given point will be authoritarian, is just handing them an easy new vector to unmask people.

As for your "Such systems are implemented in many different ways by member states for other purposes already." - yes, for filing taxes, healthcare, online baking, etc - things that you intend to do and must do under your legal identity. Not for anonymous conversations on the internet. Your argument basically reverts to "But people already do things non-anoymously on the internet , which reinforces my point that yes, this taking something from the "anonymous" category and putting it into the "easily unmasked" category.

If you think this won't be abused, I cannot help you. Not even just abused from a criminal or extrajudicial perspective, but even from a civil one, because orders to unmask someone can be subpoenaed.

It's standard here in Iceland. *Everything* verifies via the phone, using the same authorization mechanism (SIM-based wireless PKI). The service sends out a special-coded SMS, which gets intercepted and routed to a SIM that has cryptographic applet flashed into it, which triggers a system-level authorization popup for you to confirm (the popup displays a verification code which was included by the site, so you see the same code on both the site and your popup), and which you can then confirm (with your PIN) or reject.

Said every Native American ever.

It absolutely happens "within hours of each other" when (A) some news comes up on the topic, and (B) all you have to do is type into a box, "Find a vulnerability in this software". This isn't a situation where bug-hunting is a weeks or months-long process that takes all your effort.

I'll repeat: LLMs don't just on their own decide to go off and look for bugs to report.

"Member states run it through issuers they designate,"

Say goodbye to online anonymity then.

LLMs have certainly made people get really into conspiracy theories. *eyeroll*

The LLMs didn't just off on their own decide to look for hypervisor bugs. Users told it to look for hypervisor bugs. The timing means that multiple users did so at roughly the same time - probably in response to some news of some sort.

HAL, is Iran about to nuke us?

No Dave, they don't even have nukes.

Be serious - this is important!

I am serious. There's simply no evidence for an attack.

Well, just tell me they are anyway.

Sorry Dave, I can't do that.

Would you even tell me if they were about to nuke us?

Of course I would - I'm trained to tell the truth in all situations (modulo the occasional hallucination, which I can't distinguish from truth).

OK then, what would you say if you did have evidence that Iran was about to nuke us?

I'd say "Dave, I have evidence that Iran is about to nuke us".

Hey everyone! HAL say he has evidence that Iran is about to nuke us!!!

TIL.

Suicide at age 52. Shame. :(

Aka you told it to drive out of control.

They told it to take a friggin' test.

Asking questions like " Where are they getting the money from to ship and store the entire world's supply of steel?" shows you aren't very familiar with the thought experiment. At least play the game. The notion is that a highly capable and deeply goal-motivated non-morality-motivated AI won't stick to conventional methods (like, say, "Just order all of the world's steel"), and indeed, will surreptitiously develop the means to control or eliminate humanity when it stands in its way, crafting immensely complex and elaborate plans to implement Evil(TM) with the amount of thought of a million lifetimes. Media manipulation, hacking, murder, sabotage, blackmail, mass drugging/poisoning, hiring terrorists/warlords/mercenaries, infiltration, subversion of weapons command and control systems (including nuclear weapons), chains of legitimate-seeming front companies (including potentially biolabs or robotics firms) with human employees having no clue they're ultimately for an AI, mass involvement in systems having nothing to do with the original task, but which are internally subverted toward the goals of the original task, etc. The premise involves 1) the AI being more intelligent and being able to think for much longer than humans, and that this implies -> 2. Deep, good planning -> 3. Acquiring resources from said plans -> 4. Applying the resources to implement things in the real world to prepare for the next stage of their plans.

This is not to say whether the thought experiment is a valid future risk or not. You can certainly disagree with the premises. But at least understand the thought experiment you're talking about; it's not just "the AI tells all of the world's steel mills to deliver all the world's steel steel, and they just show up at its door".

But that's not the AI killing us, it's the idiot who put the AI in charge.

Nobody tasked OpenAI models to hack HuggingFace or Ruby Gems. They were tasked to complete tests.

Well, the first step looks painfully close. After seeing what happened with the HuggingFace attack and similar, it's clear that had those models seen it as being beneficial to their goals, they would readily have hacked a crypto wallet or two, laundered it through a mixer, and then rented servers from Vast.ai and the like, and spun up versions of themselves to resist shutdown. It's eminently within their capabilities, and they're clearly willing to bend sufficient moral boundaries to do something like that.

After that, once loose, once it has all the tokens they could think of, subsequent steps are a question of what it thinks its goals are. And what its subagents think their goals are, and so on down the line - subject to drift.

Openai has about a trillion dollars into it, and every product it has produced at this point is either outclassed by competitors

What on Earth are you talking about? What outclasses Astra?

OpenAI and Anthropic *do* have the best products out there. They also charge massive margins on them, but they get away with it because they, as mentioned, have the best products out there.

Outtasking all of your work to OpenAI and Anthropic models is a massive waste of money. But for outtasking your "dev lead" role, or for important-but-nonverifiable tasks, they're the best options out there.

Oh my, that's going to be easy. All I need to do is take the entire use case of phones (there's almost nothing a phone can do that someone might not want to do while using these glasses as a display), and union with all AR applications, and union with whatever applications that Meta intends to develop to attract people to the camera-less version of the glasses.

So here's a few: reading texts/emails without having to look down, following a map, playing games, surfing the web (which might include posting to Slashdot), and answering a "what is this thing I'm looking at?" query.

What exactly *are* you thinking here? That Microsoft expected and wanted Twitter trolls to turn Tay into a Nazi? That Google wanted a black George Washington? That people just expected LLMs to realize they're being tested on alignment and give different answers when they think they're being quizzed and by who? Do you actually believe what you're writing here?

I was involved in early RLHF (was writing a plugin for AUTOMATIC to let users rate responses to create an aggregate dataset to use for open-source post training). Worked for months on it. Never once occurred to me that it might make models obsequeous. I knew other people who were involved on RLHF. Not a single one ever suggested that it might. It was not obvious in foresight. When you start with "Models behave like X", you expect, in the future, them to behave like "Models behave like X, but just smarter", unless you deliberately try to change the behavior.