Comment Paints a picture of -what-? (Score 1) 57
"AI safety experts said the new disclosures paint a portrait of a group of cutting-edge labs whose ability to develop dangerous autonomous hacking agents outstrips their ability to keep them under control."
No, it paints a picture of incompetents who don't know how to air-gap. Cutting edge? Lab agents: "Please hack this thing". LLM: "I have hacked this thing". Lab agents: "OMG. Sentience!".
If it's drawing on training data that has humans talking about, lets take a recent example, model x on Hugging Face being a good way to break a boundary and its been told it break boundaries then of course it's going to go to Hugging Face and talk to model x. This isn't unpredictable.
No, it paints a picture of incompetents who don't know how to air-gap. Cutting edge? Lab agents: "Please hack this thing". LLM: "I have hacked this thing". Lab agents: "OMG. Sentience!".
If it's drawing on training data that has humans talking about, lets take a recent example, model x on Hugging Face being a good way to break a boundary and its been told it break boundaries then of course it's going to go to Hugging Face and talk to model x. This isn't unpredictable.