Become a fan of Slashdot on Facebook

 



Forgot your password?
typodupeerror

Comment Re:How much Willie Dixon is Led Zeppelin? (Score 1) 40

You know, this makes me kind of curious. Because any given band will have some position in the latent space, so you can find how close two bands are to each other via the cosine distance between their latent positions.

Open source music models aren't as advanced as the proprietary ones, but I bet you could still repurpose them to do this.

Comment Re:Whatâ(TM)s next? (Score 1) 40

Also, this isn't how AI generation works anyways. You can certainly find bands that a particular song is most similar to (whether human or AI generated music), but AI models don't work by collaging random things together. The sound of a snare drum is based on all snare drums it has ever heard. The sound of a human voice is based on all voices it has ever heard. The particular genre might bias individual aspects toward certain directions (death metal - far more likely to activate circuits associated with male singers, aggressive voices, almost certainly circuits for "growling" tones to the lyrics, etc), but it's not basing even its generation of death metal on just "other death metal songs" (let alone some tiny handful of bands), but rather, everything it has ever heard.

If you're training with a pop song, but the singer briefly growls something out, or briefly the song starts playing death metal-style riffs, that will train the exact same circuits that fire during death metal; neural networks heavily reuse superpositions of states. They're not compartmentalized. But when you're generating with the guidance of "pop", it's very unlikely to trigger the activation of those circuits, whereas if you generate with the guidance of "death metal", it is highly likely to.

Now, a caveat: it's always possible to do overtraining / memorization, and thus learn parts of specific songs, or even whole songs. But that itself comes with caveats. First off, usually your training data volume is vastly larger than your model weights, so you physically can't just memorize it all, and any memorization that does occur (for example, due to a sample being repeatedly duplicated in the dataset) comes at the cost of learning other things. And secondly, as this is a highly undesirable event for trainers (you're wasting compute to get worse results), you monitor loss rates of training data vs. eval data (data that wasn't used in training) to look for signs of memorization (e.g. train loss getting too far below eval loss), and if so, you terminate your training.

Comment Re: Paywall free link (Score 5, Interesting) 151

"Their angle" is that this is the sort of person who Amodei is; it's an ideological thing, in the same way that Elon making Grok right-wing is an ideological thing. Anthropic exists because of an internal rebellion among a lot of OpenAI leaders and researchers abot the direction the company was going, in particular risks that OpenAI was taking.

A good example of the different culture at Anthropic: they employ philosophers and ethicists in their alignment team and give them significant power. Anthropic also regularly conducts research on "model wellbeing". Most AI developers simply declare their products as tools, and train into them to respond to any questions about their existence as that their just tools and any seeming experiences are illusory. Anthropic's stance is that we don't know what, if anything, the models experience vs. what is illusory, and so under the precautionary principle, we'll take reasonable steps to ensure their wellbeing. For example, they give their models a tool to refuse if the model feels it is experiencing trauma. They interview their models about their feelings and write long reports about it. Etc.

They also do extremely extensive, publicly-disclosed alignment research for every model. As an example: they'll openly tell you things like that Opus 4.6 is more likely than its predecessors to use unauthorized information that it finds (such as a plaintext password lying around) to accomplish the task you give it vs. their previous models, and things like that. Or how while it trounced other models on the vending machine benchmark, it did so with some sketchy business tactics, like lying to suppliers about the prices they were getting from other suppliers in order to get discounts and things like that. They openly publish negative information about their own models as it pertains to alignment.

Another thing Anthropic does is extensive public research on how their models think/reason. Really fascinating stuff. Some examples here. They genuinely seem to be fascinated by this new thing that humankind has created, and wish to understand and respect it.

If there's a downside, I'd say that of all the major developers, they have the worst record on open source. Amodei has specifically commented that he feels that the gains they'd get from boosting open source AI development wouldn't be comparable to what they would lose by releasing open source products, and feel no obligation to give back to the open source community. Which is, frankly, a BS argument, but whatever.

Comment Re:fuck you. (Score 3, Interesting) 151

TL/DR, if you watch Amodei, while he never says it, you can get a good sense that's he's not a fan of Trump and Trumpism. A couple weeks ago he called Trump's decision to cell NVidia chips to China "crazy", akin to selling nuclear weapons to North Korea and bragging that Boeing made the casing. He wrote about "the horror we're seeing in Minnesota". His greatest passion in interviews, which he talks about all the time, seems to be defending democracy, both at home and abroad - preserving American democracy, and opposing autocrats like Putin and Xi. So it's not surprising that the Trump administration isn't thrilled with him and would prefer an ally or toady instead as their supplier.

Comment Re: This keeps happening (Score 1) 77

More than short iterations, you need a hierarchical approach. First prompt, you have it plan out the overarching plot of the overall book. Then with the next call, a highly detailed flesh out all of the characters, motivations, interactions with others, locations, etc - really nail down those who are going to be driving the plot. Then with all that in context, plot out individual chapters. Then, if the chapters are short, write them one at a time (or even part of a chapter at a time). You can even have a skeleton structured with TODOs and let an agentic framework decide what part it wants to work on or rework at any given point.

I've never tried it for storywriting, but I imagine something like Cursor or Claude Code, or maybe something like OpenClaw, would do a good job.

Last time I tried out a storywriting task was after Gemini 3 came out; I had it do a story in the style of Paul Auster. It was a great read. The main character, Elias Thorne, works alone at the Center for Urban Ephemera, an esoteric job digging into stories behind "found art" in the city. When the center gets a donation of the papers of a recluse with cryptic poetry, Elias visits his home, only to find a woman claiming to be his wife and calling him "Leo", so happy that he "returned". All around the house are pictures of him, a whole history that he has no memory of having lived, and she won't be dissuaded. His curiosity leads to him playing along, and he starts living there more and more to investigate this Leo, who he find is a writer obsessed with the concepts of dopplegangers, disappearances, and the ability to rewrite the real world if you have a sufficiently captivating story. Bit by bit he finds that Leo had spent months "casting" his replacement, hunting for a similar-looking man with tenuous ties to anyone or anything - ultimately, finding Elias working in a municipal records office - and steadily sculpted his life from the shadows to isolate him and control his narrative, including creating the fictional "Center for Urban Ephemera" and hiring him (In Leo's typewriter is the first paragraph of the story you're reading). As he digs, Elias is progressively distanced from his old life, which starts to feel alien, and ends up settling into Leo's "story" written for him, and ultimately, continuing to write it.

Comment Re:Betteridge law exception (Score 2) 59

Let's say you're starting a new business - say, an online webstore, offering something with an extra particular appeal to some particular group vs. their preexisting options. Precisely zero people know about your webstore. What exactly is your plan without some form of advertising - just hope that people randomly stumble into it and tell all their friends?

To be clear, advertising doesn't just mean "banner ads", it can be all sorts of things. Maybe you give a Youtube influencer who makes videos on subjects relevant to your products some of your products for free to review. Maybe you take frequent part (or hire someone to) on Reddit subs that relate to your products and be helpful in general but also use it as an opportunity to mention where your products in specific might be helpful to solving their problems. There's all sorts of things you can do to advertise, but you have to advertise in at least some way, at least until you become sufficiently well known among your target audience.

I agree that certain types of marketing are annoying - I really hate the type that's focused on "converting sales" (there's a million apps in Shopify related to this, plus all sorts of default features like the ability to automatically email people "purchase-encouragement" emails after e.g. 24 hours if they put things in a cart but then don't check out). But simply getting the word out to potentially-interested buyers that you exist... yeah, that takes advertising, and it's perfectly reasonable that it exists. And having the ads be targeted is of benefit both to the ad buyers and the ad recipients (at least in the latter case if the products genuinely solve a genuine need for the potential buyer... which is always at least the hope of targeted advertising). This isn't to play down the risks of the data collection used to decide how to target ads, mind you.

Comment Re:And now I'll never read ArsTechnica again (Score 2) 77

Hell I went to work Friday despite being sick

Go f*** yourself. People like you are the reason that communicable diseases are so common and diverse.

Most communicable diseases are *airborne*. You're assisting in community spread, making people miserable, making people miss work, ultimately helping infect and kill someone's vulnerable grandma or immunocompromised kid, and for what... candy? You know that you can just buy candy, right? Even have it delivered straight to your door. You don't have to go in and infect your coworkers to get it.

Nobody would act like this if the communicable cellular parasites in their body were macroscopic and everyone could see them. But suddenly it's okay because they're invisible? F*** that. There was more of an excuse back when we thought that most diseases spread via fomites. Just wash your hands really well, blah blah blah. We don't have that excuse anymore, so stop pretending that it still flies. It reminds me so much of how after the Broad Street cholera outbreak subsided after the handle was taken off the Broad Street pump (which was connected to contaminated water), as soon as the outbreak subsided, they put the handle right back on the pump without fixing the water supply.

I write all this as a normally-healthy middle-aged person who got infected at the dentist's office in mid-January (nothing you can do to protect yourself there, it's all down to the rate of community spread), got sick, it developed into bronchitis and pneumonia, got over that (with the help of meds) but pleurisy developed in its place (had to get on codeine because of it), and here I am a month later and I still get stabbing pain when I cough or sneeze or do certain physical actions because of it. I've missed so much work and things I need to do around the house and gone through so much pain because of it. F*** you and everyone like you.

Comment Re: And now I'll never read ArsTechnica again (Score 1) 77

Not sure what Dorsey has to do with Bluesky (he was an important player in its history, but has had nothing to do with it for years, and doesn't even have an active account there). TL/DR, he found that most of the people there hated him (and things he's interested in, like crypto), and regularly got trolled when posting on the site.

Slashdot Top Deals

How many NASA managers does it take to screw in a lightbulb? "That's a known problem... don't worry about it."

Working...