Adobe Premiere Pro Now Lets You Find Video Clips By Describing Them 17
Search in Premiere Pro has been updated with AI-powered visual recognition, allowing users to find videos by describing the contents of the footage. From a report: It's just one of several quality-of-life features Adobe is adding to Premiere Pro, After Effects, and Frame.io that aim to save video editors time on their projects. Users can enter search terms like "a person skating with a lens flare" to find corresponding clips within their media library.
Adobe says the media intelligence AI can automatically recognize "objects, locations, camera angles, and more," alongside spoken words -- providing there's a transcript attached to the video. The feature doesn't detect audio or identify specific people, but it can scrub through any metadata attached to video files, which allows it to fetch clips based on shoot dates, locations, and camera types. The media analysis runs on-device, so doesn't require an internet connection, and Adobe reiterates that users' video content isn't used to train any AI models.
Adobe says the media intelligence AI can automatically recognize "objects, locations, camera angles, and more," alongside spoken words -- providing there's a transcript attached to the video. The feature doesn't detect audio or identify specific people, but it can scrub through any metadata attached to video files, which allows it to fetch clips based on shoot dates, locations, and camera types. The media analysis runs on-device, so doesn't require an internet connection, and Adobe reiterates that users' video content isn't used to train any AI models.
Re: More useless "AI" features (Score:3)
This is not useless and can't be done well without "AI". Is it worth the impact? I'd say no. But at least it is doing something.
Re: More useless "AI" features (Score:5, Insightful)
This is not useless and can't be done well without "AI". Is it worth the impact? I'd say no. But at least it is doing something.
This could be an incredibly useful thing to do. The only problem is that you have to use Adobe Premier.
The usefulness of this is largely not production-related. In all my years of production, I've never once thought, "Where was that clip where so-and-so said [x]," because I actually take the time to organize and label content during the ingest process, which means I can typically find it within seconds *without* the need for AI.
Where this would be useful would be as part of something like Spotlight, done entirely locally on the machine without going out to some server (which I absolutely don't trust Adobe to do), for finding random clips of random things that I've shot over decades that live on various storage media, ranging from my laptop to the cold storage area of my NAS.
But doing that efficiently would pretty much require massive amounts of pre-indexing on all of that media, which would likely take months, which means it would have to have indexing modules not just that run on the Mac, but also that run on Synology. And so on.
Doing this well, in a way that is genuinely useful, is way beyond anything Adobe could ever hope to accomplish, and doing it in a way where I would trust it, without some bulls**t monthly subscription nightmare, is way beyond anything Adobe would ever consider doing, which tells me that I actually have *negative* interest in this, because I would fully expect Adobe to come up with a bunch of bulls**t patents that will make it impossible for anyone else to actually do it right.
So basically, the moment I saw Adobe's name, it became a bad thing, and when I saw that it was something that in other contexts could have been genuinely useful, it became a much worse thing.
Re: (Score:2)
You reminded me of a great interview I read (years ago) with Dieter Meier (singer of Yello). They were working in the early days of samplers and Boris Blank (keyboardist) had racks full of tapes, floppy disks, early hard drives etc.with clips he'd either recorded, or created himself.
Dieter said (something like) he could say to Boris "can we try that sound that's a bit like a rubber ball bouncing off a steel plate in a rainstorm". Boris would then go to his library and pull out the exact piece of media wi
Re: (Score:1)
You're wrong to say it can't be done well without LLM. Techniques like logging and tools like metadata have existed for many many years to address these issues, alongside roles as assistant editors. What this does is allow tight turnaround productions like reality TV to move faster with fewer assistants. You may find that socially beneficial. I'm not sure that I do.
Re: (Score:2)
Techniques like logging and tools like metadata have existed for many many years to address these issues
They do not do what this does, so no.
Re: (Score:1)
They facilitate it. The assistant editor does the rest, so take a hike.
Re: (Score:2)
They facilitate it. The assistant editor does the rest, so take a hike.
I can't take a hike. I don't have an assistant editor, so I have to tag my own videos. Or, and apparently this is too complicated for you to understand without someone drawing you a flowchart, use an automated tool which does the job.
Just say no.. (Score:1, Troll)
..to software subscriptions and crappy AI
Re: (Score:2)
Re: AI to save the world (Score:3)
Show me that video with ... (Score:1)
... whathisname doing that thing he does with that thing he does it with.