Nvidia AI Plays Minecraft, Wins AI Conference Award (arstechnica.com) 17
A paper describing MineDojo, Nvidia's generalist AI agent that can perform actions from written prompts in Minecraft, won an Outstanding Datasets and Benchmarks Paper Award at the 2022 NeurIPS (Neural Information Processing Systems) conference, Nvidia revealed on Monday. Ars Technica reports: To train the MineDojo framework to play Minecraft, researchers fed it 730,000 Minecraft YouTube videos (with more than 2.2 billion words transcribed), 7,000 scraped webpages from the Minecraft wiki, and 340,000 Reddit posts and 6.6 million Reddit comments describing Minecraft gameplay. From this data, the researchers created a custom transformer model called MineCLIP that associates video clips with specific in-game Minecraft activities. As a result, someone can tell a MineDojo agent what to do in the game using high-level natural language, such as "find a desert pyramid" or "build a nether portal and enter it," and MineDojo will execute the series of steps necessary to make it happen in the game.
MineDojo aims to create a flexible agent that can generalize learned actions and apply them to different behaviors in the game. As Nvidia writes, "While researchers have long trained autonomous AI agents in video-game environments such as StarCraft, Dota, and Go, these agents are usually specialists in only a few tasks. So Nvidia researchers turned to Minecraft, the world's most popular game, to develop a scalable training framework for a generalist agent "one that can successfully execute a wide variety of open-ended tasks." The award-winning paper debuted in June.
You can see examples of MineDojo in action on its official website, and the code for MineDojo and MineCLIP is available on GitHub.
MineDojo aims to create a flexible agent that can generalize learned actions and apply them to different behaviors in the game. As Nvidia writes, "While researchers have long trained autonomous AI agents in video-game environments such as StarCraft, Dota, and Go, these agents are usually specialists in only a few tasks. So Nvidia researchers turned to Minecraft, the world's most popular game, to develop a scalable training framework for a generalist agent "one that can successfully execute a wide variety of open-ended tasks." The award-winning paper debuted in June.
You can see examples of MineDojo in action on its official website, and the code for MineDojo and MineCLIP is available on GitHub.
Unimpressed: it cheats (Score:3)
I'm now suspicious that the "find a desert temple" video relies on it being plonked down right in front of a desert temple because it certainly does not show it exploring the world to find one. Even the moving across terrain video only shows it moving across flat terrain - can it handle mountains and avoid dangerous falls into caves etc? In a few clips it seems to also completely ignore hostile mobs.
Building its own Nether portal was about as good as it gets.
Re: (Score:1)
Which is strange because A.I. that can path out of the 2b2t spawn area already exists. That includes a couple thousand meters of some hairy parkour too. And while some regulars are trying to find and kill it.
Re: (Score:2)
Which is strange because A.I. that can path out of the 2b2t spawn area already exists.
Which is nuts, because that puts it in the 98th percentile of actual humans
Re: (Score:2)
Next video about Minecraft cheating from Karl Jobst in 3... 2... 1...
Re: (Score:2)
You are 2 days late. :-)
The Biggest Cheater In Minecraft History Was Just Exposed [youtube.com]
Re: (Score:2)
I know - but since it's not about this "A.I." cheating I was expecting yet another one - unless Billy Mitchell plays Minecraft now... :P
Re: (Score:2)
Be careful or you may end up getting sued! Apparently calling out the certain achievements that are impossible to achieve in games is now "defamation". Who knew that Billy Mitchell was speedrunning frivolous litigation. /s
But... (Score:3)
Re: (Score:2)
Does it know how to tell all the other players that it had sex with their mom?
Perhaps they could partner with Microsoft to incorporate one of their AI chatbots.
Now let's start it on GregTech (Score:1)
That should be entertaining.
They could make a youtube video series about it.
File it Under: Fulfilling Self-Created Goals (Score:2)
Re: (Score:1)
Re: (Score:2)
Why not compare someone brushing their teeth to the creation of the Falcon 9?
Perspectives (Score:2)
I'm impressed with the nether portal building.
You could imagine showing a system like this videos of house hold chores, equipping it with arms, like the Tesla bot that might some day arrive, and then it starts doing the laundry?
was it (Score:2)
sethbling? Mari/o.... minecraft....
"730,000 Minecraft YouTube videos" (Score:1)