Best AI World Models

NVIDIA Cosmos serves as a cutting-edge platform tailored for developers, featuring advanced generative World Foundation Models (WFMs), sophisticated video tokenizers, safety protocols, and a streamlined data processing and curation system aimed at enhancing the development of physical AI. This platform empowers developers who are focused on areas such as autonomous vehicles, robotics, and video analytics AI agents to create highly realistic, physics-informed synthetic video data, leveraging an extensive dataset that encompasses 20 million hours of both actual and simulated footage, facilitating the rapid simulation of future scenarios, the training of world models, and the customization of specific behaviors. The platform comprises three primary types of WFMs: Cosmos Predict, which can produce up to 30 seconds of continuous video from various input modalities; Cosmos Transfer, which modifies simulations to work across different environments and lighting conditions for improved domain augmentation; and Cosmos Reason, a vision-language model that implements structured reasoning to analyze spatial-temporal information for effective planning and decision-making. With these capabilities, NVIDIA Cosmos significantly accelerates the innovation cycle in physical AI applications, fostering breakthroughs across various industries.

Genie 3 represents DeepMind's innovative leap in general-purpose world modeling, capable of real-time generation of immersive 3D environments at 720p resolution and 24 frames per second, maintaining consistency for several minutes. When provided with textual prompts, this advanced system fabricates interactive virtual landscapes that allow users and embodied agents to explore and engage with natural occurrences from various viewpoints, including first-person and isometric perspectives. One of its remarkable capabilities is the emergent long-horizon visual memory, which ensures that environmental details remain consistent even over lengthy interactions, retaining off-screen elements and spatial coherence when revisited. Additionally, Genie 3 features “promptable world events,” granting users the ability to dynamically alter scenes, such as modifying weather conditions or adding new objects as desired. Tailored for research involving embodied agents, Genie 3 works in harmony with systems like SIMA, enhancing navigation based on specific goals and enabling the execution of intricate tasks. This level of interactivity and adaptability marks a significant advancement in how virtual environments can be experienced and manipulated.

Marble is an innovative AI model currently undergoing internal testing at World Labs, serving as a variation and enhancement of their Large World Model technology. This web-based service transforms a single two-dimensional image into an immersive and navigable spatial environment. Marble provides two modes of generation: a smaller, quicker model ideal for rough previews that allows for rapid iterations, and a larger, high-fidelity model that, while taking about ten minutes to produce, results in a far more realistic and detailed output. The core value of Marble lies in its ability to instantly create photogrammetry-like environments from just one image, eliminating the need for extensive capture equipment, and enabling users to turn a singular photo into an interactive space suitable for memory documentation, mood board creation, architectural visualization previews, or various creative explorations. As such, Marble opens up new avenues for users looking to engage with their visual content in a more dynamic and interactive way.

Mirage 2 is an innovative Generative World Engine powered by AI, allowing users to effortlessly convert images or textual descriptions into dynamic, interactive game environments right within their browser. Whether you upload sketches, concept art, photographs, or prompts like “Ghibli-style village” or “Paris street scene,” Mirage 2 crafts rich, immersive worlds for you to explore in real time. This interactive experience is not bound by pre-defined scripts; users can alter their environments during gameplay through natural-language chat, enabling the settings to shift fluidly from a cyberpunk metropolis to a lush rainforest or a majestic mountaintop castle, all while maintaining low latency (approximately 200 ms) on a standard consumer GPU. Furthermore, Mirage 2 boasts smooth rendering and offers real-time prompt control, allowing for extended gameplay durations that go beyond ten minutes. Unlike previous world-modeling systems, it excels in general-domain generation, eliminating restrictions on styles or genres, and provides seamless world adaptation alongside sharing capabilities, which enhances collaborative creativity among users. This transformative platform not only redefines game development but also encourages a vibrant community of creators to engage and explore together.

Odyssey-2 represents a cutting-edge interactive video technology that allows for immediate and real-time video generation that users can engage with. Simply enter a prompt, and the system promptly starts streaming several minutes of video that reacts to your input. This innovation transforms video from a traditional playback experience into a responsive, action-sensitive stream: the model operates in a causal and autoregressive manner, crafting each frame based on previous frames and your actions instead of adhering to a set timeline, which enables a seamless adaptation of camera perspectives, environments, characters, and narratives. The platform efficiently begins video streaming nearly instantaneously, generating new frames approximately every 50 milliseconds (around 20 frames per second), ensuring that you don’t have to wait long for content but instead immerse yourself in an evolving narrative. Beneath its surface, the model employs an advanced multi-stage training process that shifts from generating fixed clips to creating open-ended interactive video experiences, granting you the ability to type or voice commands while exploring a world crafted by AI that responds in real-time. This innovative approach not only enhances engagement but also revolutionizes the way viewers interact with visual storytelling.

GWM-1 is Runway’s first family of General World Models created to interact dynamically with simulated reality. Built on Gen-4.5, the model produces real-time, action-conditioned video rather than static imagery alone. GWM-1 allows users to control environments through camera motion, robotics commands, events, and speech inputs. It generates coherent visual scenes that persist across movement and time. The model supports synchronized video, image, and audio generation for immersive simulation. GWM-1 is designed to learn from interaction and trial-and-error rather than passive data consumption. It enables realistic exploration of both physical and imagined worlds. Runway positions GWM-1 as foundational technology for robotics, training, and creative systems. The model scales across multiple domains without manual environment design. GWM-1 marks a shift toward experiential AI systems.

Active Inference represents an innovative approach to agentic AI, grounded in world models and stemming from more than three decades of exploration in computational neuroscience. This paradigm facilitates the development of AI solutions that prioritize both power and computational efficiency, specifically tailored for on-device and edge computing environments. By seamlessly integrating with established computer vision frameworks, our intelligent decision-making systems deliver outputs that are not only explainable but also empower organizations to instill accountability within their AI applications and products. Furthermore, we are translating the principles of active inference from the realm of neuroscience into AI, establishing a foundational software system that enables robots and embodied platforms to make autonomous decisions akin to those of the human brain, thereby revolutionizing the field of robotics. This advancement could potentially transform how machines interact with their environments in real-time, unlocking new possibilities for automation and intelligence.

Game Worlds is an upcoming AI-driven gaming experience developed by Runway, a $3 billion startup that has already made significant impacts on Hollywood with its generative AI technology. The platform currently offers a basic chat interface enabling users to generate text and images, with plans to expand into fully AI-generated video games later this year. Runway’s vision for Game Worlds is to revolutionize the gaming industry by making game development significantly faster and more efficient, similar to AI’s role in accelerating film production. CEO Cristóbal Valenzuela highlights that the gaming sector is adopting AI rapidly, moving faster than Hollywood did two years ago. The platform also intends to collaborate with game companies to train AI models on rich datasets, enhancing its generative capabilities. Game Worlds will provide both gamers and developers with new ways to create, explore, and interact with dynamically generated game content. This initiative is part of Runway’s broader goal to integrate generative AI into creative industries at scale. Game Worlds stands at the forefront of blending AI technology with interactive entertainment.