Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Molmo 2 represents a cutting-edge suite of open vision-language models that come with completely accessible weights, training data, and code, thereby advancing the original Molmo series' capabilities in grounded image comprehension to encompass video and multiple image inputs. This evolution enables sophisticated video analysis, including pointing, tracking, dense captioning, and question-answering functionalities, all of which demonstrate robust spatial and temporal reasoning across frames. The suite consists of three distinct models: an 8 billion-parameter variant tailored for comprehensive video grounding and QA tasks, a 4 billion-parameter model that prioritizes efficiency, and a 7 billion-parameter model backed by Olmo, which features a fully open end-to-end architecture that includes the foundational language model. Notably, these new models surpass their predecessors on key benchmarks, setting unprecedented standards for open-model performance in image and video comprehension tasks. Furthermore, they often rival significantly larger proprietary systems while being trained on a much smaller dataset compared to similar closed models, showcasing their efficiency and effectiveness in the field. This impressive achievement marks a significant advancement in the accessibility and performance of AI-driven visual understanding technologies.
Description
Pixtral Large is an expansive multimodal model featuring 124 billion parameters, crafted by Mistral AI and enhancing their previous Mistral Large 2 framework. This model combines a 123-billion-parameter multimodal decoder with a 1-billion-parameter vision encoder, allowing it to excel in the interpretation of various content types, including documents, charts, and natural images, all while retaining superior text comprehension abilities. With the capability to manage a context window of 128,000 tokens, Pixtral Large can efficiently analyze at least 30 high-resolution images at once. It has achieved remarkable results on benchmarks like MathVista, DocVQA, and VQAv2, outpacing competitors such as GPT-4o and Gemini-1.5 Pro. Available for research and educational purposes under the Mistral Research License, it also has a Mistral Commercial License for business applications. This versatility makes Pixtral Large a valuable tool for both academic research and commercial innovations.
API Access
Has API
No
API Access
Has API
Yes
Screenshots View All
No images available
Integrations
AI-FLOW
No
Ai2 OLMoE
Yes
Deep Infra
No
GMTech
No
HoneyHive
No
Hugging Face
Yes
Humiris AI
No
Kiin
No
Langflow
No
Lunary
No
Integrations
AI-FLOW
Yes
Ai2 OLMoE
No
Deep Infra
Yes
GMTech
Yes
HoneyHive
Yes
Hugging Face
No
Humiris AI
Yes
Kiin
Yes
Langflow
Yes
Lunary
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
Free
Open source
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
Yes
Linux
Yes
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Ai2
Founded
2014
Country
United States
Website
allenai.org/blog/molmo2
Vendor Details
Company Name
Mistral AI
Founded
2023
Country
France
Website
mistral.ai/news/pixtral-large/