Average Ratings 0 Ratings
Average Ratings 1 Rating
Description
An advanced End-to-End MLLM is designed to accept various forms of references and effectively ground responses. The Ferret Model utilizes a combination of Hybrid Region Representation and a Spatial-aware Visual Sampler, which allows for detailed and flexible referring and grounding capabilities within the MLLM framework. The GRIT Dataset, comprising approximately 1.1 million entries, serves as a large-scale and hierarchical dataset specifically crafted for robust instruction tuning in the ground-and-refer category. Additionally, the Ferret-Bench is a comprehensive multimodal evaluation benchmark that simultaneously assesses referring, grounding, semantics, knowledge, and reasoning, ensuring a well-rounded evaluation of the model's capabilities. This intricate setup aims to enhance the interaction between language and visual data, paving the way for more intuitive AI systems.
Description
NVIDIA Nemotron 3.5 Super VL is a multimodal foundation model developed for AI agents that require reasoning, visual understanding, coding, and multistep task execution. Its 120-billion-parameter mixture-of-experts architecture activates approximately 12 billion parameters per token, enabling efficient inference while maintaining substantial model capacity. The model processes text, images, documents, and video within a unified system that combines multimodal interpretation with instruction following and tool use. Its document intelligence capabilities include extracting information from tables, analyzing charts, interpreting page layouts, and processing multipage documents. Video understanding features support visual information retrieval, content review, incident analysis, and reasoning across recorded sequences. The model also supports software engineering tasks such as code analysis, error identification, debugging, testing, and recommending fixes. Developers can customize Nemotron 3.5 Super VL using NVIDIA NeMo for supervised fine-tuning, low-rank adaptation, and reinforcement learning with domain-specific data. Its inference optimizations include speculative decoding, context reuse, multi-token prediction, and NVFP4 quantization to improve throughput and reduce computational requirements. The model is available with open weights and supports deployment across compatible local hardware, enterprise data centers, and cloud infrastructure.
API Access
Has API
No
API Access
Has API
Yes
Integrations
NVIDIA NIM
No
OpenRouter
No
vLLM
No
Pricing Details
Free
Open source
Free Trial
No
Free Version
Yes
Pricing Details
$0
The model is available at no charge under the OpenMDW-1.1 license. Hosted inference through third-party providers may have separate charges.
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
Yes
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Apple
Founded
1976
Country
United States
Website
github.com/apple/ml-ferret
Vendor Details
Company Name
NVIDIA
Founded
1993
Country
United States
Website
nvidia.com