Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Bonsai 27B stands as the latest multimodal flagship in the Bonsai lineup, marking the debut of a 27B-class model designed to operate on mobile devices. Built on the foundation of Qwen3.6 27B, it introduces an elevated level of capability for local devices, featuring advanced multi-step reasoning, structured tool interactions, vision tasks, and agentic loops for computer use that maintain coherence throughout multiple steps. The Bonsai 27B is available in two distinct variants. The Ternary Bonsai 27B employs ternary weights combined with FP16 group-wise scaling, achieving an effective weight of 1.71 bits and occupying a 5.9 GB footprint, suitable for high-performance laptop applications. In contrast, the 1-bit Bonsai 27B utilizes binary weights with identical group-wise scaling, resulting in an effective weight of 1.125 bits and a more compact 3.9 GB footprint, making it compatible with the memory constraints of devices like the iPhone 17 Pro. Both models operate seamlessly across the entire language network, including embeddings, attention mechanisms, MLPs, and the language model head, without resorting to higher-precision alternatives. They also feature a compact 4-bit vision tower, enabling on-device workflows to effectively interpret screenshots, documents, and camera inputs, enhancing user interaction and productivity. This innovative approach underscores Bonsai 27B's commitment to pushing the boundaries of mobile AI capabilities.
Description
Introducing a remarkable family of compact language models (SLMs) that deliver exceptional performance while being cost-effective and low in latency. These models are designed to enhance AI functionalities, decrease resource consumption, and promote budget-friendly generative AI applications across various platforms. They improve response times in real-time interactions, navigate autonomous systems, and support applications that demand low latency, all critical to user experience. Phi-3 can be deployed in cloud environments, edge computing, or directly on devices, offering unparalleled flexibility for deployment and operations. Developed in alignment with Microsoft AI principles—such as accountability, transparency, fairness, reliability, safety, privacy, security, and inclusiveness—these models ensure ethical AI usage. They also excel in offline environments where data privacy is essential or where internet connectivity is sparse. With an expanded context window, Phi-3 generates outputs that are more coherent, accurate, and contextually relevant, making it an ideal choice for various applications. Ultimately, deploying at the edge not only enhances speed but also ensures that users receive timely and effective responses.
API Access
Has API
API Access
Has API
Integrations
Azure AI Services
Azure OpenAI Service
BaseRT
Cake AI
Database Mart
Falcon-7B
LM-Kit.NET
Molmo
Msty
NativeMind
Integrations
Azure AI Services
Azure OpenAI Service
BaseRT
Cake AI
Database Mart
Falcon-7B
LM-Kit.NET
Molmo
Msty
NativeMind
Pricing Details
No price information available.
Free Trial
Free Version
Pricing Details
No price information available.
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
PrismML
Founded
2026
Country
United States
Website
prismml.com/news/bonsai-27b
Vendor Details
Company Name
Microsoft
Founded
1975
Country
United States
Website
azure.microsoft.com/en-us/products/phi-3