Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Bonsai 27B stands as the latest multimodal flagship in the Bonsai lineup, marking the debut of a 27B-class model designed to operate on mobile devices. Built on the foundation of Qwen3.6 27B, it introduces an elevated level of capability for local devices, featuring advanced multi-step reasoning, structured tool interactions, vision tasks, and agentic loops for computer use that maintain coherence throughout multiple steps. The Bonsai 27B is available in two distinct variants. The Ternary Bonsai 27B employs ternary weights combined with FP16 group-wise scaling, achieving an effective weight of 1.71 bits and occupying a 5.9 GB footprint, suitable for high-performance laptop applications. In contrast, the 1-bit Bonsai 27B utilizes binary weights with identical group-wise scaling, resulting in an effective weight of 1.125 bits and a more compact 3.9 GB footprint, making it compatible with the memory constraints of devices like the iPhone 17 Pro. Both models operate seamlessly across the entire language network, including embeddings, attention mechanisms, MLPs, and the language model head, without resorting to higher-precision alternatives. They also feature a compact 4-bit vision tower, enabling on-device workflows to effectively interpret screenshots, documents, and camera inputs, enhancing user interaction and productivity. This innovative approach underscores Bonsai 27B's commitment to pushing the boundaries of mobile AI capabilities.
Description
On June 23, 2025, Microsoft unveiled Mu, an innovative 330-million-parameter encoder–decoder language model specifically crafted to enhance the agent experience within Windows environments by effectively translating natural language inquiries into function calls for Settings, all processed on-device via NPUs at a remarkable speed of over 100 tokens per second while ensuring impressive accuracy. By leveraging Phi Silica optimizations, Mu’s encoder–decoder design employs a fixed-length latent representation that significantly reduces both computational demands and memory usage, achieving a 47 percent reduction in first-token latency and a decoding speed that is 4.7 times greater on Qualcomm Hexagon NPUs when compared to other decoder-only models. Additionally, the model benefits from hardware-aware tuning techniques, which include a thoughtful 2/3–1/3 split of encoder and decoder parameters, shared weights for input and output embeddings, Dual LayerNorm, rotary positional embeddings, and grouped-query attention, allowing for swift inference rates exceeding 200 tokens per second on devices such as the Surface Laptop 7, along with sub-500 ms response times for settings-related queries. This combination of features positions Mu as a groundbreaking advancement in on-device language processing capabilities.
API Access
Has API
API Access
Has API
Integrations
No details available.
Integrations
No details available.
Pricing Details
No price information available.
Free Trial
Free Version
Pricing Details
No price information available.
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
PrismML
Founded
2026
Country
United States
Website
prismml.com/news/bonsai-27b
Vendor Details
Company Name
Microsoft
Founded
1975
Country
United States
Website
blogs.windows.com/windowsexperience/2025/06/23/introducing-mu-language-model-and-how-it-enabled-the-agent-in-windows-settings/