Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Falcon-40B is a causal decoder-only model consisting of 40 billion parameters, developed by TII and trained on 1 trillion tokens from RefinedWeb, supplemented with carefully selected datasets. It is distributed under the Apache 2.0 license.
Why should you consider using Falcon-40B?
This model stands out as the leading open-source option available, surpassing competitors like LLaMA, StableLM, RedPajama, and MPT, as evidenced by its ranking on the OpenLLM Leaderboard.
Its design is specifically tailored for efficient inference, incorporating features such as FlashAttention and multiquery capabilities.
Moreover, it is offered under a flexible Apache 2.0 license, permitting commercial applications without incurring royalties or facing restrictions.
It's important to note that this is a raw, pretrained model and is generally recommended to be fine-tuned for optimal performance in most applications. If you need a version that is more adept at handling general instructions in a conversational format, you might want to explore Falcon-40B-Instruct as a potential alternative.
Description
On June 23, 2025, Microsoft unveiled Mu, an innovative 330-million-parameter encoder–decoder language model specifically crafted to enhance the agent experience within Windows environments by effectively translating natural language inquiries into function calls for Settings, all processed on-device via NPUs at a remarkable speed of over 100 tokens per second while ensuring impressive accuracy. By leveraging Phi Silica optimizations, Mu’s encoder–decoder design employs a fixed-length latent representation that significantly reduces both computational demands and memory usage, achieving a 47 percent reduction in first-token latency and a decoding speed that is 4.7 times greater on Qualcomm Hexagon NPUs when compared to other decoder-only models. Additionally, the model benefits from hardware-aware tuning techniques, which include a thoughtful 2/3–1/3 split of encoder and decoder parameters, shared weights for input and output embeddings, Dual LayerNorm, rotary positional embeddings, and grouped-query attention, allowing for swift inference rates exceeding 200 tokens per second on devices such as the Surface Laptop 7, along with sub-500 ms response times for settings-related queries. This combination of features positions Mu as a groundbreaking advancement in on-device language processing capabilities.
API Access
Has API
No
API Access
Has API
No
Integrations
C
Yes
C++
Yes
CSS
Yes
Clojure
Yes
Elixir
Yes
F#
Yes
HTML
Yes
Java
Yes
JavaScript
Yes
Julia
Yes
Integrations
C
No
C++
No
CSS
No
Clojure
No
Elixir
No
F#
No
HTML
No
Java
No
JavaScript
No
Julia
No
Pricing Details
Free
Open source
Free Trial
No
Free Version
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
Yes
Linux
Yes
Chromebook
No
Deployment
Web-Based
No
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
Yes
Vendor Details
Company Name
Technology Innovation Institute (TII)
Founded
2018
Country
United Arab Emirates
Website
www.tii.ae/
Vendor Details
Company Name
Microsoft
Founded
1975
Country
United States
Website
blogs.windows.com/windowsexperience/2025/06/23/introducing-mu-language-model-and-how-it-enabled-the-agent-in-windows-settings/