Average Ratings 0 Ratings
Average Ratings 1 Rating
Description
Baichuan-13B is an advanced large-scale language model developed by Baichuan Intelligent, featuring 13 billion parameters and available for open-source and commercial use, building upon its predecessor Baichuan-7B. This model has set new records for performance among similarly sized models on esteemed Chinese and English evaluation metrics. The release includes two distinct pre-training variations: Baichuan-13B-Base and Baichuan-13B-Chat.
By significantly increasing the parameter count to 13 billion, Baichuan-13B enhances its capabilities, training on 1.4 trillion tokens from a high-quality dataset, which surpasses LLaMA-13B's training data by 40%. It currently holds the distinction of being the model with the most extensive training data in the 13B category, providing robust support for both Chinese and English languages, utilizing ALiBi positional encoding, and accommodating a context window of 4096 tokens for improved comprehension and generation. This makes it a powerful tool for a variety of applications in natural language processing.
Description
Muse Spark Open is an open-weight foundation model developed by Meta to support multimodal reasoning, autonomous agents, and complex software development tasks. The model features 816 billion total parameters with approximately 42 billion active parameters and a context window supporting up to one million tokens. Its architecture is designed to process multimodal information while maintaining context across lengthy workflows, extensive codebases, and multistep assignments. Muse Spark Open provides capabilities for software engineering, code generation, debugging, application development, and automated testing. Its agentic functionality supports external tool interactions, task planning, computer-based workflows, and execution of complex objectives over extended sessions. The model can run locally using two Apple M5 Ultra Mac Studio systems with the MLX framework, enabling organizations to process information without relying on hosted inference services. Developers can deploy the model through SGLang, vLLM, TensorRT-LLM, Hugging Face Transformers, llama.cpp, and other supported inference engines. Customization is supported through PyTorch and TorchTitan, allowing organizations to adapt the model to specialized applications and workflows. Muse Spark Open is distributed under the Muse Model License and is available through Hugging Face, major cloud model repositories, and hosted API providers including Together AI, Fireworks AI, and OpenRouter.
API Access
Has API
No
API Access
Has API
No
Integrations
APIPark
Yes
Baseten
No
C
Yes
C#
Yes
Clojure
Yes
Elixir
Yes
F#
Yes
HTML
Yes
Java
Yes
Julia
Yes
Integrations
APIPark
No
Baseten
Yes
C
No
C#
No
Clojure
No
Elixir
No
F#
No
HTML
No
Java
No
Julia
No
Pricing Details
Free
Open source
Free Trial
No
Free Version
Yes
Pricing Details
$0
Model weights are available at no charge under the Muse Model License, which has limited commercial-use terms. Hosted inference providers set their own usage prices.
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
Yes
Linux
Yes
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Baichuan Intelligent Technology
Founded
1998
Country
China
Website
github.com/baichuan-inc/Baichuan-13B
Vendor Details
Company Name
Meta
Founded
2004
Country
United States
Website
research.meta.ai/blog/muse-spark-open