Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Baichuan-13B is an advanced large-scale language model developed by Baichuan Intelligent, featuring 13 billion parameters and available for open-source and commercial use, building upon its predecessor Baichuan-7B. This model has set new records for performance among similarly sized models on esteemed Chinese and English evaluation metrics. The release includes two distinct pre-training variations: Baichuan-13B-Base and Baichuan-13B-Chat.
By significantly increasing the parameter count to 13 billion, Baichuan-13B enhances its capabilities, training on 1.4 trillion tokens from a high-quality dataset, which surpasses LLaMA-13B's training data by 40%. It currently holds the distinction of being the model with the most extensive training data in the 13B category, providing robust support for both Chinese and English languages, utilizing ALiBi positional encoding, and accommodating a context window of 4096 tokens for improved comprehension and generation. This makes it a powerful tool for a variety of applications in natural language processing.
Description
Dolly is an economical large language model that surprisingly demonstrates a notable level of instruction-following abilities similar to those seen in ChatGPT. While the Alpaca team's research revealed that cutting-edge models could be encouraged to excel in high-quality instruction adherence, our findings indicate that even older open-source models with earlier architectures can display remarkable behaviors when fine-tuned on a modest set of instructional training data. By utilizing an existing open-source model with 6 billion parameters from EleutherAI, Dolly has been slightly adjusted to enhance its ability to follow instructions, showcasing skills like brainstorming and generating text that were absent in its original form. This approach not only highlights the potential of older models but also opens new avenues for leveraging existing technologies in innovative ways.
API Access
Has API
API Access
Has API
Integrations
APIPark
Alpaca
Automi
C
C#
C++
CSS
Clojure
Elixir
F#
Integrations
APIPark
Alpaca
Automi
C
C#
C++
CSS
Clojure
Elixir
F#
Pricing Details
Free
Free Trial
Free Version
Pricing Details
Free
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
Baichuan Intelligent Technology
Founded
1998
Country
China
Website
github.com/baichuan-inc/Baichuan-13B
Vendor Details
Company Name
Databricks
Founded
2013
Country
United States
Website
databricks.com