Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

Dolly is an economical large language model that surprisingly demonstrates a notable level of instruction-following abilities similar to those seen in ChatGPT. While the Alpaca team's research revealed that cutting-edge models could be encouraged to excel in high-quality instruction adherence, our findings indicate that even older open-source models with earlier architectures can display remarkable behaviors when fine-tuned on a modest set of instructional training data. By utilizing an existing open-source model with 6 billion parameters from EleutherAI, Dolly has been slightly adjusted to enhance its ability to follow instructions, showcasing skills like brainstorming and generating text that were absent in its original form. This approach not only highlights the potential of older models but also opens new avenues for leveraging existing technologies in innovative ways.

Description

Qwen2.5-1M, an open-source language model from the Qwen team, has been meticulously crafted to manage context lengths reaching as high as one million tokens. This version introduces two distinct model variants, namely Qwen2.5-7B-Instruct-1M and Qwen2.5-14B-Instruct-1M, representing a significant advancement as it is the first instance of Qwen models being enhanced to accommodate such large context lengths. In addition to this, the team has released an inference framework that is based on vLLM and incorporates sparse attention mechanisms, which greatly enhance the processing speed for 1M-token inputs, achieving improvements between three to seven times. A detailed technical report accompanies this release, providing in-depth insights into the design choices and the results from various ablation studies. This transparency allows users to fully understand the capabilities and underlying technology of the models.

API Access

Has API

API Access

Has API

Screenshots View All

Screenshots View All

Integrations

Alibaba Cloud
Automi
CSS
Clojure
Elixir
Go
HTML
Hugging Face
Java
JavaScript
Julia
Kotlin
LM-Kit.NET
ModelScope
R
Ruby
Rust
Scala
TypeScript
Visual Basic

Integrations

Alibaba Cloud
Automi
CSS
Clojure
Elixir
Go
HTML
Hugging Face
Java
JavaScript
Julia
Kotlin
LM-Kit.NET
ModelScope
R
Ruby
Rust
Scala
TypeScript
Visual Basic

Pricing Details

Free
Free Trial
Free Version

Pricing Details

Free
Free Trial
Free Version

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Vendor Details

Company Name

Databricks

Founded

2013

Country

United States

Website

databricks.com

Vendor Details

Company Name

Alibaba

Founded

1999

Country

China

Website

qwenlm.github.io/blog/qwen2.5-1m/

Product Features

Product Features

Alternatives

mT5 Reviews

mT5

Google

Alternatives

Qwen2.5-Max Reviews

Qwen2.5-Max

Alibaba
GPT-J Reviews

GPT-J

EleutherAI
Qwen3.5-Plus Reviews

Qwen3.5-Plus

Alibaba
PaLM Reviews

PaLM

Google
CodeQwen Reviews

CodeQwen

Alibaba
Alpaca Reviews

Alpaca

Stanford Center for Research on Foundation Models (CRFM)