Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
CodeQwen serves as the coding counterpart to Qwen, which is a series of large language models created by the Qwen team at Alibaba Cloud. Built on a transformer architecture that functions solely as a decoder, this model has undergone extensive pre-training using a vast dataset of code. It showcases robust code generation abilities and demonstrates impressive results across various benchmarking tests. With the capacity to comprehend and generate long contexts of up to 64,000 tokens, CodeQwen accommodates 92 programming languages and excels in tasks such as text-to-SQL queries and debugging. Engaging with CodeQwen is straightforward—you can initiate a conversation with just a few lines of code utilizing transformers. The foundation of this interaction relies on constructing the tokenizer and model using pre-existing methods, employing the generate function to facilitate dialogue guided by the chat template provided by the tokenizer. In alignment with our established practices, we implement the ChatML template tailored for chat models. This model adeptly completes code snippets based on the prompts it receives, delivering responses without the need for any further formatting adjustments, thereby enhancing the user experience. The seamless integration of these elements underscores the efficiency and versatility of CodeQwen in handling diverse coding tasks.
Description
StarCoder and StarCoderBase represent advanced Large Language Models specifically designed for code, developed using openly licensed data from GitHub, which encompasses over 80 programming languages, Git commits, GitHub issues, and Jupyter notebooks. In a manner akin to LLaMA, we constructed a model with approximately 15 billion parameters trained on a staggering 1 trillion tokens. Furthermore, we tailored the StarCoderBase model with 35 billion Python tokens, leading to the creation of what we now refer to as StarCoder.
Our evaluations indicated that StarCoderBase surpasses other existing open Code LLMs when tested against popular programming benchmarks and performs on par with or even exceeds proprietary models like code-cushman-001 from OpenAI, the original Codex model that fueled early iterations of GitHub Copilot. With an impressive context length exceeding 8,000 tokens, the StarCoder models possess the capability to handle more information than any other open LLM, thus paving the way for a variety of innovative applications. This versatility is highlighted by our ability to prompt the StarCoder models through a sequence of dialogues, effectively transforming them into dynamic technical assistants that can provide support in diverse programming tasks.
API Access
Has API
Yes
API Access
Has API
No
Integrations
Python
Yes
Alibaba Cloud
Yes
AtCoder
Yes
Code Llama
Yes
CodeQwen
No
Codeforces
Yes
DeepSeek Coder
Yes
GPT-3.5
Yes
GPT-4
Yes
GitHub
No
Integrations
Python
Yes
Alibaba Cloud
No
AtCoder
No
Code Llama
No
CodeQwen
Yes
Codeforces
No
DeepSeek Coder
No
GPT-3.5
No
GPT-4
No
GitHub
Yes
Pricing Details
Free
Free Trial
No
Free Version
Yes
Pricing Details
Free
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
No
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
Yes
Mac
Yes
Linux
Yes
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
Yes
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Alibaba
Founded
1999
Country
China
Website
github.com/QwenLM/CodeQwen1.5
Vendor Details
Company Name
BigCode
Founded
2023
Website
huggingface.co/blog/starcoder