Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Humans naturally excel at devising solutions to unexpected challenges, thanks to their ability to think critically based on past experiences. While the field of machine learning has seen remarkable advancements in the generation and interpretation of text, the development of problem-solving capabilities remains largely confined to basic math and coding tasks, predominantly relying on the retrieval and reproduction of pre-existing answers. In pursuit of DeepMind's objective to unravel the mysteries of intelligence, we developed AlphaCode, a system capable of programming at a competitive standard. By successfully addressing novel problems that necessitate a blend of critical thinking, logic, algorithms, coding skills, and comprehension of natural language, AlphaCode secured an estimated position within the top 54% of participants in various programming contests. Employing transformer-based language models, AlphaCode generates code on a remarkably large scale and adeptly narrows down potential solutions to a select few that show promise, showcasing a notable leap in the capability of machine-generated programming. This innovative approach not only enhances the efficiency of coding but also opens up new avenues for future advancements in AI problem-solving.
Description
StarCoder and StarCoderBase represent advanced Large Language Models specifically designed for code, developed using openly licensed data from GitHub, which encompasses over 80 programming languages, Git commits, GitHub issues, and Jupyter notebooks. In a manner akin to LLaMA, we constructed a model with approximately 15 billion parameters trained on a staggering 1 trillion tokens. Furthermore, we tailored the StarCoderBase model with 35 billion Python tokens, leading to the creation of what we now refer to as StarCoder.
Our evaluations indicated that StarCoderBase surpasses other existing open Code LLMs when tested against popular programming benchmarks and performs on par with or even exceeds proprietary models like code-cushman-001 from OpenAI, the original Codex model that fueled early iterations of GitHub Copilot. With an impressive context length exceeding 8,000 tokens, the StarCoder models possess the capability to handle more information than any other open LLM, thus paving the way for a variety of innovative applications. This versatility is highlighted by our ability to prompt the StarCoder models through a sequence of dialogues, effectively transforming them into dynamic technical assistants that can provide support in diverse programming tasks.
API Access
Has API
API Access
Has API
Integrations
GitHub
Python
C++
ChatGPT
CodeQwen
Codeforces
Git
LM Studio
MaiaOS
OpenAI
Integrations
GitHub
Python
C++
ChatGPT
CodeQwen
Codeforces
Git
LM Studio
MaiaOS
OpenAI
Pricing Details
No price information available.
Free Trial
Free Version
Pricing Details
Free
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
DeepMind
Country
United States
Website
www.deepmind.com/blog/competitive-programming-with-alphacode
Vendor Details
Company Name
BigCode
Founded
2023
Website
huggingface.co/blog/starcoder