Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
CodeT5 is an innovative pre-trained encoder-decoder model specifically designed for understanding and generating code. This model is identifier-aware and serves as a unified framework for various coding tasks. The official PyTorch implementation originates from a research paper presented at EMNLP 2021 by Salesforce Research. A notable variant, CodeT5-large-ntp-py, has been fine-tuned to excel in Python code generation, forming the core of our CodeRL approach and achieving groundbreaking results in the APPS Python competition-level program synthesis benchmark. This repository includes the necessary code for replicating the experiments conducted with CodeT5. Pre-trained on an extensive dataset of 8.35 million functions across eight programming languages—namely Python, Java, JavaScript, PHP, Ruby, Go, C, and C#—CodeT5 has demonstrated exceptional performance, attaining state-of-the-art results across 14 different sub-tasks in the code intelligence benchmark known as CodeXGLUE. Furthermore, it is capable of generating code directly from natural language descriptions, showcasing its versatility and effectiveness in coding applications.
Description
StableCode provides an innovative solution for developers aiming to enhance their productivity through the utilization of three distinct models designed to assist in coding tasks. Initially, the foundational model was developed using a broad range of programming languages sourced from the stack-dataset (v1.2) by BigCode, with subsequent training focused on widely-used languages such as Python, Go, Java, JavaScript, C, Markdown, and C++. In total, our models have been trained on an impressive 560 billion tokens of code using our high-performance computing cluster.
Once the base model was created, an instruction model was meticulously fine-tuned for particular use cases, enabling it to tackle intricate programming challenges effectively. To achieve this refinement, approximately 120,000 pairs of code instructions and responses in Alpaca format were utilized to train the base model.
StableCode serves as a perfect foundation for those eager to deepen their understanding of programming, while the long-context window model provides an exceptional assistant that delivers both single-line and multi-line autocomplete suggestions seamlessly. This advanced model is specifically designed to efficiently manage larger chunks of code simultaneously, enhancing the overall coding experience for developers. By integrating these features, StableCode not only aids in coding but also fosters a deeper learning environment for aspiring programmers.
API Access
Has API
API Access
Has API
Pricing Details
No price information available.
Free Trial
Free Version
Pricing Details
No price information available.
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
Salesforce
Website
github.com/salesforce/CodeT5
Vendor Details
Company Name
Stability AI
Founded
2019
Country
United Kingdom
Website
stability.ai