Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
CodeT5 is an innovative pre-trained encoder-decoder model specifically designed for understanding and generating code. This model is identifier-aware and serves as a unified framework for various coding tasks. The official PyTorch implementation originates from a research paper presented at EMNLP 2021 by Salesforce Research. A notable variant, CodeT5-large-ntp-py, has been fine-tuned to excel in Python code generation, forming the core of our CodeRL approach and achieving groundbreaking results in the APPS Python competition-level program synthesis benchmark. This repository includes the necessary code for replicating the experiments conducted with CodeT5. Pre-trained on an extensive dataset of 8.35 million functions across eight programming languages—namely Python, Java, JavaScript, PHP, Ruby, Go, C, and C#—CodeT5 has demonstrated exceptional performance, attaining state-of-the-art results across 14 different sub-tasks in the code intelligence benchmark known as CodeXGLUE. Furthermore, it is capable of generating code directly from natural language descriptions, showcasing its versatility and effectiveness in coding applications.
Description
Ornith-1.0 represents an innovative family of models tailored specifically for coding tasks that require agentic capabilities. This family encompasses a wide range of models, from the compact 9B Dense versions ideal for deployment on edge devices to the expansive 397B MoE frontier-scale models designed for peak performance, including variants such as 9B Dense, 31B Dense, 35B MoE, and 397B MoE. Built upon the foundational strengths of pretrained models like Gemma 4 and Qwen 3.5, Ornith-1.0 excels in achieving top-tier performance among open-source models that are similar in size when evaluated against coding benchmarks. A significant breakthrough of this model is its self-improving training framework, which effectively learns to produce both solution rollouts and the tailored scaffolds that direct those rollouts. Rather than depending on static, human-crafted harnesses, Ornith-1.0 perceives the scaffold as a dynamic entity that evolves alongside the policy, enabling the model to optimize both the orchestration of tasks and the resulting solutions in tandem. This dual optimization approach enhances the model's adaptability and effectiveness in real-world coding scenarios.
API Access
Has API
API Access
Has API
Integrations
C
C#
Go
Java
JavaScript
PHP
Python
Ruby
Pricing Details
No price information available.
Free Trial
Free Version
Pricing Details
Free
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
Salesforce
Website
github.com/salesforce/CodeT5
Vendor Details
Company Name
DeepReinforce
Country
United States
Website
deep-reinforce.com/ornith_1_0.html