Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Codestral Embed marks Mistral AI's inaugural venture into embedding models, focusing specifically on code and engineered for optimal code retrieval and comprehension. It surpasses other prominent code embedding models in the industry, including Voyage Code 3, Cohere Embed v4.0, and OpenAI’s large embedding model, showcasing its superior performance. This model is capable of generating embeddings with varying dimensions and levels of precision; for example, even at a dimension of 256 and int8 precision, it maintains a competitive edge over rival models. The embeddings are organized by relevance, enabling users to select the top n dimensions, which facilitates an effective balance between quality and cost. Codestral Embed shines particularly in retrieval applications involving real-world code data, excelling in evaluations such as SWE-Bench, which uses actual GitHub issues and their solutions, along with Text2Code (GitHub), which enhances context for tasks like code completion or editing. Its versatility and performance make it a valuable tool for developers looking to leverage advanced code understanding capabilities.
Description
Voyage AI has unveiled voyage-code-3, an advanced embedding model specifically designed to enhance code retrieval capabilities. This innovative model achieves superior performance, surpassing OpenAI-v3-large and CodeSage-large by averages of 13.80% and 16.81% across a diverse selection of 32 code retrieval datasets. It accommodates embeddings of various dimensions, including 2048, 1024, 512, and 256, and provides an array of embedding quantization options such as float (32-bit), int8 (8-bit signed integer), uint8 (8-bit unsigned integer), binary (bit-packed int8), and ubinary (bit-packed uint8). With a context length of 32 K tokens, voyage-code-3 exceeds the limitations of OpenAI's 8K and CodeSage Large's 1K context lengths, offering users greater flexibility. Utilizing an innovative approach known as Matryoshka learning, it generates embeddings that feature a layered structure of varying lengths within a single vector. This unique capability enables users to transform documents into a 2048-dimensional vector and subsequently access shorter dimensional representations (such as 256, 512, or 1024 dimensions) without the need to re-run the embedding model, thus enhancing efficiency in code retrieval tasks. Additionally, voyage-code-3 positions itself as a robust solution for developers seeking to improve their coding workflow.
API Access
Has API
Yes
API Access
Has API
No
Integrations
Elasticsearch
No
GitHub
Yes
Milvus
No
Mistral AI
Yes
Mistral Code
Yes
Qdrant
No
Vespa
No
Integrations
Elasticsearch
Yes
GitHub
No
Milvus
Yes
Mistral AI
No
Mistral Code
No
Qdrant
Yes
Vespa
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
Yes
In Person
No
Vendor Details
Company Name
Mistral AI
Founded
2023
Country
United States
Website
mistral.ai/news/codestral-embed
Vendor Details
Company Name
MongoDB
Founded
2007
Country
United States
Website
blog.voyageai.com/2024/12/04/voyage-code-3/