Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Created by LM-SYS, RouteLLM is a publicly available toolkit that enables users to direct tasks among various large language models to enhance resource management and efficiency. It features strategy-driven routing, which assists developers in optimizing speed, precision, and expenses by dynamically choosing the most suitable model for each specific input. This innovative approach not only streamlines workflows but also enhances the overall performance of language model applications.
Description
Boldrouter serves as a hosted AI gateway tailored for developers and teams engaged in creating applications utilizing large language models. It offers an OpenAI-compatible API along with a consolidated endpoint that efficiently routes requests among various model providers, intelligently selecting and switching based on criteria such as cost, response time, or provider reliability. Teams have the flexibility to utilize prepaid credits or link their own provider keys, while also having the capability to oversee API keys, set spending limits, and analyze token, model, and latency metrics through an intuitive dashboard. This platform additionally features capabilities like streaming, tool invocation, multimodal requests, embeddings, document text extraction, model consensus and evaluation, and an optional prompt anonymization function that ensures personal data is removed before requests are sent. Supporting a wide range of workflows, the Swiss-hosted service is ideal for applications, SaaS solutions, agents, and developer tools requiring access to diverse AI models. Furthermore, its robust infrastructure promotes seamless integration with existing systems, making it a versatile choice for modern application development.
API Access
Has API
Yes
API Access
Has API
Yes
Screenshots View All
No images available
Integrations
Gemini
Yes
OpenAI
Yes
Amazon Bedrock
Yes
Anthropic
No
Anyscale
Yes
Chatbot Arena
Yes
Claude
Yes
DeepSeek
No
GPT-4
Yes
Gemini Enterprise
Yes
Integrations
Gemini
Yes
OpenAI
Yes
Amazon Bedrock
No
Anthropic
Yes
Anyscale
No
Chatbot Arena
No
Claude
No
DeepSeek
Yes
GPT-4
No
Gemini Enterprise
No
Pricing Details
No price information available.
Free Trial
No
Free Version
Yes
Pricing Details
5.5% per top-up
Pay-as-you-go prepaid credits incur a 5.5% top-up fee. With bring-your-own provider keys, the provider bills token usage directly and boldrouter charges a 5.5% platform fee on that usage. Model charges vary by provider and model.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
Yes
In Person
Yes
Vendor Details
Company Name
LMSYS
Website
github.com/lm-sys/RouteLLM
Vendor Details
Company Name
Cybrient Technologies
Founded
2008
Country
Switzerland
Website
boldrouter.com