Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

Kosmoy helps enterprise teams answer practical questions about production AI: which systems are running, who owns them, what they cost and which controls apply. Its inventory records AI systems, models, agents and MCP servers with ownership and risk assessments. Monitoring tracks usage, costs and behaviour across applications. The AI Gateway applies access controls, guardrails, routing and logging to LLM, MCP and agent-to-agent traffic. Action Capsule provides runtime isolation and a kill switch for autonomous agent actions. Kosmoy runs in the customer Kubernetes environment, in the cloud or on premises. AI platform, security, risk and compliance teams can use the same inventory and operational evidence when reviewing AI use cases.

Description

LLM Gateway is a completely open-source, unified API gateway designed to efficiently route, manage, and analyze requests directed to various large language model providers such as OpenAI, Anthropic, and Gemini Enterprise Agent Platform, all through a single, OpenAI-compatible endpoint. It supports multiple providers, facilitating effortless migration and integration, while its dynamic model orchestration directs each request to the most suitable engine, providing a streamlined experience. Additionally, it includes robust usage analytics that allow users to monitor requests, token usage, response times, and costs in real-time, ensuring transparency and control. The platform features built-in performance monitoring tools that facilitate the comparison of models based on accuracy and cost-effectiveness, while secure key management consolidates API credentials under a role-based access framework. Users have the flexibility to deploy LLM Gateway on their own infrastructure under the MIT license or utilize the hosted service as a progressive web app, with easy integration that requires only a change to the API base URL, ensuring that existing code in any programming language or framework, such as cURL, Python, TypeScript, or Go, remains functional without any alterations. Overall, LLM Gateway empowers developers with a versatile and efficient tool for leveraging various AI models while maintaining control over their usage and expenses.

API Access

Has API

API Access

Has API

Screenshots View All

Screenshots View All

Integrations

Claude
Mistral AI
OpenAI
Databricks
Gemini
Google AI Studio
Google Cloud Platform
Groq
Meta AI
Next.js
PHP
Perplexity
Pinecone
Python
Rust
SAP Cloud Platform
Salesforce
Snowflake
Together AI
kluster.ai

Integrations

Claude
Mistral AI
OpenAI
Databricks
Gemini
Google AI Studio
Google Cloud Platform
Groq
Meta AI
Next.js
PHP
Perplexity
Pinecone
Python
Rust
SAP Cloud Platform
Salesforce
Snowflake
Together AI
kluster.ai

Pricing Details

Annual enterprise licensing, with pricing quoted according to deployment scope and required capabilities. Kosmoy runs in the customer Kubernetes environment, in the cloud or on premises. A free trial is available.
Free Trial
Free Version

Pricing Details

$50 per month
Free Trial
Free Version

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Vendor Details

Company Name

Kosmoy

Founded

2024

Country

Italy

Website

www.kosmoy.com

Vendor Details

Company Name

LLM Gateway

Country

United States

Website

llmgateway.io

Product Features

Product Features

Alternatives

Unity AI Gateway Reviews

Unity AI Gateway

Databricks

Alternatives

agentgateway Reviews

agentgateway

LF Projects, LLC
Phinite Reviews

Phinite

Phinite AI