Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Kosmoy is the AI management platform for regulated enterprises. Models, copilots and autonomous agents now run in every business unit, on every cloud, from every vendor — and the same gaps appear everywhere: shadow AI nobody registered, governance rebuilt app by app, spend that grows unseen, agents that act faster than any reviewer, and audit evidence scattered across tickets and spreadsheets. These are not five problems. They are one missing control plane.
Kosmoy is that control plane, built as four layers. Inventory: four registries — AI systems, models, MCP servers and a master agent registry that pulls agents automatically from Azure AI Foundry, AWS Bedrock, Google Vertex, Salesforce and ServiceNow — each entry with an owner and a risk tier, and anything running unregistered flagged as shadow AI. Monitoring: every call observed — cost, usage and behaviour per model, application and user, with budgets that warn and then block. Governance: one OpenAI-compatible AI Gateway enforcing guardrails, RBAC, routing and logging on every LLM, MCP and agent-to-agent call; the router sends simple prompts to smaller models, and customers regularly cut spend 90% on routable workloads. Action Control: Action Capsules — kernel-enforced sandboxes in your own Kubernetes — contain autonomous agents, MCP servers and private models with just-in-time credentials and a kill switch.
The same registries and gateway logs produce audit-ready evidence for the EU AI Act, ISO/IEC 42001 and NIST AI RMF. Kosmoy is self-hosted software, not a SaaS you send prompts to: single-tenant in your own Kubernetes on Azure, AWS, GCP or on-prem, air-gap capable, model-agnostic across OpenAI, Anthropic, Google, Mistral and open-source models. .
Description
LLM Gateway is a completely open-source, unified API gateway designed to efficiently route, manage, and analyze requests directed to various large language model providers such as OpenAI, Anthropic, and Gemini Enterprise Agent Platform, all through a single, OpenAI-compatible endpoint. It supports multiple providers, facilitating effortless migration and integration, while its dynamic model orchestration directs each request to the most suitable engine, providing a streamlined experience. Additionally, it includes robust usage analytics that allow users to monitor requests, token usage, response times, and costs in real-time, ensuring transparency and control. The platform features built-in performance monitoring tools that facilitate the comparison of models based on accuracy and cost-effectiveness, while secure key management consolidates API credentials under a role-based access framework. Users have the flexibility to deploy LLM Gateway on their own infrastructure under the MIT license or utilize the hosted service as a progressive web app, with easy integration that requires only a change to the API base URL, ensuring that existing code in any programming language or framework, such as cURL, Python, TypeScript, or Go, remains functional without any alterations. Overall, LLM Gateway empowers developers with a versatile and efficient tool for leveraging various AI models while maintaining control over their usage and expenses.
API Access
Has API
API Access
Has API
Integrations
Claude
Mistral AI
OpenAI
Gemini Enterprise Agent Platform
Go
Google AI Studio
Google Cloud Platform
Groq
Java
Microsoft Teams
Integrations
Claude
Mistral AI
OpenAI
Gemini Enterprise Agent Platform
Go
Google AI Studio
Google Cloud Platform
Groq
Java
Microsoft Teams
Pricing Details
Annual enterprise license fee
Free Trial
Free Version
Pricing Details
$50 per month
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
Kosmoy
Founded
2024
Country
Italy
Website
www.kosmoy.com
Vendor Details
Company Name
LLM Gateway
Country
United States
Website
llmgateway.io