Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

LLM Gateway is a completely open-source, unified API gateway designed to efficiently route, manage, and analyze requests directed to various large language model providers such as OpenAI, Anthropic, and Gemini Enterprise Agent Platform, all through a single, OpenAI-compatible endpoint. It supports multiple providers, facilitating effortless migration and integration, while its dynamic model orchestration directs each request to the most suitable engine, providing a streamlined experience. Additionally, it includes robust usage analytics that allow users to monitor requests, token usage, response times, and costs in real-time, ensuring transparency and control. The platform features built-in performance monitoring tools that facilitate the comparison of models based on accuracy and cost-effectiveness, while secure key management consolidates API credentials under a role-based access framework. Users have the flexibility to deploy LLM Gateway on their own infrastructure under the MIT license or utilize the hosted service as a progressive web app, with easy integration that requires only a change to the API base URL, ensuring that existing code in any programming language or framework, such as cURL, Python, TypeScript, or Go, remains functional without any alterations. Overall, LLM Gateway empowers developers with a versatile and efficient tool for leveraging various AI models while maintaining control over their usage and expenses.

Description

kgateway is a widely deployed Kubernetes gateway designed to power modern microservices and AI-driven workloads. It serves as a control plane for advanced ingress, API management, and AI gateway use cases. Built on Envoy and open-source foundations, kgateway implements the Kubernetes Gateway API for consistent, cloud-native connectivity. The platform aggregates APIs and applies authentication, authorization, and rate limiting in one centralized layer. Kgateway also protects AI models, tools, and agents by securing LLM consumption and data access. Intelligent routing capabilities support AI inference workloads directly inside Kubernetes clusters. The platform scales from lightweight microgateways to massively parallel centralized gateways. Kgateway supports agent-to-agent and MCP-based communication through a single secure endpoint. It enables omni-directional API connectivity across hybrid and multi-cloud environments. Kgateway helps organizations innovate faster while maintaining security and governance.

API Access

Has API

API Access

Has API

Screenshots View All

Screenshots View All

Integrations

Amazon Web Services (AWS)
Ambient Mesh
Claude
Gemini Enterprise Agent Platform
Google AI Studio
Google Cloud Platform
Groq
HashiCorp Nomad
HubSpot Customer Platform
Java
Mistral AI
Next.js
OpenAI
PHP
Rackspace OpenStack
Ruby
Rust
Together AI
VMware vSphere
agentgateway

Integrations

Amazon Web Services (AWS)
Ambient Mesh
Claude
Gemini Enterprise Agent Platform
Google AI Studio
Google Cloud Platform
Groq
HashiCorp Nomad
HubSpot Customer Platform
Java
Mistral AI
Next.js
OpenAI
PHP
Rackspace OpenStack
Ruby
Rust
Together AI
VMware vSphere
agentgateway

Pricing Details

$50 per month
Free Trial
Free Version

Pricing Details

No price information available.
Free Trial
Free Version

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Vendor Details

Company Name

LLM Gateway

Country

United States

Website

llmgateway.io

Vendor Details

Company Name

Cloud Native Computing Foundation

Country

United States

Website

kgateway.dev/

Product Features

Product Features

API Management

API Design
API Lifecycle Management
Access Control
Analytics
Dashboard
Developer Portal
Testing Management
Threat Protection
Traffic Control
Version Control

Alternatives

Alternatives

Ambassador Reviews

Ambassador

Ambassador Labs
Tyk Reviews

Tyk

Tyk Technologies