Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Galileo is an AI observability and eval engineering platform designed to help teams evaluate, monitor, guardrail, and improve AI agents and applications. The platform connects the offline testing process with production governance, turning evals into guardrails that can control agent actions, tool access, escalation paths, and safety behavior. Galileo helps teams capture ground truth from synthetic data, development data, live production data, and subject matter expert annotations. Its evaluation capabilities include RAG evals, agent evals, safety evals, security evals, and custom evals that can be tuned to specific environments. Galileo’s Luna models distill optimized LLM-as-judge evaluators into compact models that run at lower cost and latency for production-scale monitoring. The insights engine analyzes traces, prompts, functions, context, datasets, models, and agent behavior to identify failure modes and recommend fixes. Teams can use Galileo to detect hallucinations, tool-selection failures, drift, bias, unsafe outputs, and other reliability issues before they harm production experiences. Deployment options include SaaS, virtual private cloud, and on-premises environments. By combining observability, eval engineering, production guardrails, ground-truth datasets, Luna models, insights, and enterprise deployment options, Galileo helps organizations build more reliable AI systems.
Description
Overmind serves as a comprehensive platform for the training and deployment of AI agents, catering specifically to teams engaged in this field. It processes production traces via OpenTelemetry, generating datasets from various sources including trace data, file uploads, and integrations with Langfuse, LangSmith, Braintrust, and Galileo. Teams have the capability to analyze agent context and performance in real-time, prepare and assess datasets, and test prompts and models against their tailored examples, all while refining agent behavior through evaluated modifications. The platform facilitates both LoRA and complete fine-tuning of open-weight models, offering benchmarking with custom evaluators and deployment through an OpenAI-compatible endpoint; additionally, users have the option to download trained weights. Furthermore, users can opt to engage with the hosted console or deploy the platform within their own infrastructure using Docker Compose. Designed for AI engineering and product teams managing agents in live environments, Overmind empowers users to effectively experiment, enhance, and customize models with their proprietary data for optimized outcomes. This flexibility ensures that teams can adapt their workflows according to their specific needs and preferences.
API Access
Has API
No
API Access
Has API
Yes
Integrations
Amazon Bedrock
Yes
Amazon SageMaker
Yes
Azure OpenAI Service
Yes
Braintrust
No
Claude Code
No
Cursor
No
Galileo
No
Gemini
Yes
Gemini 1.5 Flash
Yes
Gemini 1.5 Pro
Yes
Integrations
Amazon Bedrock
No
Amazon SageMaker
No
Azure OpenAI Service
No
Braintrust
Yes
Claude Code
Yes
Cursor
Yes
Galileo
Yes
Gemini
No
Gemini 1.5 Flash
No
Gemini 1.5 Pro
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
Free
Free plan: $0/month, with fair-use OTLP ingest, up to 10 optimization runs, 5 evaluation runs, 2 training jobs, and 2 deployment jobs per month, plus 5 projects and a $40 one-time credit. Pro: $120/month with higher limits, unlimited projects, optimization runs, evaluation runs, training jobs, and deployment jobs. Enterprise pricing is custom.
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
No
Types of Training
Training Docs
No
Webinars
No
Live Training (Online)
Yes
In Person
No
Types of Training
Training Docs
No
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Cisco
Country
United States
Website
www.galileo.ai/
Vendor Details
Company Name
Overmind
Founded
2025
Country
United Kingdom
Website
www.overmindlab.ai
Product Features
Machine Learning
Deep Learning
No
ML Algorithm Library
No
Model Training
No
Natural Language Processing (NLP)
No
Predictive Modeling
No
Statistical / Mathematical Tools
No
Templates
No
Visualization
No
Product Features
Alternatives
Alternatives
No Alternatives