Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
An open-source platform for monitoring machine learning models offers robust observability features. It allows users to evaluate, test, and oversee models throughout their journey from validation to deployment. Catering to a range of data types, from tabular formats to natural language processing and large language models, it is designed with both data scientists and ML engineers in mind. This tool provides everything necessary for the reliable operation of ML systems in a production environment. You can begin with straightforward ad hoc checks and progressively expand to a comprehensive monitoring solution. All functionalities are integrated into a single platform, featuring a uniform API and consistent metrics. The design prioritizes usability, aesthetics, and the ability to share insights easily. Users gain an in-depth perspective on data quality and model performance, facilitating exploration and troubleshooting. Setting up takes just a minute, allowing for immediate testing prior to deployment, validation in live environments, and checks during each model update. The platform also eliminates the hassle of manual configuration by automatically generating test scenarios based on a reference dataset. It enables users to keep an eye on every facet of their data, models, and testing outcomes. By proactively identifying and addressing issues with production models, it ensures sustained optimal performance and fosters ongoing enhancements. Additionally, the tool's versatility makes it suitable for teams of any size, enabling collaborative efforts in maintaining high-quality ML systems.
Description
Galileo is an AI observability and eval engineering platform designed to help teams evaluate, monitor, guardrail, and improve AI agents and applications. The platform connects the offline testing process with production governance, turning evals into guardrails that can control agent actions, tool access, escalation paths, and safety behavior. Galileo helps teams capture ground truth from synthetic data, development data, live production data, and subject matter expert annotations. Its evaluation capabilities include RAG evals, agent evals, safety evals, security evals, and custom evals that can be tuned to specific environments. Galileo’s Luna models distill optimized LLM-as-judge evaluators into compact models that run at lower cost and latency for production-scale monitoring. The insights engine analyzes traces, prompts, functions, context, datasets, models, and agent behavior to identify failure modes and recommend fixes. Teams can use Galileo to detect hallucinations, tool-selection failures, drift, bias, unsafe outputs, and other reliability issues before they harm production experiences. Deployment options include SaaS, virtual private cloud, and on-premises environments. By combining observability, eval engineering, production guardrails, ground-truth datasets, Luna models, insights, and enterprise deployment options, Galileo helps organizations build more reliable AI systems.
API Access
Has API
API Access
Has API
Integrations
Amazon Bedrock
Amazon SageMaker
Azure OpenAI Service
Gemini
Gemini 1.5 Flash
Gemini 1.5 Pro
Gemini 2.0
Gemini 2.0 Flash
Gemini Enterprise
Gemini Enterprise Agent Platform
Integrations
Amazon Bedrock
Amazon SageMaker
Azure OpenAI Service
Gemini
Gemini 1.5 Flash
Gemini 1.5 Pro
Gemini 2.0
Gemini 2.0 Flash
Gemini Enterprise
Gemini Enterprise Agent Platform
Pricing Details
$500 per month
Free Trial
Free Version
Pricing Details
No price information available.
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
Evidently AI
Founded
2020
Country
United States
Website
www.evidentlyai.com
Vendor Details
Company Name
Cisco
Country
United States
Website
www.galileo.ai/
Product Features
Data Quality
Address Validation
Data Deduplication
Data Discovery
Data Profililng
Master Data Management
Match & Merge
Metadata Management
Machine Learning
Deep Learning
ML Algorithm Library
Model Training
Natural Language Processing (NLP)
Predictive Modeling
Statistical / Mathematical Tools
Templates
Visualization
Natural Language Processing
Co-Reference Resolution
In-Database Text Analytics
Named Entity Recognition
Natural Language Generation (NLG)
Open Source Integrations
Parsing
Part-of-Speech Tagging
Sentence Segmentation
Stemming/Lemmatization
Tokenization
Product Features
Machine Learning
Deep Learning
ML Algorithm Library
Model Training
Natural Language Processing (NLP)
Predictive Modeling
Statistical / Mathematical Tools
Templates
Visualization