Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Automated voice testing, monitoring and more. Test your AI voice agent with 1000s of simulated users within minutes. It's hard to get AI voice agents right. LLM outputs can be affected by a small change in the prompts, function calls or model providers. We are the only platform that can support you from development through to production. Hamming allows you to store, manage, update and sync your prompts with voice infra provider. This is 1000x faster than testing voice agents manually. Use our prompt playground for testing LLM outputs against a dataset of inputs. Our LLM judges quality of generated outputs. Save 80% on manual prompt engineering. Monitor your app in more than one way. We actively track, score and flag cases where you need to pay attention. Convert calls and traces to test cases, and add them to the golden dataset.
Description
evalship is quality control for LLM evals, delivered as a GitHub App. Setup is one line for a coding agent such as Claude Code or Codex: the agent reads your evals, finds the test cases that can't fail, and opens a pull request that wires them into CI. From then on, each pull request gets a comment naming the evals the change broke, the likely cause in the diff, the flaky evals left out, and any new AI call without an eval. When you want better results or lower bills, Optimize has your agent run experiments on your prompts and models, and evalship tells you which variants beat the current one beyond chance. You pick what ships. evalship sits next to Langfuse, Braintrust, LangSmith or promptfoo rather than replacing them, and your evals keep running on your own infrastructure.
API Access
Has API
No
API Access
Has API
No
Integrations
Braintrust
No
Claude
Yes
Claude Duet
Yes
Claude for Legal
Yes
Gemini
Yes
Gemini 1.5 Flash
Yes
Gemini 1.5 Pro
Yes
Gemini 2.0
Yes
Gemini Enterprise
Yes
Gemini Nano
Yes
Integrations
Braintrust
Yes
Claude
No
Claude Duet
No
Claude for Legal
No
Gemini
No
Gemini 1.5 Flash
No
Gemini 1.5 Pro
No
Gemini 2.0
No
Gemini Enterprise
No
Gemini Nano
No
Pricing Details
No price information available.
Free Trial
Yes
Free Version
No
Pricing Details
$19/month
Free for all public repositories, plus 1 private repository with 1 user. Team is $19/month (3 users, 2 private repositories), Pro $49/month (10 users, 5 private repositories) and Business $199/month (50 users, 25 private repositories). Yearly billing gets 2 months free. Paid plans come with a 7-day free trial.
Free Trial
Yes
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
Yes
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Hamming
Website
hamming.ai/
Vendor Details
Company Name
Garm Tech B.V.
Founded
2026
Country
Netherlands
Website
evalship.com