promptfoo Integrations

Claude Duet is an AI-powered personal productivity and autonomous agent platform designed to help individuals manage information, coordinate activities, and delegate complex work. Developed by Anthropic and powered by Claude Opus 5.5, the application uses a dedicated cloud computer to interact with connected services and execute tasks on behalf of users. Its proactive assistance capabilities include daily briefings that summarize important emails, calendar commitments, business developments, and outstanding decisions. Users can assign tasks through natural language text or voice messages, allowing the assistant to research information, prepare documents, schedule meetings, and manage administrative processes. Claude Duet can create spreadsheets, presentations, dashboards, reports, and other business deliverables using information from connected applications. The platform supports more than 6,000 connectors and plugins, including Gmail, Google Calendar, Slack, Salesforce, HubSpot, Shopify, and Microsoft 365. Persistent memory and integration with existing Claude skills enable the assistant to maintain contextual information across conversations and recurring workflows. Its safety controls require user approval for sensitive operations, while activity monitoring allows users to review agent actions and provide additional instructions. Claude Duet is offered as a research preview for eligible US-based Claude Pro and Max subscribers, with a standalone mobile application and web interface.

OpenAI aims to guarantee that artificial general intelligence (AGI)—defined as highly autonomous systems excelling beyond human capabilities in most economically significant tasks—serves the interests of all humanity. While we intend to develop safe and advantageous AGI directly, we consider our mission successful if our efforts support others in achieving this goal. You can utilize our API for a variety of language-related tasks, including semantic search, summarization, sentiment analysis, content creation, translation, and beyond, all with just a few examples or by clearly stating your task in English. A straightforward integration provides you with access to our continuously advancing AI technology, allowing you to explore the API’s capabilities through these illustrative completions and discover numerous potential applications.

Claude is an advanced AI assistant created by Anthropic to help users think, create, and work more efficiently. It is built to handle tasks such as content creation, document editing, coding, data analysis, and research with a strong focus on safety and accuracy. Claude enables users to collaborate with AI in real time, making it easy to draft websites, generate code, and refine ideas through conversation. The platform supports uploads of text, images, and files, allowing users to analyze and visualize information directly within chat. Claude includes powerful tools like Artifacts, which help organize and iterate on creative and technical projects. Users can access Claude on the web as well as on mobile devices for seamless productivity. Built-in web search allows Claude to surface relevant information when needed. Different plans offer varying levels of usage, model access, and advanced research features. Claude is designed to support both individual users and teams at scale. Anthropic’s commitment to responsible AI ensures Claude is secure, reliable, and aligned with real-world needs.

evalship is quality control for LLM evals, delivered as a GitHub App. Setup is one line for a coding agent such as Claude Code or Codex: the agent reads your evals, finds the test cases that can't fail, and opens a pull request that wires them into CI. From then on, each pull request gets a comment naming the evals the change broke, the likely cause in the diff, the flaky evals left out, and any new AI call without an eval. When you want better results or lower bills, Optimize has your agent run experiments on your prompts and models, and evalship tells you which variants beat the current one beyond chance. You pick what ships. evalship sits next to Langfuse, Braintrust, LangSmith or promptfoo rather than replacing them, and your evals keep running on your own infrastructure.

Cake AI serves as a robust infrastructure platform designed for teams to effortlessly create and launch AI applications by utilizing a multitude of pre-integrated open source components, ensuring full transparency and governance. It offers a carefully curated, all-encompassing suite of top-tier commercial and open source AI tools that come with ready-made integrations, facilitating the transition of AI applications into production seamlessly. The platform boasts features such as dynamic autoscaling capabilities, extensive security protocols including role-based access and encryption, as well as advanced monitoring tools and adaptable infrastructure that can operate across various settings, from Kubernetes clusters to cloud platforms like AWS. Additionally, its data layer is equipped with essential tools for data ingestion, transformation, and analytics, incorporating technologies such as Airflow, DBT, Prefect, Metabase, and Superset to enhance data management. For effective AI operations, Cake seamlessly connects with model catalogs like Hugging Face and supports versatile workflows through tools such as LangChain and LlamaIndex, allowing teams to customize their processes efficiently. This comprehensive ecosystem empowers organizations to innovate and deploy AI solutions with greater agility and precision.

Omega is a proprietary AI agent embedded directly within Slack, designed to enhance sales workflows by automating routine tasks, providing valuable insights, and encouraging team members to adopt best practices with ease. It integrates smoothly with essential applications such as Slack, Google Drive, Apollo, Salesforce, and various transcript systems, effectively streamlining time-consuming activities like generating call agendas, summarizing expert discussions, finding pertinent documents, and monitoring deal progress. Operating as a modular, multi-agent system, Omega employs specialized roles orchestrated through frameworks like AutoGen to strategize, implement, and verify actions throughout the workflow. This innovative framework is built on a cloud-native, serverless architecture leveraging AWS Lambda and Step Functions, allowing for significant flexibility and scalability. Additionally, the system's observability and iterative capabilities are enhanced through tools such as Langfuse, Promptfoo, CI/CD pipelines, and Terraform, ensuring continuous improvement and adaptability in the sales process. The comprehensive integration of these tools makes Omega an invaluable asset for teams looking to optimize their performance.

Claude for Legal is an AI-powered assistant developed by Anthropic designed specifically for legal professionals, enabling them to efficiently manage documents and conduct research. This tool is capable of summarizing extensive files, extracting and comparing crucial information, drafting and refining text, and aiding in the analysis of contracts and various documents. Legal teams, whether in law firms or corporate settings, can leverage Claude for Legal to streamline their document workflows and access recurring knowledge, ensuring they have the necessary context and source materials at their fingertips. Additionally, users can review the AI-generated responses as part of their comprehensive workflow. Available on both desktop and mobile platforms, Claude for Legal facilitates information processing and content creation; however, it is essential for users to verify the outputs, exercise professional judgment, and make informed legal decisions independently as part of their practice. This means that while the AI can enhance efficiency, the ultimate responsibility for legal accuracy and compliance remains with the user.