Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
The Decisions API is designed to transform both text and images into structured decisions that applications can utilize, processing inputs approximately ten times faster than the Responses API. Developers must provide a model along with shared input evidence and one or more questions that outline the evaluation criteria, after which the API delivers organized answers suitable for tasks like content classification, request routing, work prioritization, or making decisions based on defined thresholds. It accommodates three types of questions: predicate, which assesses whether a condition holds true and yields a probability ranging from 0 to 1; choice, which chooses a single value from a predetermined set and provides the associated probabilities and confidence levels; and score, which measures an input against a set of ordered rubric levels to return a probability-weighted score. The system is versatile in that it can process inputs as plain text or as user messages that include both text and images, making it effective for evaluating various scenarios such as identifying visible product damage, determining request intent, classifying document types, assessing issue severity, or evaluating answer relevance. This capability empowers developers to create more responsive and intelligent applications tailored to user needs.
Description
TruLens is a versatile open-source Python library aimed at the systematic evaluation and monitoring of Large Language Model (LLM) applications. It features detailed instrumentation, feedback mechanisms, and an intuitive interface that allows developers to compare and refine various versions of their applications, thereby promoting swift enhancements in LLM-driven projects. The library includes programmatic tools that evaluate the quality of inputs, outputs, and intermediate results, enabling efficient and scalable assessments. With its precise, stack-agnostic instrumentation and thorough evaluations, TruLens assists in pinpointing failure modes while fostering systematic improvements in applications. Developers benefit from an accessible interface that aids in comparing different application versions, supporting informed decision-making and optimization strategies. TruLens caters to a wide range of applications, including but not limited to question-answering, summarization, retrieval-augmented generation, and agent-based systems, making it a valuable asset for diverse development needs. As developers leverage TruLens, they can expect to achieve more reliable and effective LLM applications.
API Access
Has API
Yes
API Access
Has API
No
Integrations
GPT-6 Luna
Yes
OpenAI
Yes
Pinecone Rerank v0
No
Python
No
Snowflake
No
Integrations
GPT-6 Luna
No
OpenAI
No
Pinecone Rerank v0
Yes
Python
Yes
Snowflake
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
Free
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
OpenAI
Founded
2015
Country
United States
Website
developers.openai.com/api/docs/guides/decisions
Vendor Details
Company Name
TruLens
Country
United States
Website
www.trulens.org