Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
NVIDIA NeMo Guardrails serves as an open-source toolkit aimed at improving the safety, security, and compliance of conversational applications powered by large language models. This toolkit empowers developers to establish, coordinate, and enforce various AI guardrails, thereby ensuring that interactions with generative AI remain precise, suitable, and relevant. Utilizing Colang, a dedicated language for crafting adaptable dialogue flows, it integrates effortlessly with renowned AI development frameworks such as LangChain and LlamaIndex. NeMo Guardrails provides a range of functionalities, including content safety measures, topic regulation, detection of personally identifiable information, enforcement of retrieval-augmented generation, and prevention of jailbreak scenarios. Furthermore, the newly launched NeMo Guardrails microservice streamlines rail orchestration, offering API-based interaction along with tools that facilitate improved management and maintenance of guardrails. This advancement signifies a critical step toward more responsible AI deployment in conversational contexts.
Description
The NVIDIA Open Agent Safety Platform serves as an open reference framework designed to monitor and manage the behavior of AI agents continuously, ensuring that organizations can maintain agents that are isolated, observable, auditable, and operate within set boundaries. This platform integrates real-time governance, ongoing threat detection, and the enforcement of policies through hardware isolation, providing robust protection for enterprise AI agents from the initial testing phases all the way to deployment. The NVIDIA OpenShell contributes to this by offering an open-source runtime that differentiates the execution of agents from their access to data, tools, and outside systems, utilizing sandboxed environments and a zero-trust policy approach to strictly regulate agents' visibility, actions, and interactions. Policies are enforced externally to the agent process, effectively mitigating the risks associated with unpredicted behavior. Furthermore, NVIDIA Sentry enhances security by adding an extra layer that meticulously monitors agent requests and responses, verifies agent identities, and continuously manages access to data, tools, APIs, and services while also having the capability to isolate agents when necessary. This comprehensive approach ensures that organizations can safeguard their AI agents while promoting a secure and controlled operational environment.
API Access
Has API
Yes
API Access
Has API
Yes
Integrations
LangChain
Yes
Llama 3.1
Yes
LlamaIndex
Yes
NVIDIA DOCA
No
NVIDIA NIM
Yes
NVIDIA OpenShell
No
Integrations
LangChain
No
Llama 3.1
No
LlamaIndex
No
NVIDIA DOCA
Yes
NVIDIA NIM
No
NVIDIA OpenShell
Yes
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
NVIDIA
Founded
1993
Country
United States
Website
developer.nvidia.com/nemo-guardrails
Vendor Details
Company Name
NVIDIA
Founded
1993
Country
United States
Website
www.nvidia.com/en-us/solutions/ai/agent-safety/