Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
NVIDIA Cloud Functions (NVCF) is a serverless API tailored for deploying and managing AI tasks on GPUs, ensuring security, scalability, and dependable performance. It accommodates various access methods, including HTTP polling, HTTP streaming, and gRPC protocols, for interacting with workloads. Primarily, Cloud Functions is optimized for brief, preemptable tasks such as inferencing and model fine-tuning. Users can choose between two types of functions: "Container" and "Helm Chart," enabling them to customize functions according to their specific needs. Since workloads are transient and preemptable, it is crucial for users to save their progress diligently. Additionally, models, containers, helm charts, and other essential resources are stored and retrieved from the NGC Private Registry. To begin utilizing NVCF, users can refer to the quickstart guide for functions, which outlines a comprehensive workflow for establishing and launching a container-based function utilizing the fastapi_echo_sample container. This resource not only highlights the ease of setup but also encourages users to explore the full potential of NVIDIA’s serverless infrastructure.
Description
Execute code within a secure, resilient, and automatically scalable framework without the need to create or manage virtual machines. As the demand for function executions rises, the service dynamically provisions extra instances of your function to handle the increased load. All functions operate concurrently, and the runtime environment is distributed across three availability zones to maintain service continuity even if one zone experiences issues. You can set up and ready function instances to handle incoming requests efficiently, which helps to eliminate cold starts and allows for the rapid processing of workloads of any magnitude. Grant your functions access to your Virtual Private Cloud (VPC) to enhance communication with private resources, including database clusters, virtual machines, and Kubernetes nodes. Additionally, Serverless Functions monitors and logs details about function executions, providing insights into operational flow and performance metrics; you also have the option to specify logging methods within your function's code. Furthermore, you can initiate cloud functions in both synchronized mode and with delayed execution capabilities for greater flexibility. This approach allows for streamlined processes that can adapt to varying workloads efficiently.
API Access
Has API
API Access
Has API
Integrations
Kubernetes
Bash
C#
Datadog
Docker
Go
Grafana Cloud
Helm
Java
NVIDIA DGX Cloud
Integrations
Kubernetes
Bash
C#
Datadog
Docker
Go
Grafana Cloud
Helm
Java
NVIDIA DGX Cloud
Pricing Details
No price information available.
Free Trial
Free Version
Pricing Details
$0.012240 per GB
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
NVIDIA
Founded
1993
Country
United States
Website
docs.nvidia.com/cloud-functions/index.html
Vendor Details
Company Name
Yandex
Founded
1997
Country
Russia
Website
cloud.yandex.com/en/services/functions
Product Features
Product Features
Serverless
API Proxy
Application Integration
Data Stores
Developer Tooling
Orchestration
Reporting / Analytics
Serverless Computing
Storage