Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Amazon Elastic Inference provides an affordable way to enhance Amazon EC2 and Sagemaker instances or Amazon ECS tasks with GPU-powered acceleration, potentially cutting deep learning inference costs by as much as 75%. It is compatible with models built on TensorFlow, Apache MXNet, PyTorch, and ONNX. The term "inference" refers to the act of generating predictions from a trained model. In the realm of deep learning, inference can represent up to 90% of the total operational expenses, primarily for two reasons. Firstly, GPU instances are generally optimized for model training rather than inference, as training tasks can handle numerous data samples simultaneously, while inference typically involves processing one input at a time in real-time, resulting in minimal GPU usage. Consequently, relying solely on GPU instances for inference can lead to higher costs. Conversely, CPU instances lack the necessary specialization for matrix computations, making them inefficient and often too sluggish for deep learning inference tasks. This necessitates a solution like Elastic Inference, which optimally balances cost and performance in inference scenarios.
Description
Elastic computing instances equipped with GPU accelerators are ideal for various applications, including artificial intelligence, particularly deep learning and machine learning, high-performance computing, and advanced graphics processing. The Elastic GPU Service delivers a comprehensive system that integrates both software and hardware, enabling users to allocate resources with flexibility, scale their systems dynamically, enhance computational power, and reduce expenses related to AI initiatives. This service is applicable in numerous scenarios, including deep learning, video encoding and decoding, video processing, scientific computations, graphical visualization, and cloud gaming, showcasing its versatility. Furthermore, the Elastic GPU Service offers GPU-accelerated computing capabilities along with readily available, scalable GPU resources, which harness the unique strengths of GPUs in executing complex mathematical and geometric calculations, especially in floating-point and parallel processing. When compared to CPUs, GPUs can deliver an astounding increase in computing power, often being 100 times more efficient, making them an invaluable asset for demanding computational tasks. Overall, this service empowers businesses to optimize their AI workloads while ensuring that they can meet evolving performance requirements efficiently.
API Access
Has API
No
API Access
Has API
No
Integrations
Alibaba Cloud
No
Amazon EC2
Yes
Amazon EC2 G4 Instances
Yes
Amazon Web Services (AWS)
Yes
MXNet
Yes
PyTorch
Yes
TensorFlow
Yes
Integrations
Alibaba Cloud
Yes
Amazon EC2
No
Amazon EC2 G4 Instances
No
Amazon Web Services (AWS)
No
MXNet
No
PyTorch
No
TensorFlow
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
$69.51 per month
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Amazon
Founded
2006
Country
United States
Website
aws.amazon.com/machine-learning/elastic-inference/
Vendor Details
Company Name
Alibaba
Founded
1999
Country
China
Website
www.alibabacloud.com/product/heterogeneous_computing
Product Features
Infrastructure-as-a-Service (IaaS)
Analytics / Reporting
No
Configuration Management
No
Data Migration
No
Data Security
No
Load Balancing
No
Log Access
No
Network Monitoring
No
Performance Monitoring
No
SLA Monitoring
No