Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Amazon EC2 Capacity Blocks for Machine Learning allow users to secure accelerated computing instances within Amazon EC2 UltraClusters specifically for their machine learning tasks. This service encompasses a variety of instance types, including Amazon EC2 P5en, P5e, P5, and P4d, which utilize NVIDIA H200, H100, and A100 Tensor Core GPUs, along with Trn2 and Trn1 instances that leverage AWS Trainium. Users can reserve these instances for periods of up to six months, with cluster sizes ranging from a single instance to 64 instances, translating to a maximum of 512 GPUs or 1,024 Trainium chips, thus providing ample flexibility to accommodate diverse machine learning workloads. Additionally, reservations can be arranged as much as eight weeks ahead of time. By operating within Amazon EC2 UltraClusters, Capacity Blocks facilitate low-latency and high-throughput network connectivity, which is essential for efficient distributed training processes. This configuration guarantees reliable access to high-performance computing resources, empowering you to confidently plan your machine learning projects, conduct experiments, develop prototypes, and effectively handle anticipated increases in demand for machine learning applications. Furthermore, this strategic approach not only enhances productivity but also optimizes resource utilization for varying project scales.
Description
Amazon SageMaker HyperPod is a specialized and robust computing infrastructure designed to streamline and speed up the creation of extensive AI and machine learning models by managing distributed training, fine-tuning, and inference across numerous clusters equipped with hundreds or thousands of accelerators, such as GPUs and AWS Trainium chips. By alleviating the burdens associated with developing and overseeing machine learning infrastructure, it provides persistent clusters capable of automatically identifying and rectifying hardware malfunctions, resuming workloads seamlessly, and optimizing checkpointing to minimize the risk of interruptions — thus facilitating uninterrupted training sessions that can last for months. Furthermore, HyperPod features centralized resource governance, allowing administrators to establish priorities, quotas, and task-preemption rules to ensure that computing resources are allocated effectively among various tasks and teams, which maximizes utilization and decreases idle time. It also includes support for “recipes” and pre-configured settings, enabling rapid fine-tuning or customization of foundational models, such as Llama. This innovative infrastructure not only enhances efficiency but also empowers data scientists to focus more on developing their models rather than managing the underlying technology.
API Access
Has API
No
API Access
Has API
No
Integrations
AWS Trainium
Yes
Amazon SageMaker
Yes
Amazon Web Services (AWS)
Yes
AWS EC2 Trn3 Instances
No
AWS Neuron
Yes
AWS Nitro System
Yes
Amazon EC2
Yes
Amazon EC2 G5 Instances
Yes
Amazon EC2 Inf1 Instances
Yes
Amazon EC2 P4 Instances
Yes
Integrations
AWS Trainium
Yes
Amazon SageMaker
Yes
Amazon Web Services (AWS)
Yes
AWS EC2 Trn3 Instances
Yes
AWS Neuron
No
AWS Nitro System
No
Amazon EC2
No
Amazon EC2 G5 Instances
No
Amazon EC2 Inf1 Instances
No
Amazon EC2 P4 Instances
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
Yes
Live Rep (24/7)
Yes
Online Support
Yes
Customer Support
Business Hours
Yes
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
No
In Person
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
Yes
In Person
No
Vendor Details
Company Name
Amazon
Founded
1994
Country
United States
Website
aws.amazon.com/ec2/capacityblocks/
Vendor Details
Company Name
Amazon
Founded
1994
Country
United States
Website
aws.amazon.com/sagemaker/ai/hyperpod/
Product Features
Machine Learning
Deep Learning
No
ML Algorithm Library
No
Model Training
No
Natural Language Processing (NLP)
No
Predictive Modeling
No
Statistical / Mathematical Tools
No
Templates
No
Visualization
No