Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Amazon EC2 Trn2 instances, equipped with AWS Trainium2 chips, are specifically designed to deliver exceptional performance in the training of generative AI models, such as large language and diffusion models. Users can experience cost savings of up to 50% in training expenses compared to other Amazon EC2 instances. These Trn2 instances can accommodate as many as 16 Trainium2 accelerators, boasting an impressive compute power of up to 3 petaflops using FP16/BF16 and 512 GB of high-bandwidth memory. For enhanced data and model parallelism, they are built with NeuronLink, a high-speed, nonblocking interconnect, and offer a substantial network bandwidth of up to 1600 Gbps via the second-generation Elastic Fabric Adapter (EFAv2). Trn2 instances are part of EC2 UltraClusters, which allow for scaling up to 30,000 interconnected Trainium2 chips within a nonblocking petabit-scale network, achieving a remarkable 6 exaflops of compute capability. Additionally, the AWS Neuron SDK provides seamless integration with widely used machine learning frameworks, including PyTorch and TensorFlow, making these instances a powerful choice for developers and researchers alike. This combination of cutting-edge technology and cost efficiency positions Trn2 instances as a leading option in the realm of high-performance deep learning.
Description
The NVIDIA GPU-Optimized AMI serves as a virtual machine image designed to enhance your GPU-accelerated workloads in Machine Learning, Deep Learning, Data Science, and High-Performance Computing (HPC). By utilizing this AMI, you can quickly launch a GPU-accelerated EC2 virtual machine instance, complete with a pre-installed Ubuntu operating system, GPU driver, Docker, and the NVIDIA container toolkit, all within a matter of minutes.
This AMI simplifies access to NVIDIA's NGC Catalog, which acts as a central hub for GPU-optimized software, enabling users to easily pull and run performance-tuned, thoroughly tested, and NVIDIA-certified Docker containers. The NGC catalog offers complimentary access to a variety of containerized applications for AI, Data Science, and HPC, along with pre-trained models, AI SDKs, and additional resources, allowing data scientists, developers, and researchers to concentrate on creating and deploying innovative solutions.
Additionally, this GPU-optimized AMI is available at no charge, with an option for users to purchase enterprise support through NVIDIA AI Enterprise. For further details on obtaining support for this AMI, please refer to the section labeled 'Support Information' below. Moreover, leveraging this AMI can significantly streamline the development process for projects requiring intensive computational resources.
API Access
Has API
API Access
Has API
Integrations
Amazon Web Services (AWS)
AWS Batch
AWS Deep Learning AMIs
AWS Marketplace
AWS Neuron
AWS Trainium
Amazon EC2
Amazon EC2 Capacity Blocks for ML
Amazon EC2 Inf1 Instances
Amazon EC2 P4 Instances
Integrations
Amazon Web Services (AWS)
AWS Batch
AWS Deep Learning AMIs
AWS Marketplace
AWS Neuron
AWS Trainium
Amazon EC2
Amazon EC2 Capacity Blocks for ML
Amazon EC2 Inf1 Instances
Amazon EC2 P4 Instances
Pricing Details
No price information available.
Free Trial
Free Version
Pricing Details
$3.06 per hour
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
Amazon
Founded
1994
Country
United States
Website
aws.amazon.com/ec2/instance-types/trn2/
Vendor Details
Company Name
Amazon
Founded
1994
Country
United States
Website
aws.amazon.com/marketplace/pp/prodview-7ikjtg3um26wq
Product Features
Deep Learning
Convolutional Neural Networks
Document Classification
Image Segmentation
ML Algorithm Library
Model Training
Neural Network Modeling
Self-Learning
Visualization
Machine Learning
Deep Learning
ML Algorithm Library
Model Training
Natural Language Processing (NLP)
Predictive Modeling
Statistical / Mathematical Tools
Templates
Visualization
Product Features
Deep Learning
Convolutional Neural Networks
Document Classification
Image Segmentation
ML Algorithm Library
Model Training
Neural Network Modeling
Self-Learning
Visualization