Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
The Elastic Fabric Adapter (EFA) serves as a specialized network interface for Amazon EC2 instances, allowing users to efficiently run applications that demand high inter-node communication at scale within the AWS environment. By utilizing a custom-designed operating system (OS) that circumvents traditional hardware interfaces, EFA significantly boosts the performance of communications between instances, which is essential for effectively scaling such applications. This technology facilitates the scaling of High-Performance Computing (HPC) applications that utilize the Message Passing Interface (MPI) and Machine Learning (ML) applications that rely on the NVIDIA Collective Communications Library (NCCL) to thousands of CPUs or GPUs. Consequently, users can achieve the same high application performance found in on-premises HPC clusters while benefiting from the flexible and on-demand nature of the AWS cloud infrastructure. EFA can be activated as an optional feature for EC2 networking without incurring any extra charges, making it accessible for a wide range of use cases. Additionally, it seamlessly integrates with the most popular interfaces, APIs, and libraries for inter-node communication needs, enhancing its utility for diverse applications.
Description
AWS ParallelCluster is a free, open-source tool designed for efficient management and deployment of High-Performance Computing (HPC) clusters within the AWS environment. It streamlines the configuration of essential components such as compute nodes, shared filesystems, and job schedulers, while accommodating various instance types and job submission queues. Users have the flexibility to engage with ParallelCluster using a graphical user interface, command-line interface, or API, which allows for customizable cluster setups and oversight. The tool also works seamlessly with job schedulers like AWS Batch and Slurm, making it easier to transition existing HPC workloads to the cloud with minimal adjustments. Users incur no additional costs for the tool itself, only paying for the AWS resources their applications utilize. With AWS ParallelCluster, users can effectively manage their computing needs through a straightforward text file that allows for the modeling, provisioning, and dynamic scaling of necessary resources in a secure and automated fashion. This ease of use significantly enhances productivity and optimizes resource allocation for various computational tasks.
API Access
Has API
API Access
Has API
Integrations
AWS HPC
Amazon Web Services (AWS)
AWS Batch
AWS Elastic Fabric Adapter (EFA)
AWS Lambda
AWS Nitro System
AWS Parallel Computing Service
AWS ParallelCluster
Amazon
Amazon EC2
Integrations
AWS HPC
Amazon Web Services (AWS)
AWS Batch
AWS Elastic Fabric Adapter (EFA)
AWS Lambda
AWS Nitro System
AWS Parallel Computing Service
AWS ParallelCluster
Amazon
Amazon EC2
Pricing Details
No price information available.
Free Trial
Free Version
Pricing Details
No price information available.
Free Trial
Free Version
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Deployment
Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Customer Support
Business Hours
Live Rep (24/7)
Online Support
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Types of Training
Training Docs
Webinars
Live Training (Online)
In Person
Vendor Details
Company Name
United States
Founded
1994
Country
United States
Website
aws.amazon.com/hpc/efa/
Vendor Details
Company Name
Amazon
Founded
1994
Country
United States
Website
aws.amazon.com/hpc/parallelcluster/
Product Features
Machine Learning
Deep Learning
ML Algorithm Library
Model Training
Natural Language Processing (NLP)
Predictive Modeling
Statistical / Mathematical Tools
Templates
Visualization