Amazon Elastic Inference Description
Amazon Elastic Inference allows for low-cost GPU-powered acceleration to Amazon EC2 instances and Sagemaker instances, or Amazon ECS tasks. This can reduce the cost of deep learning inference by up 75%. Amazon Elastic Inference supports TensorFlow and Apache MXNet models. Inference is the process by which a trained model makes predictions. Inference can account for as much as 90% of total operational expenses in deep learning applications for two reasons. First, standalone GPU instances are usually used for model training and not inference. Inference jobs typically process one input at a time and use a smaller amount of GPU compute. Training jobs can process hundreds of data samples simultaneously, but inference jobs only process one input in real-time. This makes standalone GPU-based inference expensive. However, standalone CPU instances aren't specialized for matrix operations and are therefore often too slow to perform deep learning inference.
Amazon Elastic Inference Alternatives
Google Cloud AI Infrastructure
There are options for every business to train deep and machine learning models efficiently. There are AI accelerators that can be used for any purpose, from low-cost inference to high performance training. It is easy to get started with a variety of services for development or deployment. Tensor Processing Units are ASICs that are custom-built to train and execute deep neural network. You can train and run more powerful, accurate models at a lower cost and with greater speed and scale. NVIDIA GPUs are available to assist with cost-effective inference and scale-up/scale-out training. Deep learning can be achieved by leveraging RAPID and Spark with GPUs. You can run GPU workloads on Google Cloud, which offers industry-leading storage, networking and data analytics technologies. Compute Engine allows you to access CPU platforms when you create a VM instance. Compute Engine provides a variety of Intel and AMD processors to support your VMs.
Learn more
Amazon EC2
Amazon Elastic Compute Cloud (Amazon EC2) provides secure, resizable cloud computing capacity. It was designed to make cloud computing at web scale easier for developers. Amazon EC2's web service interface makes it easy to configure and obtain capacity with minimal effort. It gives you complete control over your computing resources and allows you to run on Amazon's proven computing environment.
Learn more
AWS Inferentia
AWS Inferentia Accelerators are designed by AWS for high performance and low cost for deep learning (DL), inference applications. The first-generation AWS Inferentia accelerator powers Amazon Elastic Compute Cloud, Amazon EC2 Inf1 instances. These instances deliver up to 2.3x more throughput and up 70% lower cost per input than comparable GPU-based Amazon EC2 instances. Inf1 instances have been adopted by many customers including Snap, Sprinklr and Money Forward. They have seen the performance and cost savings. The first-generation Inferentia features 8 GB of DDR4 memory per accelerator, as well as a large amount on-chip memory. Inferentia2 has 32 GB of HBM2e, which increases the total memory by 4x and memory bandwidth 10x more than Inferentia.
Learn more
UberCloud
Simr (formerly UberCloud) is revolutionizing the world of simulation operations with our flagship solution, Simulation Operations Automation (SimOps). Designed to streamline and automate complex simulation workflows, Simr enhances productivity, collaboration, and efficiency for engineers and scientists across various industries, including automotive, aerospace, biomedical engineering, defense, and consumer electronics.
Our cloud-based infrastructure provides scalable and cost-effective solutions, eliminating the need for significant upfront investments in hardware. This ensures that our clients have access to the computational power they need, exactly when they need it, leading to reduced costs and improved operational efficiency.
Simr is trusted by some of the world's leading companies, including three of the seven most successful companies globally. One of our notable success stories is BorgWarner, a Tier 1 automotive supplier that leverages Simr to automate its simulation environments, significantly enhancing their efficiency and driving innovation.
Learn more
Integrations
Company Details
Company:
Amazon
Year Founded:
2006
Headquarters:
United States
Website:
aws.amazon.com/machine-learning/elastic-inference/
Media
Recommended Products
The #1 Embedded Analytics Solution for SaaS Teams.
Qrvey’s comprehensive embedded analytics software enables you to design more customizable analytics experiences for your end users.
Product Details
Platforms
SaaS
Type of Training
Documentation
Customer Support
Online
Amazon Elastic Inference Features and Options
Amazon Elastic Inference User Reviews
Write a Review- Previous
- Next
