Tencent Cloud Elastic MapReduce Description
EMR allows you to scale managed Hadoop clusters manually, or automatically, according to your monitoring metrics or business curves. EMR's storage computation separation allows you to terminate clusters to maximize resource efficiency. EMR supports hot failover on CBS-based nodes. It has a primary/secondary disaster recovery mechanism that allows the secondary node to start within seconds of the primary node failing, ensuring high availability of big data services. Remote disaster recovery is possible because of the metadata in Hive's components. High data persistence is possible with computation-storage separation for COS data storage. EMR comes with a comprehensive monitoring system that allows you to quickly locate and identify cluster exceptions in order to ensure stable cluster operations. VPCs are a convenient network isolation method that allows you to plan your network policies for managed Hadoop clusters.
Tencent Cloud Elastic MapReduce Alternatives
Apache Hadoop YARN
The fundamental idea of YARN is to split up the functionalities of resource management and job scheduling/monitoring into separate daemons. The idea is to have a global ResourceManager, (RM), and a per-application ApplicationMaster, (AM). An application can be a single job, or a DAG (distributed array of jobs). The data-computation framework is formed by the NodeManager and the ResourceManager. The ResourceManager is the ultimate authority who arbitrates the allocation of resources among all applications in the system. The NodeManager is the per-machine framework agent who is responsible for containers, monitoring their resource usage (cpu, memory, disk, network) and reporting the same to the ResourceManager/Scheduler. The per-application ApplicationMaster, which is in essence a framework-specific library, is responsible for negotiating resources from ResourceManager and working with NodeManagers to execute and monitor tasks.
Learn more
Hadoop
Apache Hadoop is a software library that allows distributed processing of large data sets across multiple computers. It uses simple programming models. It can scale from one server to thousands of machines and offer local computations and storage. Instead of relying on hardware to provide high-availability, it is designed to detect and manage failures at the application layer. This allows for highly-available services on top of a cluster computers that may be susceptible to failures.
Learn more
E-MapReduce
EMR is an enterprise-ready big-data platform that offers cluster, job, data management and other services. It is based on open-source ecosystems such as Hadoop Spark, Kafka and Flink. Alibaba Cloud Elastic MapReduce is a big-data processing solution that runs on the Alibaba Cloud platform. EMR is built on Alibaba Cloud ECS and is based open-source Apache Spark and Apache Hadoop. EMR allows you use the Hadoop/Spark ecosystem components such as Apache Hive and Apache Kafka, Flink and Druid to analyze and process data. EMR can be used to process data stored on different Alibaba Cloud data storage services, such as Log Service (SLS), Object Storage Service(OSS), and Relational Data Service (RDS). It is easy to create clusters quickly without having to install hardware or software. Its Web interface allows you to perform all maintenance operations.
Learn more
Apache Gobblin
A distributed data integration framework which simplifies common Big Data integration tasks such as data ingestion and replication, organization, and lifecycle management. It can be used for both streaming and batch data ecosystems. It can be run as a standalone program on a single computer. Also supports embedded mode. It can be used as a mapreduce application on multiple Hadoop versions. Azkaban is also available for the launch of mapreduce jobs. It can run as a standalone cluster, with primary and worker nodes. This mode supports high availability, and can also run on bare metals. This mode can be used as an elastic cluster in the public cloud. This mode supports high availability. Gobblin, as it exists today, is a framework that can build various data integration applications such as replication, ingest, and so on. Each of these applications are typically set up as a job and executed by Azkaban, a scheduler.
Learn more
Integrations
Company Details
Company:
Tencent
Year Founded:
2013
Headquarters:
China
Website:
intl.cloud.tencent.com/product/emr
Media
Recommended Products
Our Free Plans just got better! | Auth0 by Okta
You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your secuirty. Auth0 now, thank yourself later.
Product Details
Platforms
SaaS
Type of Training
Documentation
Customer Support
Phone Support
Online
Tencent Cloud Elastic MapReduce Features and Options
Tencent Cloud Elastic MapReduce User Reviews
Write a Review- Previous
- Next