Occubee Integrations

Apache Hive™, a data warehouse software, facilitates the reading, writing and management of large datasets that are stored in distributed storage using SQL. Structure can be projected onto existing data. Hive provides a command line tool and a JDBC driver to allow users to connect to it. Apache Hive is an Apache Software Foundation open-source project. It was previously a subproject to Apache® Hadoop®, but it has now become a top-level project. We encourage you to read about the project and share your knowledge. To execute traditional SQL queries, you must use the MapReduce Java API. Hive provides the SQL abstraction needed to integrate SQL-like query (HiveQL), into the underlying Java. This is in addition to the Java API that implements queries.

Microsoft Azure is a cloud computing platform that allows you to quickly develop, test and manage applications. Azure. Invent with purpose. With more than 100 services, you can turn ideas into solutions. Microsoft continues to innovate to support your development today and your product visions tomorrow. Open source and support for all languages, frameworks and languages allow you to build what you want and deploy wherever you want. We can meet you at the edge, on-premises, or in the cloud. Services for hybrid cloud enable you to integrate and manage your environments. Secure your environment from the ground up with proactive compliance and support from experts. This is a trusted service for startups, governments, and enterprises. With the numbers to prove it, the cloud you can trust.

Apache Hadoop is a software library that allows distributed processing of large data sets across multiple computers. It uses simple programming models. It can scale from one server to thousands of machines and offer local computations and storage. Instead of relying on hardware to provide high-availability, it is designed to detect and manage failures at the application layer. This allows for highly-available services on top of a cluster computers that may be susceptible to failures.

Apache Spark™, a unified analytics engine that can handle large-scale data processing, is available. Apache Spark delivers high performance for streaming and batch data. It uses a state of the art DAG scheduler, query optimizer, as well as a physical execution engine. Spark has over 80 high-level operators, making it easy to create parallel apps. You can also use it interactively via the Scala, Python and R SQL shells. Spark powers a number of libraries, including SQL and DataFrames and MLlib for machine-learning, GraphX and Spark Streaming. These libraries can be combined seamlessly in one application. Spark can run on Hadoop, Apache Mesos and Kubernetes. It can also be used standalone or in the cloud. It can access a variety of data sources. Spark can be run in standalone cluster mode on EC2, Hadoop YARN and Mesos. Access data in HDFS and Alluxio.

Atlas is a flexible and extensible set core foundational governance services that enable enterprises to efficiently and effectively meet their compliance requirements within Hadoop. It also allows integration with the entire enterprise data ecosystem. Apache Atlas offers open metadata management and governance capabilities that allow organizations to create a catalog of their data assets, classify, govern and provide collaboration capabilities around these assets for data scientists, analysts, and the data governance group. Pre-defined types to manage various Hadoop and non Hadoop metadata. Ability to create new types to manage metadata. Types can inherit from other types, and can have simple attributes, complex attributes, and object references. Type instances, also known as entities, are able to capture metadata object details and their relationships. REST APIs allow for easier integration with types and instances.