Best Query Engines for Kubernetes

Trino is an engine that runs at incredible speeds. Fast-distributed SQL engine for big data analytics. Helps you explore the data universe. Trino is an extremely parallel and distributed query-engine, which is built from scratch for efficient, low latency analytics. Trino is used by the largest organizations to query data lakes with exabytes of data and massive data warehouses. Supports a wide range of use cases including interactive ad-hoc analysis, large batch queries that take hours to complete, and high volume apps that execute sub-second queries. Trino is a ANSI SQL query engine that works with BI Tools such as R Tableau Power BI Superset and many others. You can natively search data in Hadoop S3, Cassandra MySQL and many other systems without having to use complex, slow and error-prone copying processes. Access data from multiple systems in a single query.

Timeplus is an easy-to-use, powerful and cost-effective platform for stream processing. All in one binary, easily deployable anywhere. We help data teams in organizations of any size and industry process streaming data and historical data quickly, intuitively and efficiently. Lightweight, one binary, no dependencies. Streaming analytics and historical functionality from end-to-end. 1/10 of the cost of comparable open source frameworks Transform real-time data from the market and transactions into real-time insight. Monitor financial data using append-only streams or key-value streams. Implement real-time feature pipelines using Timeplus. All infrastructure logs, metrics and traces are consolidated on one platform. In Timeplus we support a variety of data sources through our web console UI. You can also push data using REST API or create external streams, without copying data to Timeplus.

Starburst allows you to make better decisions by having quick access to all of your data. Your company has more data than ever, but your data teams are still waiting to analyze it. Starburst gives your data teams quick and accurate access to more data. Starburst Enterprise, a fully supported, production-tested, enterprise-grade distribution for open source Trino (formerly Presto®, SQL), is now available. It increases performance and security, while making it easy for you to deploy, connect, manage, and manage your Trino environment. Starburst allows your team to connect to any source of data, whether it's on-premise, in a cloud, or across a hybrid cloud environment. This allows them to use the analytics tools they already love and access data that lives anywhere.

A hybrid SQL-onHadoop engine that delivers advanced, security-rich data queries across enterprise big data sources including Hadoop object storage and data warehouses. IBM Db2 Big SQL, an enterprise-grade, hybrid ANSI compliant SQL-on-Hadoop engine that delivers massively parallel processing and advanced data query, is available. Db2 Big SQL allows you to connect to multiple sources, such as Hadoop HDFS and WebHDFS. RDMS, NoSQL database, object stores, and RDMS. You can benefit from low latency, high speed, data security, SQL compatibility and federation capabilities to perform complex and ad-hoc queries. Db2 Big SQL now comes in two versions. It can be integrated with Cloudera Data Platform or accessed as a cloud native service on the IBM Cloud Pak®. for Data platform. Access, analyze, and perform queries on real-time and batch data from multiple sources, including Hadoop, object stores, and data warehouses.

Apache Spark™, a unified analytics engine that can handle large-scale data processing, is available. Apache Spark delivers high performance for streaming and batch data. It uses a state of the art DAG scheduler, query optimizer, as well as a physical execution engine. Spark has over 80 high-level operators, making it easy to create parallel apps. You can also use it interactively via the Scala, Python and R SQL shells. Spark powers a number of libraries, including SQL and DataFrames and MLlib for machine-learning, GraphX and Spark Streaming. These libraries can be combined seamlessly in one application. Spark can run on Hadoop, Apache Mesos and Kubernetes. It can also be used standalone or in the cloud. It can access a variety of data sources. Spark can be run in standalone cluster mode on EC2, Hadoop YARN and Mesos. Access data in HDFS and Alluxio.

Scale from 0 to millions of events every second. Arroyo is shipped as a single compact binary. Run locally on MacOS, Linux or Kubernetes for development and deploy to production using Docker or Kubernetes. Arroyo is an entirely new stream processing engine that was built from the ground-up to make real time easier than batch. Arroyo has been designed so that anyone with SQL knowledge can build reliable, efficient and correct streaming pipelines. Data scientists and engineers are able to build real-time dashboards, models, and applications from end-to-end without the need for a separate streaming expert team. SQL allows you to transform, filter, aggregate and join data streams with results that are sub-second. Your streaming pipelines should not page someone because Kubernetes rescheduled your pods. Arroyo can run in a modern, elastic cloud environment, from simple container runtimes such as Fargate, to large, distributed deployments using the Kubernetes logo.