Average Ratings 0 Ratings
Average Ratings 0 Ratings
Description
Delta Lake serves as an open-source storage layer that integrates ACID transactions into Apache Spark™ and big data operations. In typical data lakes, multiple pipelines operate simultaneously to read and write data, which often forces data engineers to engage in a complex and time-consuming effort to maintain data integrity because transactional capabilities are absent. By incorporating ACID transactions, Delta Lake enhances data lakes and ensures a high level of consistency with its serializability feature, the most robust isolation level available. For further insights, refer to Diving into Delta Lake: Unpacking the Transaction Log. In the realm of big data, even metadata can reach substantial sizes, and Delta Lake manages metadata with the same significance as the actual data, utilizing Spark's distributed processing strengths for efficient handling. Consequently, Delta Lake is capable of managing massive tables that can scale to petabytes, containing billions of partitions and files without difficulty. Additionally, Delta Lake offers data snapshots, which allow developers to retrieve and revert to previous data versions, facilitating audits, rollbacks, or the replication of experiments while ensuring data reliability and consistency across the board.
Description
OLake Fusion is an application designed for self-hosting that focuses on the management of Apache Iceberg tables within data lakehouses. This tool automates the process of scheduled table compaction, effectively merging smaller data files and transforming delete files to enhance the overall layout of tables as data is consistently added, modified, or removed. Users have the ability to set maintenance schedules at the individual table level, choosing from compaction tiers labeled Lite, Medium, and Full, while also being able to assess table health, file metrics, and monitor maintenance activities and logs via an intuitive web interface. Additionally, Fusion integrates seamlessly with various Iceberg catalogs, such as AWS Glue, Hive Metastore, JDBC, and REST-based catalog systems like Nessie, Polaris, Unity Catalog, and Lakekeeper, allowing it to manage tables that were created externally to OLake. Deployment options include Docker or Kubernetes, making it suitable for a team’s cloud infrastructure or on-premises setup. This tool is particularly beneficial for data engineers and platform teams who are managing analytical lakehouses that utilize Apache Iceberg, ensuring efficient data handling within their environments. The flexibility and robustness of OLake Fusion make it an essential asset for modern data management practices.
API Access
Has API
Yes
API Access
Has API
No
Integrations
Acryl Data
Yes
Apache Iceberg
No
Ascend
Yes
Booz Allen MDR
Yes
Databricks
Yes
Edmunds Financial Management
Yes
IBM StreamSets
Yes
Informatica Cloud Application Integration
Yes
Kyvos Semantic Layer
Yes
McGraw-Hill Connect
Yes
Integrations
Acryl Data
No
Apache Iceberg
Yes
Ascend
No
Booz Allen MDR
No
Databricks
No
Edmunds Financial Management
No
IBM StreamSets
No
Informatica Cloud Application Integration
No
Kyvos Semantic Layer
No
McGraw-Hill Connect
No
Pricing Details
No price information available.
Free Trial
No
Free Version
No
Pricing Details
$0
The open-source software has no license charge; customers pay for the compute and storage they provision.
Free Trial
No
Free Version
Yes
Deployment
Web-Based
Yes
On-Premises
No
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Deployment
Web-Based
No
On-Premises
Yes
iPhone App
No
iPad App
No
Android App
No
Windows
No
Mac
No
Linux
No
Chromebook
No
Customer Support
Business Hours
No
Live Rep (24/7)
Yes
Online Support
No
Customer Support
Business Hours
No
Live Rep (24/7)
No
Online Support
Yes
Types of Training
Training Docs
Yes
Webinars
Yes
Live Training (Online)
No
In Person
No
Types of Training
Training Docs
Yes
Webinars
No
Live Training (Online)
No
In Person
No
Vendor Details
Company Name
Delta Lake
Founded
2019
Country
United States
Website
delta.io
Vendor Details
Company Name
Datazip
Country
United States
Website
olake.io/olake-fusion/
Product Features
Big Data
Collaboration
No
Data Blends
No
Data Cleansing
No
Data Mining
No
Data Visualization
No
Data Warehousing
No
High Volume Processing
No
No-Code Sandbox
No
Predictive Analytics
No
Templates
No