Apache Parquet Description

Parquet was developed to provide the benefits of efficient, compressed columnar data representation to all projects within the Hadoop ecosystem. Designed with a focus on accommodating complex nested data structures, Parquet employs the record shredding and assembly technique outlined in the Dremel paper, which we consider to be a more effective strategy than merely flattening nested namespaces. This format supports highly efficient compression and encoding methods, and various projects have shown the significant performance improvements that arise from utilizing appropriate compression and encoding strategies for their datasets. Furthermore, Parquet enables the specification of compression schemes at the column level, ensuring its adaptability for future developments in encoding technologies. It is crafted to be accessible for any user, as the Hadoop ecosystem comprises a diverse range of data processing frameworks, and we aim to remain neutral in our support for these different initiatives. Ultimately, our goal is to empower users with a flexible and robust tool that enhances their data management capabilities across various applications.

Integrations

Reviews

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Company Details

Company:
The Apache Software Foundation
Year Founded:
1999
Headquarters:
United States
Website:
parquet.apache.org

Media

Apache Parquet Screenshot 1
Recommended Products
Our Free Plans just got better! | Auth0 Icon
Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.
Try free now

Product Details

Platforms
Windows
Mac
Linux
Types of Training
Training Docs
Webinars
Training Videos
Customer Support
Online Support

Apache Parquet Features and Options

Apache Parquet User Reviews

Write a Review
  • Previous
  • Next