Pachyderm Reviews

Pachyderm Description

Pachyderm's Data Versioning provides teams with an automated and efficient way to track all data changes. File-based versioning allows for a complete audit trail of all data and artifacts across the pipeline stages, including intermediate results. Versioning can be automated and guaranteed because they are native objects, not metadata pointers. Without writing additional code, autoscale data processing by parallel. Incremental processing reduces computation by only processing the differences and automatically skipping duplicates. Pachyderm's Global IDs allow teams to track any result back to its raw input. This includes all analysis, parameters, codes, and intermediate results. The Pachyderm Console allows you to see your DAG (directed-acyclic graph) and helps with reproducibility using Global IDs.