Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

Airflow is a community-driven platform designed for the programmatic creation, scheduling, and monitoring of workflows. With its modular architecture, Airflow employs a message queue to manage an unlimited number of workers, making it highly scalable. The system is capable of handling complex operations through its ability to define pipelines using Python, facilitating dynamic pipeline generation. This flexibility enables developers to write code that can create pipelines on the fly. Users can easily create custom operators and expand existing libraries, tailoring the abstraction level to meet their specific needs. The pipelines in Airflow are both concise and clear, with built-in parametrization supported by the robust Jinja templating engine. Eliminate the need for complex command-line operations or obscure XML configurations! Instead, leverage standard Python functionalities to construct workflows, incorporating date-time formats for scheduling and utilizing loops for the dynamic generation of tasks. This approach ensures that you retain complete freedom and adaptability when designing your workflows, allowing you to efficiently respond to changing requirements. Additionally, Airflow's user-friendly interface empowers teams to collaboratively refine and optimize their workflow processes.

Description

Dagster is the cloud-native open-source orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability. It is the platform of choice data teams responsible for the development, production, and observation of data assets. With Dagster, you can focus on running tasks, or you can identify the key assets you need to create using a declarative approach. Embrace CI/CD best practices from the get-go: build reusable components, spot data quality issues, and flag bugs early.

API Access

Has API

API Access

Has API

Screenshots View All

Screenshots View All

Integrations

DataHub
Great Expectations
OpenMetadata
SDF
Tobiko
Airbyte
Azure Databricks
Beats
Chalk
Coginiti
DQOps
Dagster
DataBuck
GitHub
JAMS
Kedro
Oxla
Soda
Twilio
intermix.io

Integrations

DataHub
Great Expectations
OpenMetadata
SDF
Tobiko
Airbyte
Azure Databricks
Beats
Chalk
Coginiti
DQOps
Dagster
DataBuck
GitHub
JAMS
Kedro
Oxla
Soda
Twilio
intermix.io

Pricing Details

No price information available.
Free Trial
Free Version

Pricing Details

$0
Free Trial
Free Version

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Deployment

Web-Based
On-Premises
iPhone App
iPad App
Android App
Windows
Mac
Linux
Chromebook

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Customer Support

Business Hours
Live Rep (24/7)
Online Support

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Types of Training

Training Docs
Webinars
Live Training (Online)
In Person

Vendor Details

Company Name

The Apache Software Foundation

Founded

1999

Country

United States

Website

airflow.apache.org

Vendor Details

Company Name

Dagster Labs

Founded

2019

Country

United States

Website

dagster.io

Product Features

Workflow Management

Access Controls/Permissions
Approval Process Control
Business Process Automation
Calendar Management
Compliance Tracking
Configurable Workflow
Customizable Dashboard
Document Management
Forms Management
Graphical Workflow Editor
Mobile Access
No-Code
Task Management
Third Party Integrations
Workflow Configuration

Product Features

Data Fabric

Data Access Management
Data Analytics
Data Collaboration
Data Lineage Tools
Data Networking / Connecting
Metadata Functionality
No Data Redundancy
Persistent Data Management

Data Management

Customer Data
Data Analysis
Data Capture
Data Integration
Data Migration
Data Quality Control
Data Security
Information Governance
Master Data Management
Match & Merge

ETL

Data Analysis
Data Filtering
Data Quality Control
Job Scheduling
Match & Merge
Metadata Management
Non-Relational Transformations
Version Control

Machine Learning

Deep Learning
ML Algorithm Library
Model Training
Natural Language Processing (NLP)
Predictive Modeling
Statistical / Mathematical Tools
Templates
Visualization

Alternatives

Alternatives

JAMS Reviews

JAMS

JAMS Software
Union Cloud Reviews

Union Cloud

Union.ai
Amazon MWAA Reviews

Amazon MWAA

Amazon
dbt Reviews

dbt

dbt Labs
Flyte Reviews

Flyte

Union.ai