Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Average Ratings 0 Ratings

Total
ease
features
design
support

No User Reviews. Be the first to provide a review:

Write a Review

Description

AWS Data Pipeline is a robust web service designed to facilitate the reliable processing and movement of data across various AWS compute and storage services, as well as from on-premises data sources, according to defined schedules. This service enables you to consistently access data in its storage location, perform large-scale transformations and processing, and seamlessly transfer the outcomes to AWS services like Amazon S3, Amazon RDS, Amazon DynamoDB, and Amazon EMR. With AWS Data Pipeline, you can effortlessly construct intricate data processing workflows that are resilient, repeatable, and highly available. You can rest assured knowing that you do not need to manage resource availability, address inter-task dependencies, handle transient failures or timeouts during individual tasks, or set up a failure notification system. Additionally, AWS Data Pipeline provides the capability to access and process data that was previously confined within on-premises data silos, expanding your data processing possibilities significantly. This service ultimately streamlines the data management process and enhances operational efficiency across your organization.

Description

Dagster is the cloud-native open-source orchestrator for the whole development lifecycle, with integrated lineage and observability, a declarative programming model, and best-in-class testability. It is the platform of choice data teams responsible for the development, production, and observation of data assets. With Dagster, you can focus on running tasks, or you can identify the key assets you need to create using a declarative approach. Embrace CI/CD best practices from the get-go: build reusable components, spot data quality issues, and flag bugs early.

API Access

Has API Yes 

API Access

Has API Yes 

Screenshots View All

Screenshots View All

Integrations

Airbyte No 
Amazon DynamoDB Yes 
Amazon EC2 Yes 
Amazon EMR Yes 
Amazon Web Services (AWS) No 
Apache Airflow No 
Apache Spark No 
Azure Databricks No 
Coginiti No 
Collate No 
Datadog No 
Functionize Yes 
GitHub No 
Google Cloud Platform No 
Jupyter Notebook No 
Kubernetes No 
Mobito Yes 
Papertrail No 
SDF No 
SquaredUp Yes 

Integrations

Airbyte Yes 
Amazon DynamoDB No 
Amazon EC2 No 
Amazon EMR No 
Amazon Web Services (AWS) Yes 
Apache Airflow Yes 
Apache Spark Yes 
Azure Databricks Yes 
Coginiti Yes 
Collate Yes 
Datadog Yes 
Functionize No 
GitHub Yes 
Google Cloud Platform Yes 
Jupyter Notebook Yes 
Kubernetes Yes 
Mobito No 
Papertrail Yes 
SDF Yes 
SquaredUp No 

Pricing Details

$1 per month
Free Trial No 
Free Version Yes 

Pricing Details

$0
Pricing starts at $0.04/min for Serverless and $0.03/min for Hybrid, and tapers down from there based on usage.
Free Trial Yes 
Free Version Yes 

Deployment

Web-Based Yes 
On-Premises Yes 
iPhone App No 
iPad App No 
Android App No 
Windows No 
Mac No 
Linux No 
Chromebook No 

Deployment

Web-Based Yes 
On-Premises Yes 
iPhone App No 
iPad App No 
Android App No 
Windows Yes 
Mac Yes 
Linux Yes 
Chromebook No 

Customer Support

Business Hours No 
Live Rep (24/7) No 
Online Support Yes 

Customer Support

Business Hours No 
Live Rep (24/7) Yes 
Online Support Yes 

Types of Training

Training Docs Yes 
Webinars No 
Live Training (Online) No 
In Person No 

Types of Training

Training Docs Yes 
Webinars No 
Live Training (Online) No 
In Person No 

Vendor Details

Company Name

Amazon

Founded

1994

Country

United States

Website

aws.amazon.com/datapipeline/

Vendor Details

Company Name

Dagster Labs

Founded

2019

Country

United States

Website

dagster.io

Product Features

ETL

Data Analysis No 
Data Filtering No 
Data Quality Control No 
Job Scheduling No 
Match & Merge No 
Metadata Management No 
Non-Relational Transformations No 
Version Control No 

Product Features

Data Fabric

Data Access Management No 
Data Analytics Yes 
Data Collaboration Yes 
Data Lineage Tools Yes 
Data Networking / Connecting Yes 
Metadata Functionality Yes 
No Data Redundancy No 
Persistent Data Management No 

Data Management

Customer Data No 
Data Analysis Yes 
Data Capture No 
Data Integration Yes 
Data Migration Yes 
Data Quality Control No 
Data Security No 
Information Governance No 
Master Data Management No 
Match & Merge Yes 

ETL

Data Analysis Yes 
Data Filtering Yes 
Data Quality Control No 
Job Scheduling Yes 
Match & Merge No 
Metadata Management No 
Non-Relational Transformations No 
Version Control No 

Machine Learning

Deep Learning No 
ML Algorithm Library No 
Model Training Yes 
Natural Language Processing (NLP) No 
Predictive Modeling Yes 
Statistical / Mathematical Tools Yes 
Templates No 
Visualization No 

Alternatives

AWS Batch Reviews

AWS Batch

Amazon

Alternatives

AWS Glue Reviews

AWS Glue

Amazon
Union Cloud Reviews

Union Cloud

Union.ai
Flyte Reviews

Flyte

Union.ai