Airflow in Action: DataOps Insights from 2,200 Pipelines at Instacart
- M Matthew Keep
Discover how Instacart scaled Apache Airflow to handle 2,200 pipelines and 16 million tasks monthly with custom tools, IaC, and centralized management.
Astronomer Blog
The latest insights from our team of Apache Airflow® experts.
Airflow in Action: ML and Data Engineering Insights from the Analytics-Obsessed World of MLB
Explore how the Texas Rangers and Philadelphia Phillies use Airflow to revolutionize data orchestration and ML, driving faster insights and a competitive edge.
Data Observability 101: An Introduction to the Most Critical Features of Modern Data Observability
When data is your product, your pipelines are supply chains.
How to orchestrate Azure Data Explorer queries with Airflow
Learn how to orchestrate Azure Data Explorer queries with Airflow.
How to Select the Best ETL Tool to Integrate With Airflow? Our 3 Picks
Learn from our experts about how to select the best ETL tool, and why it pays to integrate Fivetran, Airbyte, and Azure Data Factory with Apache Airflow®.
Every Company Nowadays Becomes a Data Company—Interview with Bolke de Bruin
Hear from Bolke de Bruin – VP of Enterprise Data Services at Astronomer – about how Apache Airflow® helps modern companies manage data effectively.
Machine Learning Pipeline Orchestration
Learn about machine learning orchestration, machine learning pipelines, and their components. See why Apache Airflow® is the top ML data orchestration tool.
How to Build a Modern Data Stack
Breaking down what a modern data stack means in practice. We discuss four core components, five reasons to set it up, and how to orchestrate it.
Apache Airflow® vs. Apache Beam: A Comparative Guide
Explore the differences and similarities between Apache Beam and Airflow. Understand their capabilities, programming models, and ideal use cases to make the right choice for your data management needs.
Democratizing the Data Stack—Airflow for Business Workflows
See why modern orchestrators and reverse ETL tools are the future for data-driven business. Learn how Apache Airflow® takes SQL to the next level.
Machine Learning Pipeline: Everything You Need to Know
Discover what a machine learning pipeline is and the process behind creating one with Apache Airflow®. Learn what you need to know about ML pipelines.
What is Reverse ETL and How Can It Improve Data Flow?
Understand the difference between ETL and reverse ETL. Learn to use the Census reverse ETL platform and Airflow together to leverage data orchestration.
