Airflow in Action: DataOps Insights from 2,200 Pipelines at Instacart
- M Matthew Keep
Discover how Instacart scaled Apache Airflow to handle 2,200 pipelines and 16 million tasks monthly with custom tools, IaC, and centralized management.
Astronomer Blog
The latest insights from our team of Apache Airflow® experts.
Airflow in Action: ML and Data Engineering Insights from the Analytics-Obsessed World of MLB
Explore how the Texas Rangers and Philadelphia Phillies use Airflow to revolutionize data orchestration and ML, driving faster insights and a competitive edge.
Data Observability 101: An Introduction to the Most Critical Features of Modern Data Observability
When data is your product, your pipelines are supply chains.
How to Keep Data Quality in Check with Airflow
Learn more about Airflow-driven data quality checks, their benefits, and design. Find out how data quality issues are detected and solved at Astronomer.
What’s New in Astro Python SDK 1.1: Data-Driven Scheduling, Dynamic Tasks, and Redshift Support
Learn what the new upgraded Astro Python SDK 1.1 offers to Airflow users. Find out more about data-driven scheduling, dynamic tasks, and Redshift support.
Orchestration, or How to Become a Data-Driven Company
Learn how Astro, the modern Airflow-powered data orchestration platform, helped Astronomer build a fully coordinated data ecosystem.
Micropipelines: A Microservice Approach for DAG Authoring in Apache Airflow®
Learn how to tune the data system and have critical data products ready on time with micropipelines. See how to make DAG authoring easier with Airflow 2.4.
Expanding Data Access and Exchange Inside a Company
Hear from Steven Hillion and Taylor Merrick about how our data scientists combine tooling and process to encourage company-wide data product development.
Airflow 2.4 and Data-Driven Scheduling: How a New Feature Is Saving Time at Astronomer
Learn how Astronomer is using the new data-driven scheduling feature in Airflow 2.4. See how it benefits DAG authors and helps solve timing problems.
Astro CLI: The Easiest Way to Install Apache Airflow®
Learn all about the Astro CLI — the free, open source tool that makes it easy to install, run, and test Apache Airflow® from your command line.
Apache Airflow® 2.4 — Everything You Need to Know
Discover the newly released Apache Airflow® 2.4. Find out how its new data-driven scheduling logic enables faster and easier delivery of data.
Podcast Spotlight: What Observability Brings to Data Orchestration
Hear from Astronomer’s Senior Vice President of R&D about how data orchestration and observability improve the quality and reliability of dataflows.
