Best practices for running Airflow at scale
Hosted By
In this webinar, we’ll cover best practices for running Airflow at scale so you can provide your teams with a robust, reliable Airflow service.
Astronomer Webinars
Join us for upcoming online events!
The State of Airflow 2025
Our panel of experts will discuss the state of Airflow in 2025, including trends and results from the recent annual Airflow survey.
Watch Recorded Webinars On-Demand
What’s New in Airflow 2.3
The Airflow project is rapidly evolving, with frequent releases bringing advancements in DAG authoring, observability, and project stability. We’re super excited for the release of Airflow 2.3, which comes with big changes in the flexibility of DAG creation, improvements to the Airflow UI, and much more.
Using Airflow as a Data Analyst
A data analyst’s workflow typically involves ingesting and transforming data and Airflow is the perfect tool to orchestrate analytics workflows.
OpenLineage and Airflow: A Deeper Dive
Data lineage is the complex set of relationships between your jobs and datasets. Using OpenLineage with Apache Airflow®, you can observe and analyze these relationships, allowing you to find and fix issues more quickly. This webinar will provide a deeper dive on OpenLineage, extending beyond the basics into key implementation details and best practices.
Improve Your DAGs with Hidden Airflow Features
Apache Airflow® is flexible and powerful. It has a rich ecosystem and an incredibly active community. But are you sure you haven’t missed anything? A new feature or concept that could put your DAGs at another level? It can be challenging to keep up with the latest Airflow features, and sometimes we miss the most useful ones. For this webinar, I'd like to introduce you to a couple of lesser-known features of Apache Airflow® that can dramatically improve your data pipelines.
Scaling Out Airflow
Learn about the process of scaling out Airflow with Celery and Kubernetes Executor and the parameters that need to be tuned when adding nodes to Airflow.
Data Quality Use Cases with Airflow and Great Expectations
At this webinar, Benji Lampel (Enterprise Platform Architect @ Astronomer) and Tal Gluck (Software Engineer @ Superconductive) will present several Airflow DAGs using Great Expectations that cover more advanced DAG patterns and data quality checking cases.
The Airflow API
Learn about Airflow’s fully stable REST API. Find out how to use it and why it’s a great tool for managing and monitoring data pipelines.
Introducing Astro: Data Centric DAG Authoring
Learn about Astro, a new DAG writing experience brought by Astronomer. See how we’re taking Airflow 2.0 and the concept of providers to the next level.
Data Lineage with OpenLineage and Airflow
If one out of your hundreds of DAGs fails, how do you know which downstream datasets have become out-of-date? The answer is data lineage. Data lineage is the complex set of relationships between your jobs and datasets. In this webinar, you'll learn how to use OpenLineage to collect lineage metadata from Airflow and assemble a lineage graph - a picture of your pipeline worth way more than a thousand words.
