Join us for Astro Days: NYC on Sept 27!
Webinars

What’s New in Airflow 2.4

When: October 4, 2022 at 2pm EDT

Hosted By

  • Kenten Danas Kenten Danas Lead Developer Advocate
  • Viraj Parekh Viraj Parekh Field CTO

Summary

The Airflow project is rapidly evolving, with frequent releases bringing advancements in DAG authoring, observability, and project stability. We’re super excited for the release of Airflow 2.4, which comes with big changes in the flexibility of DAG scheduling and data awareness, expansion of the dynamic task mapping feature, and much more.

Key Takeaways

In this webinar, we’ll cover all the great 2.4 updates that make Airflow even more powerful and observable. We’ll spend extra time on exciting new features like:

  • Data-driven scheduling, a new feature where DAGs that access the same data now have explicit, visible relationships, and DAGs can be scheduled based on updates to datasets. This feature is a big step forward in making Airflow data-aware, and vastly expands Airflow’s scheduling capabilities beyond time-based methods like Cron.
  • Updates to the dynamic task mapping feature, including new options for mapping over multiple parameters.
  • A new simpler, consolidated schedule parameter.

Kenten Danas - Lead Developer Advocate at Astronomer

Kenten is a Lead Developer Advocate at Astronomer, with a background in field engineering, data engineering, and consulting. She has first-hand experience adopting and running Airflow as a consultant, and is passionate about helping other data engineers scale and get the most out of their Airflow experience.

Viraj Parekh - Field CTO

Viraj is Field CTO at Astronomer, where he works to help ensure that Airflow and Astronomer have a great story within the greater data ecosystem. He’s based in Brooklyn and is always eager to talk about anything related to Knicks basketball.

Astronomer Webinars are biweekly, real-time online sessions for data pipeline authors hosted by Astronomer’s Apache Airflow experts. During an hour-long meeting, participants have a chance to dive into the most important features and practices related to Apache Airflow and data orchestration — from Airflow 2+ feature highlights to DAG writing best practices. At the end of each webinar, we open the floor for a Q&A to ensure that participants leave the event confident about their newly acquired knowledge.

Save Your Spot Today

By proceeding you agree to our Privacy Policy and to receive emails from Astronomer.