Summary

The Airflow project is rapidly evolving, with more frequent releases bringing advancements in DAG authoring, observability, and project stability. We’re excited about the release of Airflow 2.5 because it has notable updates and quality-of-life improvements touching big features like dynamic task mapping, sensors, task groups, datasets, and the UI.

Key Takeaways

In this webinar, we’ll cover all the great 2.5 updates that make Airflow even easier to use and implement at scale. We’ll spend extra time on exciting new features like:

• Dynamic mapping over task groups, which makes the dynamic task mapping feature even more flexible.
• Updates to the datasets UI, including filtering and search capabilities.
• A new @sensor decorator that lets you turn any Python function into a sensor.
• Updates to XCom, particularly for dynamically mapped tasks.

Kenten Danas - Lead Developer Advocate at Astronomer

Kenten is a Lead Developer Advocate at Astronomer, with a background in field engineering, data engineering, and consulting. She has first-hand experience adopting and running Airflow as a consultant, and is passionate about helping other data engineers scale and get the most out of their Airflow experience.

Astronomer Webinars are biweekly, real-time online sessions for data pipeline authors hosted by Astronomer’s Apache Airflow® experts. During an hour-long meeting, participants have a chance to dive into the most important features and practices related to Apache Airflow® and data orchestration — from Airflow 2+ feature highlights to DAG writing best practices. At the end of each webinar, we open the floor for a Q&A to ensure that participants leave the event confident about their newly acquired knowledge.