In this webinar, we provide an overview of the major new features and significant updates included in the newly released Airflow 2.4. Working through a variety of use cases, this high-level recap addresses new data-driven scheduling capabilities that help users avoid monolithic DAGs.
The webinar focuses on a number of specific new features in Airflow 2.4, such as:
- Datasets and data-aware scheduling, which lets DAG authors create smaller and more self-contained DAGs
- Updates to dynamic task mapping
- A consolidated schedule parameter
- New operators and decorators
- And more!
All of the sample code shown in this webinar can be found in this repo.
