Join us for Astro Days: NYC on Sept 27!

Live with Astronomer

Data Driven Scheduling

When: October 11, 2022 at 2pm EDT

Hosted By

  • Kenten Danas Kenten Danas Lead Developer Advocate
  • Viraj Parekh Viraj Parekh Field CTO

Summary

On October 11th, Live with Astronomer will dive into the new datasets feature introduced in Airflow 2.4. We’ll show how DAGs that access the same data now have explicit, visible relationships, and how DAGs can be scheduled based on updates to these datasets. This feature is a big step forward in making Airflow data-aware, and vastly expands Airflow’s scheduling capabilities beyond time-based methods like Cron. And it’s widely applicable to many common use cases.

Live with Astronomer is a biweekly series of short, real-time online sessions for data pipeline authors, hosted by Astronomer’s resident Airflow experts. Topics range from Airflow feature highlights to DAG authoring how-tos to interviews with the developers of Airflow, and every session includes an audience Q&A. It’s all designed to make sure you get the most out of your Airflow experience.

Save Your Spot Today

By proceeding you agree to our Privacy Policy and to receive emails from Astronomer.