globe

Live with Astronomer

Data-Aware Scheduling with the Astro Python SDK

Watch On Demand

Hosted By

  • Benji Lampel Benji Lampel Ecosystem Engineer
    Astronomer
  • Tamara Fingerlin Tamara Fingerlin Developer Advocate
    Astronomer

Summary

Live with Astronomer dives into implementing data-aware scheduling with the Astro Python SDK. The new Airflow Datasets feature allows you to schedule DAGs based on updates to your data and easily view cross-DAG relationships. This feature is part of the Astro Python SDK, so it requires almost no effort from the DAG author to implement. We’ll show you everything you need to do (and don’t need to do) to take advantage of Datasets.

Live with Astronomer is a bi-weekly series of short, real-time online sessions for data pipeline authors, hosted by Astronomer’s resident Airflow experts. Topics range from Airflow feature highlights to DAG authoring how-tos to interviews with the developers of Airflow, and every session includes an audience Q&A. It’s all designed to make sure you get the most out of your Airflow experience.

Missed the event? Watch on demand.

By proceeding you agree to our Privacy Policy , our Website Terms and to receive emails from Astronomer.