WEBINAR

Simplified DAG Authoring with New Airflow Features

Recorded On February 14, 2023

  • Kenten Danas
  • Viraj Parekh

This webinar provides an overview of how to use three new Airflow features and supporting open source community projects to simplify your DAG authoring process. We cover how to utilize these tools to write less code and design more straightforward DAGs, as well as use cases that most benefit from them. Questions covered in this session include:

  • How can I use datasets to implement cross-DAG dependencies that have increased visibility?
  • How can I use dynamic task mapping to create DAGs that dynamically update at runtime while also remaining scalable?
  • How do I use the new Astro Python SDK to rapidly develop ELT workflows by turning my SQL queries and Python functions into Airflow tasks with no boilerplate code?

All of the code shown in this webinar can be found in this repo.

See More Resources

Dynamic DAGs

What’s New in Airflow 2.4

Q2 2024 Astro Release: Seamlessly Integrate dbt with Astro

The Astro Python SDK Load File Function

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.