Dynamic Tasks in Airflow

Watch Video On Demand

Hosted By

  • Kenten Danas
  • Tamara Fingerlin

In this webinar, we provide an overview of the dynamic task mapping feature that was first introduced in Airflow 2.3 and expanded further in Airflow 2.4. Previously, tasks could only be generated dynamically at the time the DAG was parsed. Now, with dynamic task mapping, you can create tasks at runtime based on external criteria, without knowing in advance how many tasks you need.

The webinar, which reviews the basic functions of dynamic task mapping through pertinent use cases, answers questions like:

All of the sample code shown in this webinar can be found in this repo.

Ready to Get Started?

See how your team can fuel its data workflows with more power and less complexity than ever before.

Start Free Trial →

Which plan works best for your team?

Learn about pricing →

What can Astronomer do for your organization?

Talk to an expert →