WEBINAR

Reusable DAG Patterns with TaskGroups

Recorded On July 19, 2022

  • Kenten Danas
  • Viraj Parekh

In this session Live with Astronomer will explore some creative ways to use TaskGroups. While TaskGroups are a UI feature, they can also be adapted to create reusable patterns with multiple operators in your DAGs. In this session we’ll show how Astronomer’s data and intelligence team uses TaskGroups to reduce the amount of code the team has to write while adhering to DAG authoring best practices.

You can find more information on task groups and a code sample to create your own reusable task groups in our guide.

Live with Astronomer is a biweekly series of short, real-time online sessions for data pipeline authors, hosted by Astronomer’s resident Airflow experts. Topics range from Airflow feature highlights to DAG authoring how-tos to interviews with the developers of Airflow, and every session includes an audience Q&A. It’s all designed to make sure you get the most out of your Airflow experience.

See More Resources

Try Astro for Free for 14 Days

Sign up with your business email and get up to $20 in free credits.

Get Started

Get started free.

OR

API Access
Alerting
SAML-Based SSO
Airflow AI Assistant
Deployment Rollbacks
Audit Logging

By proceeding you agree to our Privacy Policy, our Website Terms and to receive emails from Astronomer.