WEBINAR

DAG Writing Best Practices

Recorded On November 7, 2024

  • Kenten Danas
  • Tamara Fingerlin

Because Airflow is 100% code, knowing the basics of Python is all it takes to get started writing DAGs. However, writing DAGs that are efficient, secure, and scalable requires some Airflow-specific finesse. It’s no surprise that one of the most requested topics in this year’s Airflow survey was more Airflow best practices content. We hear you, and we’ve got you covered with this hands-on workshop on DAG writing best practices.

Whether you’re writing traditional ELT/ETL pipelines or complex ML workflows, you’ll learn how to make Airflow work best for your use case. We’ll teach you best practices including things like:

  • How to design your DAGs for easy readability and maintenance
  • How to make your DAGs dynamic in an efficient and scalable way
  • How to avoid common pitfalls that can cause performance issues

See More Resources

Airflow at Faire: Democratizing Machine Learning at Scale

Improve Your DAGs with Hidden Airflow Features

Efficient data quality checks with Airflow 2.7

Debugging your Airflow DAGs

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.