WEBINAR

DAG writing for data engineers and data scientists

Recorded On February 8, 2024

  • Kenten Danas
  • Tamara Fingerlin

Because Airflow is 100% code, knowing the basics of Python is all it takes to get started writing DAGs. However, writing DAGs that are efficient, secure, and scalable requires some Airflow-specific finesse. Whether you’re writing traditional ELT/ETL pipelines or complex ML workflows, we’re here to help you learn how to make Airflow work best for your use case.

In this webinar, we cover DAG writing best practices applicable to data engineers and data scientists on topics like DAG design, dynamic DAGs, and testing.

The code shown in this webinar can be found in this repo.

See More Resources

Debugging your Airflow DAGs

Secrets Management in Airflow 2.0 - March 2021

Implementing reliable ETL & ELT pipelines with Airflow and Snowflake

Best Practices for Building Secure Data Pipelines with Apache Airflow®

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.