WEBINAR

DAG writing for data engineers and data scientists

Recorded On February 8, 2024

  • Kenten Danas
  • Tamara Fingerlin

Because Airflow is 100% code, knowing the basics of Python is all it takes to get started writing DAGs. However, writing DAGs that are efficient, secure, and scalable requires some Airflow-specific finesse. Whether you’re writing traditional ELT/ETL pipelines or complex ML workflows, we’re here to help you learn how to make Airflow work best for your use case.

In this webinar, we cover DAG writing best practices applicable to data engineers and data scientists on topics like DAG design, dynamic DAGs, and testing.

The code shown in this webinar can be found in this repo.

See More Resources

Intro to Airflow: Get Started Writing Pipelines for Any Use Case

How to write better DAGs in Airflow

Data-Aware Scheduling with the Astro Python SDK

Power your LLMOps with Airflow’s Weaviate Provider

Try Astro for Free for 14 Days

Sign up with your business email and get up to $20 in free credits.

Get Started

Build, run, & observe your data workflows.
All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $20 in free credits during your 14-day trial.