WEBINAR

Best Practices for Running Airflow at Scale

Recorded On August 5, 2025

  • Naveen Sukumar
  • Jake Roach
  • Stephen Faig

Leading companies like Uber, Ford, and LinkedIn rely on Apache Airflow to orchestrate hundreds of thousands of tasks daily. However, scaling multiple Airflow deployments effectively requires optimized resource management, streamlined workflow development, and robust observability to avoid performance bottlenecks and developer inefficiencies.

Watch this webinar to discover practical strategies for running Airflow efficiently at scale.

You’ll learn:

  • How to select and optimize Airflow configurations tailored to your workloads.
  • Techniques for automating Airflow infrastructure management with Terraform, REST APIs, and self-service platforms.
  • Ways to accelerate workflow development using templating tools.
  • Approaches to standardize shared code libraries to reduce redundancy.
  • How to maintain the health of your Airflow environments and enhance visibility into complex workflows.

Whether engineering resilient pipelines or managing scalable Airflow infrastructure, this session will equip you with actionable insights for successful Airflow operations.

See More Resources

What’s New in the Astro Platform Release, Q1 2024

How to expertly organize your DAGs with task groups

Data-Aware Scheduling with the Astro Python SDK

DAG writing for data engineers and data scientists

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.