WEBINAR

Best Practices for Running Airflow at Scale

Recorded On August 5, 2025

  • Naveen Sukumar
  • Jake Roach
  • Stephen Faig

Leading companies like Uber, Ford, and LinkedIn rely on Apache Airflow to orchestrate hundreds of thousands of tasks daily. However, scaling multiple Airflow deployments effectively requires optimized resource management, streamlined workflow development, and robust observability to avoid performance bottlenecks and developer inefficiencies.

Watch this webinar to discover practical strategies for running Airflow efficiently at scale.

You’ll learn:

  • How to select and optimize Airflow configurations tailored to your workloads.
  • Techniques for automating Airflow infrastructure management with Terraform, REST APIs, and self-service platforms.
  • Ways to accelerate workflow development using templating tools.
  • Approaches to standardize shared code libraries to reduce redundancy.
  • How to maintain the health of your Airflow environments and enhance visibility into complex workflows.

Whether engineering resilient pipelines or managing scalable Airflow infrastructure, this session will equip you with actionable insights for successful Airflow operations.

See More Resources

Develop ML Pipelines with the Astro Cloud IDE

What's new in Airflow 2.10

Learn from the experts: how to write data pipelines with Airflow

The Astro CLI: the easiest way to get started with Airflow

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows.
All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.