WEBINAR

Best Practices for Running Airflow at Scale

Recorded On August 5, 2025

  • Naveen Sukumar
  • Jake Roach
  • Stephen Faig

Leading companies like Uber, Ford, and LinkedIn rely on Apache Airflow to orchestrate hundreds of thousands of tasks daily. However, scaling multiple Airflow deployments effectively requires optimized resource management, streamlined workflow development, and robust observability to avoid performance bottlenecks and developer inefficiencies.

Watch this webinar to discover practical strategies for running Airflow efficiently at scale.

You’ll learn:

  • How to select and optimize Airflow configurations tailored to your workloads.
  • Techniques for automating Airflow infrastructure management with Terraform, REST APIs, and self-service platforms.
  • Ways to accelerate workflow development using templating tools.
  • Approaches to standardize shared code libraries to reduce redundancy.
  • How to maintain the health of your Airflow environments and enhance visibility into complex workflows.

Whether engineering resilient pipelines or managing scalable Airflow infrastructure, this session will equip you with actionable insights for successful Airflow operations.

See More Resources

Organizing Your Airflow Project Code with the Astro CLI

The New DAG Schedule Parameter

Intro to Apache Airflow® Orchestration and Data Organization

Implementing reliable ETL & ELT pipelines with Airflow and Snowflake

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.