WEBINAR

Best practices for running Airflow at scale

Recorded On January 22, 2025

  • Kenten Danas
  • Bas Harenslak

Data teams at companies like Uber, Ford, and LinkedIn use Airflow to power their data ops because of its ability to scale, sometimes orchestrating hundreds of thousands of tasks each day.

However, running multiple Airflow deployments at scale can be a challenge. Without properly optimizing resource utilization, task performance, and user management, teams can encounter bottlenecks and suboptimal developer efficiency.

Join our live session to learn best practices for running Airflow at scale. We’ll cover:

  • How to choose appropriate Airflow resources and configurations for your workloads.
  • How to automate management of Airflow deployment resources and users.

How to leverage observability and alerting features to monitor the health of your Airflow deployments.

See More Resources

Power your LLMOps with Airflow’s Weaviate Provider

Astro 101 Webinar: An Introduction to fully-managed Airflow

Anatomy of an Operator

From Zero to Production: Orchestrating LLM workflows with the Airflow AI SDK

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.