Watch the recording
By proceeding you agree to our Privacy Policy, our Website Terms and to receive emails from Astronomer.
Best practices for running Airflow at scale
Recorded on
Kenten DanasDirector, Developer RelationsAstronomer
Bas HarenslakStaff ArchitectAstronomer
Note: There is a newer version of this webinar available: Best Practices for Running Apache Airflow® in Production.
Data teams at companies like Uber, and LinkedIn use Airflow to power their data orchestration because of its ability to scale, sometimes orchestrating hundreds of thousands of tasks each day.
However, running multiple Airflow deployments at scale can be a challenge. Without properly optimizing resource utilization, task performance, and user management, teams can encounter bottlenecks and suboptimal developer efficiency.
Join our live session to learn best practices for running Airflow at scale. We’ll cover:
- How to choose appropriate Airflow resources and configurations for your workloads.
- How to automate management of Airflow deployment resources and users.
How to leverage observability and alerting features to monitor the health of your Airflow deployments.
