Best practices for scaling Apache Airflow®

Are you all too familiar with out of memory errors, Dagbag imports timing out, or tasks stuck in “scheduled” when they're ready to run? If so, you've probably hit the wall that most teams face when scaling Airflow.

Join this webinar to discover practical strategies for running Airflow efficiently at any scale.

Learn how to:

• Use scaling parameters at the configuration, Dag and task-level to optimize task resource utilization
• Configure Airflow infrastructure components, from Dag processor and Scheduler parameters to setting up worker queues
• How to automate Airflow infrastructure management of multiple Airflow environments with terraform

Whether your deployments are just starting to strain under growing task volume or you're already managing that scale, this one’s for you.