Best practices for scaling Apache Airflow®

One of Airflow's greatest strengths is that it scales with your business, from startup to Fortune 500 enterprise. Companies like OpenAI, GitHub and Qualcomm run thousands to millions of tasks every day, distributed across many Dags and Airflow environments.

If you're scaling Airflow from a handful of Dags to a multi-Deployment operation, the wrong foundation will cost you later. In this webinar, we'll walk you through the best practices, scaling parameters, and resource provisioning to get there.

Learn how to:

• Write Dags that scale using best practices
• Use scaling parameters to optimize resource utilization
• Adjust your infrastructure to support large scale Airflow environments