Getting Started With the Official Airflow Helm Chart
The official helm chart of Apache Airflow is out! 🥳 The day of wondering what Helm Chart to use in production is over. Now, you only have one chart maintained and tested by Airflow PMC members as well as the community. It's time to get your hands on it and take it for a spin! At the end of the webinar, you will have a fully functional Airflow instance deployed with the Official Helm Chart and running within a Kubernetes cluster locally.
June 15, 2021 - 2:00PM EST
Using Dynamic DAGs with Airflow
The simplest way of creating an Airflow DAG is to write it as a static Python file. However, sometimes manually writing DAGs isn't practical. Maybe you have hundreds or thousands of DAGs that do similar things, with just a parameter changing between them. Or maybe you need a set of DAGs to load tables, but don't want to manually update DAGs every time those tables change. In these cases, and others, it can make more sense to dynamically generate DAGs. Because everything in Airflow is code, you can dynamically generate DAGs using Python alone. In this webinar, we'll talk about when you might want to dynamically generate your DAGs, show a couple of methods for doing so, and discuss problems that can arise when implementing dynamic generation at scale.
Using Airflow with Multiple AWS Accounts
In AWS, it's common for organizations to use multiple AWS accounts for various reasons, from Dev, Stage, Prod accounts to accounts being dedicated to LOBs. What do you do when your Data Pipeline needs to span AWS accounts? This webinar will show how you can run a single DAG across multiple AWS accounts in a secure manner.
Intro to Airflow
Learn about the core concepts, components, and benefits of working with Airflow.
Never miss an update from us.
Do Airflow the easy way.