The official helm chart of Apache Airflow is out! The days of wondering what Helm Chart to use in production are over. Now you can safely deploy Airflow in the production environment using an official chart maintained and tested by Airflow PMC members as well as the community.
Why is this great news?
- If Airflow gets updated, so does your Helm Chart
- You can quickly run some experiments with new features of Airflow, for example KEDA
- You can easily run local experiments
At the end of the webinar, you will have a fully functional Airflow instance deployed with the Official Helm Chart and running within a Kubernetes cluster locally.
Step 1: Create the local Kubernetes cluster
Note: You need to have Docker, Docker Composer, kubectl, and Kind installed.
- Open the
kind-cluster.yamlfile — here you define your cluster. You can see here different
workernodes. Each worker node you can configure and specify.