One of the great benefits of Airflow is that your pipelines are defined as Python code, which means you can treat them like any other piece of software. This allows you to leverage software engineering best practices, such as using CI/CD to automate key parts of your pipeline development lifecycle, including code changes, builds, and testing. CI/CD helps your organization develop faster, more securely, and more reliably.
In this webinar, we show how you can use CI/CD with Airflow to manage the deployment and testing of your DAGs. All code shown in the demo can be found in this repo. For more CI/CD templates for deploying to Astro, see our docs.