Airflow logging
An introduction to Airflow logging.
Custom XCom backends
Use this guide to learn about different ways you can set up custom XCom backends.
Cluster policies
Learn about everything you need to use the Apache Airflow cluster policies.
Deferrable operators
Implement deferrable operators to save cost and resources with Airflow.
Dynamically generate DAGs
Get to know the best ways to dynamically generate DAGs in Apache Airflow. Use examples to generate DAGs using single- and multiple-file methods.
Event-driven scheduling
Learn how schedule DAGs based on messages in a message queue.
Isolated Environments
Learn how to run an Airflow task in an isolated environment.
KubernetesPodOperator
Use the KubernetesPodOperator in Airflow to run tasks in Kubernetes Pods
MLOps
Learn how to use Airflow to run machine learning in production.
Multilanguage
Learn how to run Airflow tasks in languages other than Python.
Plugins
How to use Airflow plugins.
Pools
Use pools to control Airflow task parallelism.
Setup/ teardown tasks
Learn how to use setup and teardown tasks to manage task resources in Airflow.
Sharing code between multiple projects
A description of the various ways to reuse and share code between multiple projects, with pros and cons of each solution.
Test DAGs
Learn about testing Airflow DAGs and gain insight into various types of tests — validation testing, unit testing, and data and pipeline integrity testing.