With the KubernetesPodOperator, Airflow offers the possibility to leverage Kubernetes containerization for individual tasks. Run Airflow tasks in their own custom containerized environment with specific package dependencies and gain the ability to execute tasks defined in languages other than Python. Since Astro runs on Kubernetes clusters natively, there’s no additional set up to manage and scaling horizontally becomes effortless.
Using Astro can take your use of Kubernetes with Airflow to the next level. Find the best solution to run your containerized tasks in a reliable, scalable, and cost-effective way by collaborating with our in-house experts.