The Astronomer Blog: Data Orchestration Insights & Guides

March 23, 2021

Airflow 2.0 TaskFlow API and Its Features

Learn more about the TaskFlow API and read about its features. Get to know how TaskFlow API in Airflow 2.0 enables a better DAG authoring experience.

March 8, 2021

Airflow Secrets Management: Best Practices for Airflow 2.0

Have a look at Astronomer’s ultimate guide on Airflow Secrets, and learn best practices for managing Secrets with various backends in Apache Airflow® 2.0.

January 21, 2021

Near-Real-Time CDC with Airflow and GCP

Learn how to implement near-real-time Change Data Capture (CDC) in Airflow using a scheduled GCP CloudSQL export approach for data pipelines.

January 5, 2021

Deploying Airflow DAGs in Production with dbt (Part 2)

Take your Airflow DAGs live! Learn how to deploy them in production using dbt manifest.json, and integrate dbt into your ETL/ELT workflows.

December 22, 2020

Building a Scalable Analytics Architecture With Airflow and dbt (Part 1)

Kickstart your analytics architecture with Airflow and dbt. Learn DAG authoring, configurations, and code snippets for a seamless setup.

December 17, 2020

The Airflow 2.0 Scheduler

Explore the features of the updated Apache Airflow® 2.0 Scheduler. Learn how the Airflow Scheduler enables quick and seamless initiation of tasks.

November 23, 2020

A Great Expectations Provider for Apache Airflow®

Find out why Great Expectations and Apache Airflow® are a great match. Learn how to leverage native Great Expectations functionality directly from DAGs.

October 29, 2020

Introducing Airflow 2.0

Get to know the highlights of Apache Airflow® 2.0 and see hundreds of new features it includes. Have a look at how Airflow 2.0 compares to Airflow 1.10.

March 17, 2020

Introducing KEDA for Airflow

Explore the possibilities of the Kubernetes Event-Driven Autoscaler. See how KEDA helps users improve the efficiency of their Apache Airflow® deployments.

Astronomer Blog

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.