The Astronomer Blog: Data Orchestration Insights & Guides

April 17, 2021

How to orchestrate Talend jobs with Airflow

Learn how to orchestrate Talend jobs with Airflow so you can use both tools without rewriting your pipelines.

March 30, 2021

Announcing the Astronomer Registry

Learn about the discovery-and-distribution hub for Airflow integrations. See how to bridge the gap between the Airflow community and the data ecosystem.

March 23, 2021

Airflow 2.0 TaskFlow API and Its Features

Learn more about the TaskFlow API and read about its features. Get to know how TaskFlow API in Airflow 2.0 enables a better DAG authoring experience.

March 8, 2021

Airflow Secrets Management: Best Practices for Airflow 2.0

Have a look at Astronomer’s ultimate guide on Airflow Secrets, and learn best practices for managing Secrets with various backends in Apache Airflow® 2.0.

January 21, 2021

Near-Real-Time CDC with Airflow and GCP

Learn how to implement near-real-time Change Data Capture (CDC) in Airflow using a scheduled GCP CloudSQL export approach for data pipelines.

January 5, 2021

Deploying Airflow DAGs in Production with dbt (Part 2)

Take your Airflow DAGs live! Learn how to deploy them in production using dbt manifest.json, and integrate dbt into your ETL/ELT workflows.

December 22, 2020

Building a Scalable Analytics Architecture With Airflow and dbt (Part 1)

Kickstart your analytics architecture with Airflow and dbt. Learn DAG authoring, configurations, and code snippets for a seamless setup.

December 17, 2020

The Airflow 2.0 Scheduler

Explore the features of the updated Apache Airflow® 2.0 Scheduler. Learn how the Airflow Scheduler enables quick and seamless initiation of tasks.

November 23, 2020

A Great Expectations Provider for Apache Airflow®

Find out why Great Expectations and Apache Airflow® are a great match. Learn how to leverage native Great Expectations functionality directly from DAGs.

Astronomer Blog

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.