The Astronomer Blog: Data Orchestration Insights & Guides

November 28, 2022

A Short History of DAG Writing

Learn about Airflow & its updated features. Get to know how users can benefit from Taskflow API, Custom XCom Backends, Astro SDK, and the Astro Cloud IDE.

November 17, 2022

Best Practices for Secure Network Connectivity and Authentication in Astro

Learn how to securely hook up data sources and implement strong authentication in Astro — a modern data orchestration solution powered by Apache Airflow®.

November 11, 2022

3 Ways to Extract Data Lineage with Airflow

Learn how to extract data lineage events from your Airflow pipelines using OpenLineage. Plus, see how these three methods work with the Astro platform.

November 10, 2022

How Astro’s Data Graph Helps Data Engineers Run and Fix Their Pipelines

Discover how Astro can help you understand, communicate, and solve pipeline problems. Learn about the key pipeline observability feature – the Data Graph.

November 3, 2022

OpenLineage: Where It Came from and What Comes Next

Hear from Julien Le Dem, Chief Architect at Astronomer, about the creation of OpenLineage and how it’s evolving into a standard for data lineage.

October 27, 2022

How to Keep Data Quality in Check with Airflow

Learn more about Airflow-driven data quality checks, their benefits, and design. Find out how data quality issues are detected and solved at Astronomer.

October 18, 2022

What’s New in Astro Python SDK 1.1: Data-Driven Scheduling, Dynamic Tasks, and Redshift Support

Learn what the new upgraded Astro Python SDK 1.1 offers to Airflow users. Find out more about data-driven scheduling, dynamic tasks, and Redshift support.

October 17, 2022

Orchestration, or How to Become a Data-Driven Company

Learn how Astro, the modern Airflow-powered data orchestration platform, helped Astronomer build a fully coordinated data ecosystem.

October 11, 2022

Micropipelines: A Microservice Approach for DAG Authoring in Apache Airflow®

Learn how to tune the data system and have critical data products ready on time with micropipelines. See how to make DAG authoring easier with Airflow 2.4.

Astronomer Blog

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.