Astronomer Blog

The latest insights from our team of experts

September 22, 2023

Ask Astro: An open source LLM Application with Apache Airflow

Michael Gregory Staff Ecosystem Engineer

A reference implementation and community dialogue for building production-grade day-2 operations for LLM applications

September 8, 2023

Change Data Capture with Airflow - Part 2

We look at some examples to implement CDC in Airflow using a legacy data pipeline with batch processing, and look at advanced use cases for near-real-time processing.

August 30, 2023

Comparing Data Orchestration: Databricks Workflows vs. Apache Airflow, Part 1

A detailed guide to building an ETL workflow in Databricks Workflows and Apache Airflow

August 22, 2022

Reimagining Airflow for Data Engineers and Data Scientists with the Astro Python SDK

Introducing the fastest way to get started writing Airflow data pipelines.

August 9, 2022

Astro Is Now Available on All Major Cloud Providers

Data teams can now run Astro — the data orchestration platform powered by Airflow — on AWS, Azure, and Google Cloud, providing access to the latest Airflow updates, smooth integration of your native services, and more time to focus on your pipelines.

August 5, 2022

Everything You Should Know About Airflow 2.3’s New Grid View

Airflow 2.3’s new grid view is a compact, intuitive way to visualize complex representations in Airflow’s UI. Today, we present a detailed overview of the feature.

July 14, 2022

The Astronomer Providers Package — A Better Option for Long-Running Tasks

A deeper dive into this new collection of deferrable operators, hooks, and sensors, which can save money by reducing the resources Airflow consumes.

June 17, 2022

Ventana Research Names Astronomer as a Finalist for Its Digital Innovation Awards

Astronomer is a finalist for the 15th Annual Ventana Research Digital Innovation Awards, which recognize companies for creating innovative technologies.

June 10, 2022

Introducing Astro, the Fully Managed Data Orchestration Platform, Powered by Airflow

Astro lets organizations build, run, and observe data pipelines quickly and reliably. Its support for data lineage provides complete visibility into pipelines running across projects, regions, and clouds.

June 2, 2022

Introducing New Astro CLI Commands to Make DAG Testing Easier

The open-source Astro CLI is the easiest way to develop DAGs with Apache Airflow locally. The new Astro CLI commands we’re announcing today give users a simple, standardized, frustration-free way to test and debug their DAGs and tasks.

May 24, 2022

To Build or to Buy? DIY Orchestration with Airflow vs. A Fully Managed Service

In this article, we look at a few common reasons organizations consider building their own Airflow infrastructures, and at how a fully managed service can save resources and make you more competitive.

May 12, 2022

Introducing Astronomer Providers

We’re excited to introduce Astronomer Providers, a set of Airflow 2-licensed providers with async functionality, created and maintained by Astronomer.

Astronomer Blog

Try Astro Today