Astronomer Blog

The latest insights from our team of experts

September 22, 2023

Ask Astro: An open source LLM Application with Apache Airflow

Michael Gregory Staff Ecosystem Engineer

A reference implementation and community dialogue for building production-grade day-2 operations for LLM applications

September 8, 2023

Change Data Capture with Airflow - Part 2

We look at some examples to implement CDC in Airflow using a legacy data pipeline with batch processing, and look at advanced use cases for near-real-time processing.

August 30, 2023

Comparing Data Orchestration: Databricks Workflows vs. Apache Airflow, Part 1

A detailed guide to building an ETL workflow in Databricks Workflows and Apache Airflow

June 2, 2023

The Top 7 Alternatives to MWAA

Here’s a look at seven alternatives to MWAA.

June 2, 2023

The Top 7 Alternatives to Google Cloud Composer

Picking the right tools for your data stack depends on your exact business and engineering needs, and the choice may seem daunting. Thankfully, there are several popular tools, each with thousands of users, all with a unique approach for managing data pipelines.

May 15, 2023

How we optimized the Registry for performance across millions of page views

Migrating the Astronomer Registry’s backend from Airtable to Postgres and a Golang REST API

May 3, 2023

Scale Airflow with confidence using Astro’s new Alerting capabilities

See how Astro can help you stay ahead of Data SLAs and commitments to stakeholders

May 2, 2023

Introducing Airflow 2.6

Apache Airflow 2.6 contains over 500 commits from over 130 contributors, adding up to 35 new features, 50 general improvements, and 27 bug fixes.

April 3, 2023

Kubernetes Executor Support in Astro: A New Era of Scalability and Resource Management

We are excited to announce the public launch of Kubernetes Executor support in Astro. With this, you can now take advantage of the underpinning power of Kubernetes to manage resources and scale your Airflow workloads.

March 30, 2023

CI/CD Enforcement for Code Changes

Ensure that all code changes are deployed within your CI/CD processes, increase code quality, and enforce automated testing.

March 10, 2023

OpenLineage Is on the Rise in 2023

See why OpenLineage is ascendant and find out how to get an in-person overview of this open-source standard at the upcoming Data Council conference in Austin, Texas.

February 24, 2023

Inside Authorized Workspaces, A New Feature in Astro

Astro customers can isolate teams or projects to specific clusters in their data planes, ensuring that data goes where it’s supposed to go.

Astronomer Blog

Try Astro Today