Astronomer Blog

The latest insights from our team of experts

September 22, 2023

Ask Astro: An open source LLM Application with Apache Airflow

Michael Gregory Staff Ecosystem Engineer

A reference implementation and community dialogue for building production-grade day-2 operations for LLM applications

September 8, 2023

Change Data Capture with Airflow - Part 2

We look at some examples to implement CDC in Airflow using a legacy data pipeline with batch processing, and look at advanced use cases for near-real-time processing.

August 30, 2023

Comparing Data Orchestration: Databricks Workflows vs. Apache Airflow, Part 1

A detailed guide to building an ETL workflow in Databricks Workflows and Apache Airflow

July 27, 2021

Airflow Summit 2021 Highlights

Learn about the biggest community-driven event around Apache Airflow 2021 and the power of the Airflow community.

July 22, 2021

How Data Pipelines Drive Improved Sales in E-commerce

Our Field CTO, Viraj Parekh, shares insights on how sales and marketing operations in e-commerce can benefit from running functional data pipelines.

May 11, 2021

Everything You Need to Know About the Airflow Summit 2021

Join Airflow Summit 2021 – a free online conference for the worldwide community of developers and users of Apache Airflow.

May 5, 2021

Validate Your Apache Airflow Skills With the Astronomer Certification

Boost your career and learn to run a data pipeline by getting Apache Airflow certified with the Astronomer Certification for Apache Airflow Fundamentals.

April 21, 2021

The New KubernetesExecutor

We give you a tour of the new features in the KubernetesExecutor 2.0. Spoiler alert – it's faster, more flexible, and easier to understand.

March 30, 2021

Announcing the Astronomer Registry

Today, we're excited to release our discovery and distribution hub for Apache Airflow integrations.

March 23, 2021

Airflow 2.0 TaskFlow API and Its Features

Learn how the TaskFlow API in Airflow 2.0 enables a better DAG authoring experience.

March 8, 2021

Secrets Management in Airflow 2.0

Secrets are sensitive information that are used as part of your DAG. Here are some best practices for managing them in Apache Airflow 2.0.

January 21, 2021

Change Data Capture With Apache Airflow: Part 1

Implementing production-grade change data capture in near real-time on Google CloudSQL with Apache Airflow.

Astronomer Blog

Try Astro Today