The Astronomer Blog: Data Orchestration Insights & Guides

September 21, 2023

Day-2 Operations for LLM Applications with Apache Airflow®

Explore how Apache Airflow® solves day-2 operations challenges for LLM applications. Learn about scalable, reliable, and auditable workflows with Airflow.

September 8, 2023

Advanced Airflow CDC Implementation

Dive deeper into Airflow CDC implementation. Explore advanced use cases, best practices, and handle schema evolution & log-based sync effectively.

August 30, 2023

Comparing Data Orchestration: Databricks Workflows vs. Apache Airflow®, Part 1

Choosing the right data orchestration tool for your needs can be tough. This blog post compares Databricks Workflows and Apache Airflow, two popular options.

August 24, 2023

Debugging Airflow Made Easy: 3 Key Steps to Debug your DAGs

Learn how to debug Airflow DAGs in 3 key steps. Eliminate common issues, set up a local development environment, and implement testing for seamless Airflow workflows.

August 23, 2023

Orchestrating Machine Learning Pipelines with Airflow

In the realm of machine learning, managing workflows efficiently is paramount. One tool that has emerged as a game-changer in this space is Apache Airflow®.

August 22, 2023

Change Data Capture (CDC) in Airflow: A Beginner's Guide

Understand the basics of Change Data Capture (CDC) in Airflow. Learn its importance, use cases, and core concepts for data pipeline success.

August 18, 2023

Introducing Airflow 2.7

The latest minor release includes several new features, such as automatic setup/teardown of tasks, built-in OpenLineage support, cluster activity view, fail-stop functionality, and more.

August 15, 2023

Leveraging Apache Airflow® and Kubernetes for Data Processing

Get insights on how to use Apache Airflow® and the Kubernetes Executor for data processing, along with proven best practices and tips for scaling your workloads.

August 10, 2023

Test Airflow Upgrades with the Astro CLI

The Local Upgrade Test command in the Astro CLI eliminates upgrade pains and ensures safe upgrades, allowing users to confidently identify and resolve compatibility issues, and DAG import errors.

Astronomer Blog

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.