Astronomer Blog

The latest insights from our team of experts

September 22, 2023

Ask Astro: An open source LLM Application with Apache Airflow

Michael Gregory Staff Ecosystem Engineer

A reference implementation and community dialogue for building production-grade day-2 operations for LLM applications

September 8, 2023

Change Data Capture with Airflow - Part 2

We look at some examples to implement CDC in Airflow using a legacy data pipeline with batch processing, and look at advanced use cases for near-real-time processing.

August 30, 2023

Comparing Data Orchestration: Databricks Workflows vs. Apache Airflow, Part 1

A detailed guide to building an ETL workflow in Databricks Workflows and Apache Airflow

September 29, 2021

The Future of Banking: How Can Apache Airflow Help?

Learn what are the challenges of the banking industry today, and how Apache Airflow can help with digital transformation.

September 22, 2021

Apache NiFi vs. Apache Airflow

Overview and comparison study of two popular ETL tools for managing the golden asset of most organizations: data. Can these two be compared at all?

September 16, 2021

Airflow at Wise: Data Orchestrator in Machine Learning

A talk with Alexandra Abbas—a Machine Learning Engineer at Wise—about how they leverage Apache Airflow in their ML initiatives.

September 3, 2021

How to Build an ETL Process?

Extract, transform, load. Discover the vital steps and methods of building an ETL process for your business.

August 24, 2021

Data Silos: What Are They and How to Fix Them?

Everything you need to know about data silos – how they influence your business, where they come from, and how to fix them.

August 17, 2021

Airflow at Societe Generale: Data Orchestration Solution in Banking

A conversation with Societe Generale about their Airflow implementation and development of the data orchestration solution.

August 9, 2021

Data Pipeline: Components, Types, and Best Practices

Why are data pipelines an absolute necessity for any smart, data-driven business? Learn the basics and follow our best practices.

August 6, 2021

Building a Scalable Analytics Architecture With Airflow and dbt: Part 3

Learn how to build a scalable analytics architecture with Apache Airflow and dbt – in the third and final part of our series.

July 29, 2021

What Is Data Orchestration and Why Is It Essential for Business

Discover what data orchestration is, learn the most significant pain points it addresses, and find out how to help your business grow.

Astronomer Blog

Try Astro Today