The Astronomer Blog: Data Orchestration Insights & Guides

November 2, 2023

Apache Airflow® TaskFlow API vs. Traditional Operators: An In-Depth Comparison for Efficient DAGs

Explore the TaskFlow API and traditional operators and find out how to combine them for dynamic, efficient DAGs.

October 31, 2023

Orchestrating Feature Pipelines: Announcing the Tecton Airflow Provider

See how the new Tecton Airflow Provider can make your feature pipeline orchestration within Apache Airflow® more efficient.

October 24, 2023

Ask Astro: Operationalizing Data Ingest for Retrieval Augmented Generation with LLMs, Part 3

Data ingestion for RAG with LLMs: Ask Astro Part 3 covers vector stores, schema design, and chunking.

October 12, 2023

Using Astronomer’s new Cosmos to deploy dbt pipelines onto Snowflake

The state of deploying pipelines with dbt has changed considerably in the last few months. Over the last few weeks, I was working with Astronomer to test out their new tool, Cosmos, to deploy dbt workflows onto Snowflake.

October 11, 2023

Databricks vs. Airflow From a Management Perspective, Part 2

Databricks vs Airflow from a production management perspective. Explore the differences in setup, monitoring, integrations, scalability & customization.

October 10, 2023

ML for Customer Analytics with Airflow, Snowpark, and Weaviate

An example project showing how to use Apache Airflow® to orchestrate a machine learning pipeline with the Snowpark provider and Snowpark ML.

October 6, 2023

Migrate Python Jobs to Airflow in 4 Simple Steps

Learn how easy it is to migrate Python scripts to Airflow DAGs, streamline orchestration, and leverage Airflow features to boost job efficiency.

September 29, 2023

3 Key Takeaways from Airflow Summit 2023

Last week, the first-ever in-person Airflow Summit occurred in Toronto, Canada. Over 500 attendees from 20+ countries came together for all things Airflow, orchestration, and open source.

September 22, 2023

Ask Astro: An open source LLM Application with Apache Airflow®, Part 2

Build an LLM-powered chatbot with Airflow! Learn how to leverage domain-specific knowledge to create intelligent applications like "Ask Astro." Astro LLM meets Apache Airflow.

Astronomer Blog

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.