Astronomer Adopts DAG Factory to Democratize Writing Data Pipelines
We are thrilled to announce that Astronomer is officially taking over Adam Boscarino’s DAG Factory, an open source project that allows DAGs to be generated from YAML files.
Astronomer Blog
The latest insights from our team of Apache Airflow® experts.
Introducing Cohort 3 of the Astronomer Champions Program for Apache Airflow®!
We are thrilled to introduce Cohort 3 of our Champions Program for Apache Airflow! Launched at the start of 2024, our diverse and experienced champions have paved the way for this latest group to make a lasting impact on the Apache Airflow® community.
Exploring Airflow 2.9 Features with Astronomer's 29 Days of Airflow 2.9 Series
Join Astronomer in a comprehensive review of Airflow 2.9's capabilities across 29 days. Discover significant updates from dynamic data scheduling to advanced task management, and see how they can enhance your data engineering strategies.
Introducing the First Generative AI Cookbook for Data Orchestration
One of the biggest questions we get asked when discussing data orchestration for GenAI is how to get started. That is what our new GenAI Cookbook is designed to answer.
Announcing "The Data Flowcast" by Astronomer: Your Gateway to Mastering Airflow
This podcast is specially designed for the Apache Airflow® community and aims to share invaluable insights, useful tips, and engaging discussions about the current and future trends of Airflow.
SnowPatrol Series: Convert anomalies into actions, and how Grindr saved $600,000 in Snowflake costs
Explore how Grindr saved $600,000 on Snowflake costs with SnowPatrol. Learn about leveraging machine learning for anomaly detection and cost management in Snowflake with Airflow, including practical insights on monitoring, tagging, and remediation strategies for optimal cost efficiency.
Data Orchestration: The Dividing Line Between Generative AI Success and Failure
Learn how Apache Airflow® and Astronomer streamline data and model orchestration for Generative AI success. Explore practical use cases and a comprehensive guide.
Introducing Apache Airflow® 2.9
The Airflow 2.9 release brings significant enhancements to user-favorite features like data-aware scheduling, dynamic task mapping, and object storage.
Ensuring Data Pipeline Integrity: A Comprehensive Guide to Testing Airflow DAGs
An introduction to testing strategies, best practices, and implementation techniques.
Introducing Cohort 2 of the Astronomer Champions Program for Apache Airflow®!
Our beta cohort of 10 is now joined by 23 hand-selected individuals who, we believe, truly embody what it means to champion the Apache Airflow® Project.
What’s new in the Astro Platform Release, Q1 2024
Welcome to the latest Astro Platform release — we’re thrilled to introduce enhancements aimed at bolstering governance at scale and across environments, fortifying the security of your data platform, and accelerating innovation.
Introducing SnowPatrol - Snowflake Anomaly Detection and Cost Management with Machine Learning and Airflow
SnowPatrol is an open-source application for managing cloud costs that saved Astronomer almost 25% of its Snowflake spend. SnowPatrol offers a reference implementation for MLOps on Airflow to manage the training, testing, deployment, and monitoring of a predictive model of Snowflake spend. In this first post of a 3-part series, we introduce the application and how it was built on Airflow.
