Astronomer Adopts DAG Factory to Democratize Writing Data Pipelines
We are thrilled to announce that Astronomer is officially taking over Adam Boscarino’s DAG Factory, an open source project that allows DAGs to be generated from YAML files.
Astronomer Blog
The latest insights from our team of Apache Airflow® experts.
Introducing Cohort 3 of the Astronomer Champions Program for Apache Airflow®!
We are thrilled to introduce Cohort 3 of our Champions Program for Apache Airflow! Launched at the start of 2024, our diverse and experienced champions have paved the way for this latest group to make a lasting impact on the Apache Airflow® community.
Exploring Airflow 2.9 Features with Astronomer's 29 Days of Airflow 2.9 Series
Join Astronomer in a comprehensive review of Airflow 2.9's capabilities across 29 days. Discover significant updates from dynamic data scheduling to advanced task management, and see how they can enhance your data engineering strategies.
Enhanced Astro Workspace Roles for more granular permissions
In this blog post, we will dive into the details of the Astro’s Role-Based Access Control (RBAC) and new Workspace Role updates, and explore improvements to popular use cases of Astro.
ETL in Airflow: A Comprehensive Guide to Efficient Data Pipelines
This guide covers everything you need to know about creating efficient data pipelines with Apache Airflow®. Get tips to speed up your pipelines, improve their reliability, and make them easier to manage.
Run ETL with Astro and CrateDB Cloud in 30min - fully up in the cloud
Use Apache Airflow® with CrateDB to run ETL processes, deploy with ease thanks to Astro and CrateDB Cloud.
Introducing Cosmos 1.0: the best way to run dbt Core in Airflow
Turn your dbt projects into entire Airflow DAGs with less than 10 lines of code.
6 Lessons Learned in Building Astronomer’s Developer Documentation
The Astronomer Approach to Clear and Effective Technical Documentation
Expert tips for monitoring the health and SLAs of your Apache Airflow® DAGs
Metrics in the form of tables, charts, or graphs are useful for monitoring the health of your Airflow system and maintaining the SLA of your data pipelines. They provide a quick and easy way to identify issues and take corrective actions. While Airflow's built-in UI is a good starting point along with notifications, using Airflow’s REST API to extract metadata about your DAGs and tasks provides advanced observability options with an added overhead of cost and maintenance.
.jpg)
Advantages of Hosted Airflow for Your ETL Workflows
Maximize ETL efficiency with hosted Apache Airflow® on Astro, not self-hosting open-source. Benefit from simplified infrastructure management, scalable elasticity, and dedicated support for your workloads.
Best Practices for Building an Airflow Service (Part 1)
This guide covers best practices for everything from choosing the right Airflow deployment model to configuring your DAGs for optimal performance.
Astronomer and Fivetran Partner to Release Production-Grade ELT Airflow Provider
The new provider will make it easier for organizations to use Airflow to automate and manage their Fivetran pipelines.
