Introducing Apache Airflow 2.9
The Airflow 2.9 release brings significant enhancements to user-favorite features like data-aware scheduling, dynamic task mapping, and object storage.
Ensuring Data Pipeline Integrity: A Comprehensive Guide to Testing Airflow DAGs
An introduction to testing strategies, best practices, and implementation techniques.
Introducing Cohort 2 of the Astronomer Champions Program for Apache Airflow!
Our beta cohort of 10 is now joined by 23 hand-selected individuals who, we believe, truly embody what it means to champion the Apache Airflow Project.
Using Apache Airflow to Create Data Infrastructure in the Public Sector
When ARGO began exploring the technology required to build, operate, and maintain data infrastructure in the public sector, it’s no surprise they landed on Apache Airflow.
Data Formats 101
Business analysts generally encounter four main formats of data: JSON, XML, CSV, and TSV. So what are these types and why would we use them?
Why Every Data Scientist Needs a Data Engineer
The data scientist, the sexiest role of the 21st century, isn't actually very sexy. But it could be.
What Exactly Is a DAG?
What exactly is a DAG and what does it tell us that the term “data pipeline” can't?
Data Engineering Platform Astronomer Closes $3.5M Financing
The Astronomer platform collects, processes and unifies data, allowing organizations to scale analytics, data science and insights.
Normalizing Data for Warehouse Centralization
Knowing the options for storing data will help you make the right decisions for your company when you’re ready to take this step.
Apache Airflow and the Future of Data Engineering: A Q&A with Maxime Beauchemin
I reached out to Max about doing an interview post, and to my delight, he agreed. Here are thoughtful answers to questions about Airflow and data engineering.
Our Open Source Philosophy
The world where technology is open sourced is the world we want to live in. Our CTO explains why.
Why Is My Data Playing Hard to Get?
When we talk about 'hard to reach' data, what kind of data are we talking about, and why exactly is it so hard to access, organize, and store?
