The Astronomer Blog: Data Orchestration Insights & Guides

January 15, 2025

Airflow in Action: 5.5K Pipelines, 200 Models, 10% of the World’s Web Sites. MLOps Insights From Wix

Wix runs 5,500 Airflow pipelines daily, powering ML workflows for the company that hosts 10% of the web. Explore their innovative MLOps platform.

January 8, 2025

Airflow in Action: Deploying AI Clusters to 100 Data Centers in 3 Months. Infrastructure Insights from Cloudflare

Learn how Airflow powers Cloudflare’s infrastructure automation, from server diagnostics to GPU inference clusters in 100+ data centers

January 3, 2025

Airflow in Action: Data Engineering Insights from Circle, Managing $10s of Billions Across Multiple Blockchains

Learn how Circle manages stablecoins across multiple blockchains with Airflow, tackling MWAA challenges and exploring Astronomer for speed & scale

December 17, 2024

Airflow in Action: $160BN in Assets, 4,000 Data Pipelines. Financial Workflow Insights from Robinhood

Learn how Robinhood scaled mission-critical financial workflows with Airflow, from trading to clearing, migration strategies, and future plans.

December 12, 2024

Airflow in Action: Model Training with PBs of New Data Weekly. DataOps & MLOps Insights from Ford

Learn how Ford’s Mach1ML platform, powered by Airflow and Astronomer, delivers scalable, efficient MLOps for AI-driven innovation and next-gen vehicles.

December 10, 2024

Airflow in Action: DataOps Insights from 2,200 Pipelines at Instacart

Discover how Instacart scaled Apache Airflow to handle 2,200 pipelines and 16 million tasks monthly with custom tools, IaC, and centralized management.

December 5, 2024

Airflow in Action: ML and Data Engineering Insights from the Analytics-Obsessed World of MLB

Explore how the Texas Rangers and Philadelphia Phillies use Airflow to revolutionize data orchestration and ML, driving faster insights and a competitive edge.

December 4, 2024

Data Observability 101: An Introduction to the Most Critical Features of Modern Data Observability

Explore core data observability features: analytics, monitoring, and alerts. Gain insights into pipeline health, prevent failures, and ensure data reliability.

December 3, 2024

Airflow in Action: How Panasonic Energy is Accelerating the EV Transition With Data Engineering

Learn how Panasonic leverages Apache Airflow to streamline battery production, scale workflows, and plan for streaming and Kubernetes.

Astronomer Blog

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.