Airflow in Action: ETL Insights from Bloomberg — Slashing Runtimes by 50%
Bloomberg's Data Platform Engineering team shares four real-world Airflow configuration fixes that resolved production issues across 2,500+ DAGs — no code changes required.
Airflow in Action
Real-world stories from teams running Apache Airflow at scale.
Airflow in Action: Migrating 200,000 Pipelines to Airflow 3 at Uber
Uber is migrating 200k pipelines to Airflow 3. Here's the architecture, tooling, and strategy behind one of the largest orchestration migrations ever undertaken.
Airflow in Action: Kaiser Permanente's AI Pipelines Detecting Disease Before Clinicians Can
See how Kaiser Permanente runs AI and ML research pipelines on-prem with Airflow, and how Astronomer supports regulated industries with the same flexibility
Airflow in Action: How SAP Delivers Trusted AI for Enterprise Clients
See how SAP built a production RAG pipeline with Apache Airflow to power Joule for Consultants, processing 5M+ documents across 15 data sources for the enterprise.
Airflow in Action: From Steel City to Data City. Pittsburgh, Astro and Open Government Data
See how Pittsburgh's two-person data team uses Apache Airflow and Astro to power open government data, cut manual work, and deliver real civic impact.
Airflow in Action: How DoorDash Scaled for Data and ML Engineering
DoorDash runs one of the largest Airflow deployments in the world. See how they built the Orchestration Frederator to scale without the chaos.
Airflow in Action: Red Hat's Blueprint for Trusted AI Agents with Astro
How Red Hat built a trusted data and AI platform on Apache Airflow and Astro, powering 95 data products and production AI agents across the enterprise.
Airflow in Action: How American Express Orchestrates Metadata Across 3,000 Databases
Amex runs 100+ production Dags orchestrating metadata with Airflow. See how they built the operators, pipelines, and governance framework that makes it work.
Airflow in Action: Boosting BI at Visa. 100% Trust in Data With 70% Lower Overhead
Visa cut BI dashboard refresh times from 24 hours to 2 hours with Airflow. Learn how they automated end-to-end workflows and achieved zero missed SLAs.
Airflow in Action: Unlocking Airflow 3's Power for Multi-Tenancy at Datadog
Datadog processes 100+ trillion events daily. Learn why they chose Airflow 3 for multi-tenancy, and data-aware scheduling at scale.
Airflow in Action: Best Practices Learned From Scaling AI at Oracle
Best practices from AI at Oracle: use Airflow to scale GPU-heavy AI and MLOps on Kubernetes with higher reliability, visibility, and GPU ROI.
Airflow in Action: Expedia’s Multi-Tenant Platform at 200+ Clusters, 14,000+ Pipelines
How Expedia runs 14,000+ Dags across 200+ isolated Airflow clusters with multi-tenancy, templates, and automated CI/CD.
Airflow in Action: Qualcomm Chip Design Orchestration at Million-Task Scale with Airflow 3
How Qualcomm uses Airflow 3 to orchestrate chip design at massive scale, running millions of EDA tasks daily across global data centers.
Airflow in Action: Powering Investigative Journalism at the FT with Orchestration and AI
How the Financial Times uses Apache Airflow to orchestrate AI pipelines, structure messy public data, and power investigative journalism at scale.
Airflow in Action: Orchestrating AI At Duolingo To Unlock 99% Lower Costs, 10x User Growth
Discover how Duolingo uses Airflow to orchestrate AI content pipelines, automate critical workflows, cut costs, and scale learning to millions.
Airflow in Action: Inside Deutsche Bank’s Regulated Data Workflows
Learn how Deutsche Bank runs Apache Airflow in a highly regulated environment to orchestrate audited, hybrid banking workflows at scale.
Airflow in Action: Inside GitHub’s Data Platform. Open Source to Copilot
How GitHub uses Airflow for open source insights, customer success and continuous Copilot improvements plus nine years of lessons from its data platform.
Airflow in Action: The Unified Orchestration Platform Behind OpenAI
How OpenAI scaled Apache Airflow into a unified orchestration platform, boosted reliability, and replaced legacy schedulers across the business.
Airflow in Action: Modernizing Legacy Data Systems for AI and Analytics With Procter & Gamble
Discover how Procter & Gamble uses Apache Airflow to modernize data systems, power AI, and streamline legacy workflows at global scale.
Airflow in Action: How Vibrant Planet Accelerates Climate Resilience With Geospatial Analytics and ML
Vibrant Planet optimizes Airflow pipelines for wildfire prevention, using ML and dynamic memory scaling to process massive geospatial datasets
Airflow in Action: Scaling Climate Intelligence with Zero-Downtime on HPC Clusters at Meteosim
Integrating Slurm and Airflow, Meteosim runs over 6,000 pipelines daily with zero failures. Read the post to learn how they did it.
Airflow in Action: Customizing LLMs at Laurel. Speeds Rollout and Saves $500k / Year in Inference Through GenAI Ops
How Laurel uses Airflow to scale GenAI, automate timekeeping, and cut LLM costs by $500K per year. Learn how DAGs power model retraining and inference.
Airflow in Action: Insights From Scaling Multiple Workloads Across A Shared Environment at Rakuten Kobo
Discover Rakuten Kobo’s strategies for scaling Airflow usage across teams, fostering collaboration with guardrails, alerts, and shared environments.
Airflow in Action: Making dbt on Airflow Easy with Astronomer Cosmos. Insights from BAM
BAM simplifies complex data pipelines with dbt on Airflow using Cosmos, enabling teams to scale transformations with ease and transparency.
Airflow in Action: 33% Faster Deploys with 90% Higher Data Quality. Astronomer at Autodesk
Discover Autodesk’s secure UAT environment for PII testing, achieving faster deployments and reduced technical debt, powered by Airflow and Astronomer.
Airflow in Action: 5.5K Pipelines, 200 Models, 10% of the World’s Web Sites. MLOps Insights From Wix
Wix runs 5,500 Airflow pipelines daily, powering ML workflows for the company that hosts 10% of the web. Explore their innovative MLOps platform.
Airflow in Action: Deploying AI Clusters to 100 Data Centers in 3 Months. Infrastructure Insights from Cloudflare
Learn how Airflow powers Cloudflare’s infrastructure automation, from server diagnostics to GPU inference clusters in 100+ data centers
Airflow in Action: Data Engineering Insights from Circle, Managing $10s of Billions Across Multiple Blockchains
Learn how Circle manages stablecoins across multiple blockchains with Airflow, tackling MWAA challenges and exploring Astronomer for speed & scale
Airflow in Action: $160BN in Assets, 4,000 Data Pipelines. Financial Workflow Insights from Robinhood
Learn how Robinhood scaled mission-critical financial workflows with Airflow, from trading to clearing, migration strategies, and future plans.
Airflow in Action: Orchestration Insights from 2,200 Pipelines at Instacart
Discover how Instacart scaled Apache Airflow to handle 2,200 pipelines and 16 million tasks monthly with custom tools, IaC, and centralized management.
Airflow in Action: ML and Data Engineering Insights from the Analytics-Obsessed World of MLB
Explore how the Texas Rangers and Philadelphia Phillies use Airflow to revolutionize data orchestration and ML, driving faster insights and a competitive edge.
Airflow in Action: How Panasonic Energy is Accelerating the EV Transition With Data Engineering
Learn how Panasonic leverages Apache Airflow to streamline battery production, scale workflows, and plan for streaming and Kubernetes.
Airflow in Action: ML and LLM Ops Insights from ASAPP — Reducing Workflow Runtimes by 85%
Discover how ASAPP turbocharges MLOps with Airflow and Spark, scaling LLM workflows to boost efficiency & achieve lightning-fast processing in hours vs days.
Airflow in Action: Infrastructure Management Insights from 1 Million Monthly Deploys at LinkedIn
Discover how LinkedIn uses Airflow to orchestrate 12k pipelines managing 1m deploys for 7k services. And Airflow 3 will make provisioning even easier!
Airflow in Action: Data Engineering Insights from Processing PBs of Data Every Day at Stripe
Learn how Stripe processes petabytes of data daily with Apache Airflow, ensuring compliance while accelerating developer workflows with its dev/test tooling
Airflow in Action: Scaling Insights from Bosch and 1.2 Million Pipeline Runs Per Day
Go on an Airflow journey with Bosch as they scale from 1k to 50k DAG runs per hour and 1.2 million pipeline runs per day with an average 1 second latency.
Airflow in Action: Data Engineering Insights from Burns & McDonnell
Discover how Burns & McDonnell scaled data delivery from ad-hoc workflows to a unified platform using Apache Airflow, providing reliable data in under 24 hours.
Airflow in Action: Data Engineering Insights from Uber and Its 200,000 Data Pipelines
Discover how Uber streamlined data workflows with Apache Airflow, scaling to support 1,000 teams, 450,000 daily pipeline runs, and plans for Airflow 3
