Light Mode

Exploring
Apache Airflow® 3 London

May 21, 2025 | 10:30am - 4:30pm

Got feedback?

Take the Survey
London

Welcome to the Roadshow!

Wifi: Astronomer
Password: Airflow3

Agenda

11:00am - 11:15am

Opening Remarks

  • Steven Hillion

11:15am - 12:00pm

Unlocking the Future of Orchestration: Introducing Airflow 3

Abstract

Airflow 3 is here, bringing a new era of flexibility, scalability, and security to data orchestration. This release introduces groundbreaking capabilities that make it easier than ever to build, run and manage data pipelines.

In this session, we will cover the key benefits of Airflow 3, including:

  • Ease of Use: Airflow 3 rethinks the user experience—from an intuitive, upgraded UI to DAG Versioning and scheduler-integrated backfills that let teams manage pipelines more effectively than ever before

  • Stronger Security: By decoupling task execution from direct database connections, Airflow 3 enforces task isolation and minimal-privilege access. This meets stringent compliance standards while reducing the risk of unauthorized data exposure.

  • Ultimate Flexibility: Run tasks anywhere, anytime with remote execution and event-driven scheduling. With an architecture that facilitates edge and hybrid-cloud to GPU-based deployments, Airflow 3 is designed for global, heterogeneous modern data environments.

With these innovations, Airflow 3 redefines orchestration, offering more flexibility and control than ever before. Join us to explore how these new capabilities can transform the way you automate and operationalize data workflows!

  • Ash Berlin-Taylor

12:00pm - 1:00pm

Lunch

1:00pm - 2:15pm

Next-Level Orchestration: Exploring Airflow 3 Use Cases

Abstract

Airflow 3 unlocks new possibilities for data orchestration, but what does that mean in practice? The recent State of Apache Airflow survey revealed that while ETL/ELT for reporting / analytics, and business operations use cases are most popular, Airflow is increasingly being used for GenAI and MLOps use cases.

In this session, we’ll dive into how the new features in Airflow 3 drive these use cases forward —enhanced DAG versioning, remote execution, task isolation, event-driven scheduling, GenAI inference execution, and more.

Whether you're looking to scale workflows, improve security, or embrace event-driven scheduling, you’ll leave with fresh ideas and practical takeaways to elevate your orchestration strategy. Join us as we explore what’s possible with Airflow 3!

  • Pete DeJoy
  • Davies Oludare

2:15pm - 2:30pm

Break

2:30pm - 4:30pm

Breakout: Discover Apache Airflow® 3: A Hands-on Workshop

Abstract

Technical experts who are looking to evolve their Airflow capabilities Airflow 3 introduces powerful new capabilities that provide a better user experience, increase security, and expand execution options.

In this hands-on workshop, we’ll teach you how to use some of the most anticipated features. From DAG versioning, to backfills, to data assets, to remote execution, you’ll gain practical insights to optimize your workflows.

Plus, we’ll leave you with tips for going through the upgrade process, ensuring you’ll be able to take advantage of Airflow 3 in production as soon as possible. Whether you’re an Airflow veteran or just getting started, this session will equip you with the knowledge and skills to make the most of the latest release.

  • Andrei Avramescu
  • Bas Harenslak
  • Tatiana Al-Cheuyr Martins
  • Davies Oludare

2:30pm - 4:30pm

Breakout: The Next Evolution: Scaling Data Teams for the Future

2:30pm - 3:00pm

Keynote

3:00pm - 3:30pm

Fireside Chat

3:30pm - 4:30pm

Executive Roundtables

Abstract

Leaders who are looking for strategies to elevate their data team’s impact.

The role of data teams is shifting. No longer just pipeline builders or dashboard creators, today’s data teams must evolve to drive business strategy, enable automation, and scale with growing demands. Best practices seen in the software engineering world (Agile development, CI/CD, and Infrastructure-as-code) from the DevOps movement are gradually making their way into data engineering. We see the rise of DataOps and a new wave of best practices that will transform the discipline of data engineering.

But how do you transform a reactive team into a proactive force for innovation? In this session, we’ll explore the key principles of building a resilient, high-impact data team—from structuring for collaboration, testing, automation, to leveraging modern orchestration tools. Whether you’re leading a team or looking to future-proof your career, you’ll walk away with actionable insights on how to stay ahead in the rapidly changing data landscape.

We will kick this session off with a keynote, followed by a fireside chat with a data leader, then break into interactive roundtable discussions. Explore strategies to elevate your data team's impact, share challenges, and gain fresh insights on building a high-performing, future-ready team.

  • Steven Hillion
  • Carter Page
  • Robert Barton

4:30pm - 5:00pm

Happy Hour + Networking

FAQs

When is the release schedule for Airflow 3.0?
We expect development to conclude by the end of 2024 with beta releases following shortly afterwards. We anticipate Release Candidates to be cut during March 2025, leading to an anticipated GA following soon after. All dates are subject to change.
What are the additional languages that will be supported in Airflow 3.0?
Initially Go, Java, Javascript, and Typescript. Support for additional languages are planned in the future. Language sequence may change based on demand.
Does Airflow 3.0 support DAG authoring in additional languages?
No, DAGs will still be written in Python. Airflow 3 will be multilingual, so that DAGs generated from a DagFactory or a custom DSL, or a DAG natively written in Python can invoke Tasks written in any language By extending task support for other languages, Airflow can integrate with application APIs written in Java, Javascript or Typescript.
How does the new architecture in Airflow 3.0 balance distributed execution with control?
While execution is distributed, you maintain centralized control, reducing the operational complexity that often characterizes distributed systems.

got feedback?

Tell us how we did!

Enjoyed your day at the Astronomer Roadshow? Have ideas or comments? Please fill out this brief survey so we can continuously improve for future events!

Take the Survey