Play Astro: An Immersive Learning Quest for Building GenAI Pipelines with Apache Airflow and Amazon Bedrock

AWS Open Source Lounge | Ha Salon at the Venetian

Sip and play. As you journey through Astronomer quests and the curated tapestry of narratives, enjoy bites, specialty drinks, giveaways, and prizes throughout. Plus, get all your burning Apache Airflow + Astro questions answered by the Astronomer team. Reserve your spot to play.

About the event

Play Astro is a gamified learning event that challenges participants to use Astronomer solutions to solve real-world technical problems in a risk-free setting. As a new hire at Astro Studios, the world’s largest, fictional sci-fi publication house, you will test your Apache Airflow knowledge in an interactive, risk-free environment.

Play Astro offers participants a dynamic sandbox to harness the potential of Apache Airflow 3, by building GenAI pipelines using the latest features. Explore, experiment, and push the boundaries of what’s possible with Astronomer.

For this workshop, you will use a free trial of Astro to run Airflow and the Astro IDE to write Dags. It is not necessary to understand all details of the Astro platform, but in a nutshell: Astro allows you to create hosted, fully managed Airflow Deployments that make running Airflow in production easy, while providing additional functionality for writing data pipelines with the Astro IDE.

Learning objectives - Players will walk away with:

Firsthand experience with new Airflow 3 features like event-driven scheduling, human-in-the-loop, and Dag versioning
Unlocking the power of Astronomer’s new Astro IDE

This event is hosted by Astronomer. Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Trusted by more than 800 of the world’s leading enterprises, Astronomer enables businesses to do more with their data.

The Mission

Astro Studios is seeing a decline in readership of their daily newsletter service. They need to speak to their audiences in a new way.

They kicked off a personalized daily newsletter service by taking into account the user’s location, and the reader’s favorite sci-fi character. This is used with the LLM through Amazon Bedrock to write content in the voice/style of the sci-fi character they chose.

Your task is to set up event-driven pipelines in Airflow that will give the newsletter service on-demand capabilities.

Join us through the below quests.

Exercise 1: Explore the new Airflow 3 UI
Exercise 2: Use Assets
Exercise 3: Add a human-in-the-loop
Exercise 4: Run a Backfill
Exercise 5: Use DAG versioning
Exercise 6: Run a GenAI Dag with event-driven scheduling

Follow these setup instructions to come prepared to dive in.

Agenda

4:20pm: Doors open
4:30pm: Welcome + Introduction to Play Astro
4:40pm: Quests begin + Power trivia games
6:15pm: Wrap up begins