Building Production Geospatial Pipelines with Airflow and Wherobots

Summary: Join Astronomer and Wherobots for an interactive, hands-on workshop designed to take you from raw data to a dynamic geospatial visualization. In this 90-minute session, you will learn how to orchestrate scalable spatial data pipelines using Apache Airflow and WherobotsDB.

What You Will Build: Every participant will build the same robust pipeline: ingesting data from multiple sources, performing spatial transformations (including spatial joins on buildings and neighborhoods) using Wherobots, and outputting the results to a visualization.

Key Takeaways:

• Modern Orchestration: Learn to use @dag, @task, and the Astro IDE to build DAGs.
• Geospatial Power: Discover how to connect Airflow to Wherobots and utilize the Wherobots Airflow package
• Advanced Airflow Features: Implement Asset-based scheduling, Dynamic Task Mapping, and “Human in the loop” tasks for data validation and retries, callbacks, and more.
• Geospatial Processing: Use cloud hosted spatial data to produce key insights on a recurring basis with large scale joins using weather, buildings, and areas of interest with data from NOAA and Overture Maps

Format:

• Workshop (Tuesday): 90-minute demo and hands-on workshop.
• Office Hours (Thursday): Open Office Hours for Q&A and troubleshooting.

Requirements:

• Wherobots account (trial key will be provided during the workshop)
• Astronomer account
• Workshop is a follow along format for learners of all skill levels

Certification: Participants who submit their completed pipeline by the following Monday will receive an official certificate of completion.