Summary: Join Astronomer and Wherobots for an interactive, hands-on workshop designed to take you from raw data to a dynamic geospatial visualization. In this 90-minute session, you will learn how to orchestrate scalable spatial data pipelines using Apache Airflow and WherobotsDB.
What You Will Build: Every participant will build the same robust pipeline: ingesting data from multiple sources, performing spatial transformations (including spatial joins on buildings and neighborhoods) using Wherobots, and outputting the results to a visualization.
Key Takeaways:
- Modern Orchestration: Learn to use @dag, @task, and the Astro IDE to build DAGs.
- Geospatial Power: Discover how to connect Airflow to Wherobots and utilize the Wherobots Airflow package
- Advanced Airflow Features: Implement Asset-based scheduling, Dynamic Task Mapping, and “Human in the loop” tasks for data validation and retries, callbacks, and more.
- Geospatial Processing: Use cloud hosted spatial data to produce key insights on a recurring basis with large scale joins using weather, buildings, and areas of interest with data from NOAA and Overture Maps
Format:
- Workshop (Tuesday): 90-minute demo and hands-on workshop.
- Office Hours (Thursday): Open Office Hours for Q&A and troubleshooting.
Requirements:
- Wherobots account (trial key will be provided during the workshop)
- Astronomer account
- Workshop is a follow along format for learners of all skill levels
Certification: Participants who submit their completed pipeline by the following Monday will receive an official certificate of completion.
