This “Live with Astronomer” session covers the Astro SDK, an open-source, revolutionary data transfer system that empowers Data Engineers, Data Scientists, and Business Analysts to create Airflow DAGs with code that prioritizes data movement over system configuration.
Topics covered in this session include:
- How to use the Astro SDK in your Airflow environment.
- How to use the
@load_filedecorator to load data from supported file systems without system-specific code. - How to use the
@dataframeand@transformdecorators to easily load your data and run Python or SQL transformations without boilerplate Airflow code. - How the
dag.test()function can help you test your Astro SDK code. - How the Astro SDK can be used in unit testing.
All code shown in this session can be found in this repo. Learn more about the Astro SDK in the official repo, and with this step-by-step tutorial.
