WEBINAR

Simplified DAG authoring with the Astro SDK

Recorded On May 2, 2023

  • Daniel Imberman
  • Kenten Danas

This “Live with Astronomer” session covers the Astro SDK, an open-source, revolutionary data transfer system that empowers Data Engineers, Data Scientists, and Business Analysts to create Airflow DAGs with code that prioritizes data movement over system configuration.

Topics covered in this session include:

  • How to use the Astro SDK in your Airflow environment.
  • How to use the @load_file decorator to load data from supported file systems without system-specific code.
  • How to use the @dataframe and @transform decorators to easily load your data and run Python or SQL transformations without boilerplate Airflow code.
  • How the dag.test() function can help you test your Astro SDK code.
  • How the Astro SDK can be used in unit testing.

All code shown in this session can be found in this repo. Learn more about the Astro SDK in the official repo, and with this step-by-step tutorial.

See More Resources

Data Driven Scheduling

Learn from the experts: how to write data pipelines with Airflow

The SQL Table Check Operator

The SQL Column Check Operator

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.