Efficient data quality checks with Airflow 2.7

Watch Video On Demand

Hosted By

  • Tamara Fingerlin
  • Kenten Danas

Data quality is key to the health of an organization’s data ecosystem. With in-DAG quality checks, you can halt pipelines before bad data makes its way into production.

Implementing data quality checks efficiently can be challenging, but has recently gotten a lot easier with the addition of automatic setup/teardown tasks in Airflow 2.7. Setup/teardown tasks support the pattern of creating resources to run data quality checks and tearing them down once the checks are completed.

This webinar covers everything you need to know about setup/teardown tasks and how to use them to support your data quality checks, including:

Ready to Get Started?

Get Started Free

Try Astro free for 14 days and power your next big data project.