Implementing Data Quality Checks in Airflow

Watch Video On Demand

Hosted By

  • Kenten Danas
  • Benji Lampel

Please note: The webinar stream ended prematurely — about 40 minutes into the webinar, during the Q&A session — due to a technical error. We apologize for the inconvenience.

In this webinar, we discuss the benefits of the Common SQL provider package, a consistent, easy-to-use, and versatile set of operators for implementing data quality checks in your pipelines. In particular, we focus on the SQLColumnCheckOperator and SQLTableCheckOperator, both part of the provider package, and how they can work with OpenLinage.

The webinar shows you how to effectively use SQL for data quality checks, and answers questions like:

All of the sample code shown in this webinar can be found in this repo.

Ready to Get Started?

Get Started Free

Try Astro free for 14 days and power your next big data project.