In this session Live with Astronomer will dive into the new Core SQL provider package and show you how to use the SQLColumnCheckOperator. We’ll demonstrate how you can easily use this operator to implement data quality checks in your DAGs, ensuring that errant data never makes it to production.
See also our tutorial on Run data quality checks using SQL check operators for code examples using the SQLColumnCheckOperator.
Live with Astronomer is a biweekly series of short, real-time online sessions for data pipeline authors, hosted by Astronomer’s resident Airflow experts. Topics range from Airflow feature highlights to DAG authoring how-tos to interviews with the developers of Airflow, and every session includes an audience Q&A. It’s all designed to make sure you get the most out of your Airflow experience.