WEBINAR

How to Improve Data Quality with Airflow's Great Expectations Operator

Recorded On February 28, 2023

  • Benji Lampel
  • Kenten Danas

This webinar provides an overview of how to use the new Great Expectations (GX) operator to implement data quality checks in your Airflow DAGs. We cover new features of the GX operator, including a default Checkpoint feature, which makes Great Expectations more Airflow-centric and simpler to use. Questions covered in this session include:

What improvements have been made to the GX operator in the latest version? How can I implement the GX operator in my Airflow DAGs? How can I scale my data quality checks to large datasets using the GX operator and Airflow? What kinds of data quality checks can I implement with the GX operator?

Learn more about the Great Expectations provider in the public repo. Explore our tutorial on Orchestrating Great Expectations with Airflow. The example code covered in this webinar can be found on the Astronomer Registry.

See More Resources

2024 Apache Airflow®: Trends and Insights

Data Lineage with OpenLineage and Airflow

Best practices for writing ETL and ELT pipelines

Batch Inference with Airflow and SageMaker

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.