Data Quality Use Cases with Airflow and Great Expectations

Summary

At this webinar, Benji Lampel (Enterprise Platform Architect @ Astronomer) and Tal Gluck (Software Engineer @ Superconductive) will present several Airflow DAGs using Great Expectations that cover more advanced DAG patterns and data quality checking cases.

Key Takeaways

• Data Quality comes from the needs of the organization. Learn why data engineers need to be guardians of data and liaisons for quality
• Data Quality checking in the real world is messy. We will showcase methods to cope with that messiness
• There’s a strong, documented story of using Airflow and Great Expectations together. This makes it a premier way to add data quality checks into your organization’s data ecosystem.