Iterative Data Quality in Airflow DAGs

WATCH ON DEMAND

Summary:

Data quality is an often overlooked component of data pipelines. Learn why it is a valuable part of data systems and how to get started integrating data quality checks into existing pipelines with a variety of tools.

Key Takeaways

  • Learn how to make a case for data quality in your org
  • Familiarize yourself with modern data quality tooling
  • Understand trade-offs of scheduling data quality tasks

Missed the Webinar? Sign up for the recap.

Hosted By

Viraj Parekh

Viraj Parekh

Field CTO

Benji Lampel

Benji Lampel

Enterprise Platform Architect

Benjamin (Benji) Lampel is currently an Enterprise Platform Architect at Astronomer, focusing on how to leverage data quality use-cases with Airflow. He graduated from UC Santa Barbara with a BS and MS in Computer Science, and has worked as a data engineer and principal engineer. In his spare time, he enjoys biking, reading, and going to concerts. Benji currently resides in Brooklyn, NY.