globe
Webinars

Data Lineage with OpenLineage and Airflow

Watch On Demand

Missed the Webinar? Watch Now.

By proceeding you agree to our Privacy Policy , our Website Terms and to receive emails from Astronomer.

Summary

If one out of your hundreds of DAGs fails, how do you know which downstream datasets have become out-of-date? The answer is data lineage. Data lineage is the complex set of relationships between your jobs and datasets. In this webinar, you’ll learn how to use OpenLineage to collect lineage metadata from Airflow and assemble a lineage graph - a picture of your pipeline worth way more than a thousand words.

Key Takeaways

  • The Purpose and Use of Data Lineage
  • OpenLineage Core Concepts
  • Using OpenLineage with Airflow

Hosted By

  • Willy Lulciuc Willy Lulciuc Senior Software Engineer
    Astronomer
  • Viraj Parekh Viraj Parekh Field CTO
    Astronomer