WEBINAR

Introducing Cosmos: The Easy Way to Run dbt Models in Airflow

Recorded On July 27, 2023

  • Julian LaNeve
  • Kenten Danas

dbt is an open-source library for analytics engineering that is frequently used in combination with Airflow. Using Airflow to orchestrate and execute dbt models as DAGs ensures fine-grained control over dbt tasks, observability over every step, and a reliable, scalable environment to run your models.

This webinar introduces Cosmos, an open source package from Astronomer that is the easiest way to run your dbt Core projects as Airflow DAGs and Task Groups with just a few lines of code. We show you how Cosmos can be used to dynamically generate Airflow DAGs from your dbt models with benefits like avoiding dependency conflicts, using data-aware scheduling, using retries, altering, etc., and more.

All code shown in the webinar can be found in this repo. For more details on implementing Cosmos, see the documentation.

Discover how to streamline your data transformation with dbt on Astro.

See More Resources

Intro to Airflow: Get Started Writing Pipelines for Any Use Case

Optimizing ML/AI Workflows with Essential Airflow Features

Iterative Data Quality in Airflow DAGs

OpenLineage and Airflow: A Deeper Dive

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.