EBOOK

Quick Notes: Airflow + dbt with Cosmos

Orchestrating dbt projects with Airflow

When you pair dbt with Apache Airflow® and Cosmos, you can run dbt projects as part of your Airflow dags. This allows you to take advantage of Airflow’s features, like retries and backfills, while scaling your dbt projects and gaining full visibility into their dependencies within your data ecosystem.

These quick notes cover how to quickly get started with orchestrating dbt projects with Airflow and the most important configuration options to improve performance. You’ll learn how to:

  • Set up Cosmos and Airflow
  • Convert a dbt project into an Airflow dag with Dbtdag and DbtTaskGroup
  • Authenticate Cosmos to Snowflake, Databricks, and BigQuery
  • Increase Cosmos parsing and execution speed, and choose the right execution mode

Get Your Copy Today