Astronomer + dbt
Simplify dbt workflows with Astro.
Eliminate fragmented workflows and black-box limitations. Astro delivers unified dbt orchestration with observable pipelines across your entire data stack.
Unified platform. Maximum value.
Astro’s orchestration-first approach eliminates tool fragmentation, delivering complete visibility, and operational efficiency.
Complete observability and control
Gain full visibility into your dbt workflows. Cosmos integrates dbt model execution, dependencies, and status within the Airflow UI.
Efficient retries
Each model, seed, and test appears as its own Airflow task. Only failed or impacted transformations are rerun for faster recovery.
Take a two minute guided tour of Astro + Cosmos
See how to connect your dbt project, configure credentials, deploy with `astro dbt deploy`, and monitor model-level execution and efficient retries.
Seamless integration & independent deployments
Orchestrate dbt, ingestion, ML, and analytics in unified pipelines. Deploy dbt code independently with `astro dbt deploy` for rapid, flexible CI/CD and multi-repo workflows.
Future-proof flexibility
Choose dbt Core or Fusion with Cosmos, author on dbt notebooks while staying flexible and compatible across Astro, MWAA, Cloud Composer, and self-hosted Airflow—never locked in.
Organizations from every industry transform their data operations with Cosmos.
insurance
“Since adopting Astro with Cosmos, we’ve rescued countless failed dbt jobs and still met our SLAs. That wasn’t possible before. The ability to see our dbt jobs at a more atomic level using Cosmos is game changing for us.”
Josh Bickmeyer
Manager, Analytics Engineering
online dating
“Having set up dbt-core on Airflow before, I had to create a lot of internal jobs to achieve what this project does out of the box. With Cosmos and the open source community, it's been great to see best practices in place and how forward-thinking the project is. dbt artifacts automatically spitting out open-lineage datasets to feed into data-aware scheduling? Nice! It's been great and I know it will get better.”
Adam Underwood
Senior Data Engineer
Financial technology
“After testing Mage.ai, dbt Cloud, GitHub Actions, and Cosmos, our team unanimously chose Cosmos. The integration, visibility, and simplicity won us over.”
Jensen Yap
Senior Data Engineer
responsive acquisition marketing
“Cosmos significantly accelerated our Airflow adoption, dynamically creating Airflow tasks while preserving dbt model lineage effortlessly.”
Karen Connelly
Senior Manager, Business Intelligence
Streamlining your dbt orchestration and observability with Astro & Cosmos.
Scale dbt operations
As your dbt projects and teams expand, Cosmos provides granular observability and robust orchestration, ensuring your pipelines remain efficient, scalable, and easy to manage—no matter how fast your business grows.
One platform for Airflow & dbt Core
Automate orchestration and gain instant, model-level observability with Cosmos— no custom scripts required. Faster troubleshooting, reduced engineering overhead, and more resilient data pipelines.
Overcome managed service limitations
Break free from vendor lock-in. Leverage the full power of Airflow and Cosmos, enabling multi-cloud portability and access to advanced orchestration features that drive business agility.
Frequently Asked Questions
Can I use dbt Fusion with Astro?
Yes. Cosmos supports both dbt Core and dbt Fusion, letting you select the ideal engine based on your project’s scale and needs. To use dbt Fusion, simply install the Fusion binary in accordance with its licensing.
Is this compatible with my existing dbt setup?
Absolutely. Cosmos integrates smoothly with existing dbt Core projects, supporting local, Docker, or Kubernetes execution. You can migrate incrementally without disruption.
Is Cosmos priced as an add‑on?
No, Cosmos is open‑source and does not carry an additional price.
What’s the difference between Cosmos and dbt Deploys?
Cosmos delivers task‑level observability within Airflow, while dbt Deploys lets you independently deploy dbt code from your DAGs. Together, they streamline deployment and enhance visibility.
How do you handle dbt licensing changes?
Cosmos’s open‑source model ensures compliance with dbt’s updated licensing requirements, providing flexibility to choose your preferred engine based on your needs.
Learn More About dbt + Airflow
eBook
Orchestrating dbt with Airflow and Cosmos
This eBook, written in two parts, part 1 for both beginners and part 2 for advanced users, offers a practical guide to Cosmos
Code Examples
Apache Airflow® and dbt using Cosmos
Discover 13 full dag code examples of running dbt on Airflow with Cosmos ready to be adapted to your own dbt projects.
Reference
Quick Notes: Airflow + dbt with Cosmos
Quickly get started with dbt projects using Airflow and the most important configuration options to improve performance.
