How to Orchestrate Databricks Jobs Using Airflow

July 25, 2024 at 11am PT / 2pm ET

Hosted By

  • Kenten Danas
  • Tamara Fingerlin

Save Your Spot Today

By proceeding you agree to our Privacy Policy,
our Website Terms and to receive emails from Astronomer.

Using Airflow with Databricks is common in the data ecosystem. Many data teams leverage Databricks to run heavy workloads like training machine learning models, data transformations, and data analysis. Using Airflow as a tool-agnostic orchestrator in combination with Databricks provides several advantages, such as easy integration with other tools in your data stack, and managing your pipelines as code.

Airflow’s open-source functionality makes it easy to orchestrate Databricks Jobs, allowing you to take advantage of Databricks’ Job clusters while maintaining full visibility from Airflow.

In this webinar, you’ll learn how to:

Ready to Get Started?

See how your team can fuel its data workflows with more power and less complexity than ever before.

Start Free Trial →

Which plan works best for your team?

Learn about pricing →

What can Astronomer do for your organization?

Talk to an expert →