WEBINAR

Airflow at Salesforce: Building a fully managed workflow orchestration system

Recorded On October 19, 2023

  • Raj Ramalingam
  • Varun Srinivas
  • Kenten Danas

We are excited to be joined by the team from Salesforce for a webinar where they will discuss how they built a fully managed workflow orchestration system using Apache Airflow® to facilitate dependable data lake infrastructure on the public cloud.

They will cover:

  • How Salesforce utilized Kubernetes for increased scalability and resilience, and the most effective approaches for managing and scaling data pipelines. 
  • How they addressed data security and privacy, multitenancy, and interoperability with other internal systems.
  • How they use this system to empower users with the ability to effortlessly build reliable pipelines that incorporate failure detection, alerting, and monitoring for deep insights, removing the undifferentiated heavy lifting associated with running and managing their own orchestration engines.
  • How they integrated their in-house CI/CD pipelines to enable effective DAG and dependency management, further enhancing the system’s capabilities.

See More Resources

Best practices for Upgrading to Airflow 3

Secrets Management in Airflow 2.0 - March 2021

The Astro Python SDK

Q2 2024 Astro Release: Seamlessly Integrate dbt with Astro

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.