Airflow at Salesforce: Building a fully managed workflow orchestration system
Watch Video On Demand
We are excited to be joined by the team from Salesforce for a webinar where they will discuss how they built a fully managed workflow orchestration system using Apache Airflow to facilitate dependable data lake infrastructure on the public cloud.
They will cover:
- How Salesforce utilized Kubernetes for increased scalability and resilience, and the most effective approaches for managing and scaling data pipelines.
- How they addressed data security and privacy, multitenancy, and interoperability with other internal systems.
- How they use this system to empower users with the ability to effortlessly build reliable pipelines that incorporate failure detection, alerting, and monitoring for deep insights, removing the undifferentiated heavy lifting associated with running and managing their own orchestration engines.
- How they integrated their in-house CI/CD pipelines to enable effective DAG and dependency management, further enhancing the system’s capabilities.