WEBINAR

How to Orchestrate Machine Learning Workflows with Airflow

Recorded On March 28, 2023

  • Jeff Fletcher
  • Kenten Danas

This webinar provides an overview of machine learning orchestration, its importance in managing ML workflows, and how it fits in with MLOps. We cover everything you need to know to use Airflow to streamline your ML workflows and MLOps environments including orchestrating tasks such as data ingestion, data processing, model training, model deployment, and ongoing model monitoring. Questions covered in this session include:

  • What is machine learning orchestration and how can Airflow be used for this purpose?
  • What operators are available for Airflow that can be used for machine learning orchestration?
  • What are some best practices for setting up and managing an Airflow environment for ML workflows?
  • How can I optimize Airflow performance for ML use cases and avoid common pitfalls?

All code covered in this webinar can be found in this repo.

See More Resources

Best practices for managing Airflow across teams

Airflow 101: Essential Tips For Beginners - Dec 2022

A Deep Dive into the Airflow UI

Deliver Data with Precision: Supercharge your Airflows with Apache Airflow® on Astro - An Azure Native ISV Service

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows.
All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.