NEW WEBINAR: 4 Things To Consider When Deciding How to Run Airflow|Register Today →
globe
Webinars

How to Orchestrate Machine Learning Workflows with Airflow

When: March 28, 2023 at 2pm EST

Save Your Spot Today

By proceeding you agree to our Privacy Policy , our Website Terms and to receive emails from Astronomer.

Summary

Although often regarded as a data engineering tool, Airflow is also wildly popular among machine learning (ML) teams. In this webinar on machine learning orchestration with Apache Airflow, we’ll provide an overview of machine learning orchestration, its importance in managing ML workflows, and how it fits in with MLOps. We’ll delve into how Airflow can be used for machine learning orchestration and MLOps, including orchestrating tasks such as data ingestion, data processing, model training, model deployment and ongoing model monitoring.

Specifically, we’ll discuss:

  • The operators available for Airflow that can be used for machine learning orchestration.
  • Best practices for setting up and managing an Airflow environment for ML workflows, including DAG design, infrastructure management, CI/CD integration, and version control.
  • How to optimize Airflow performance for ML use cases and avoid common pitfalls.

By the end of this webinar, you’ll have a comprehensive understanding of machine learning orchestration with Airflow and how it can help streamline your ML workflows and MLOps environments.

Hosted By

  • Jeff Fletcher Jeff Fletcher Director of Field Engineering EMEA
    Astronomer
  • Kenten Danas Kenten Danas Lead Developer Advocate
    Astronomer