WEBINAR

Airflow at Faire: Democratizing Machine Learning at Scale

Recorded On November 30, 2023

  • Rafay Aleem
  • Victoria Varney
  • Kenten Danas

Data science and machine learning form the core of Faire’s industry-celebrated marketplace (a16z top-ranked marketplace), driving powerful search, navigation, and risk functions. These functions are powered by ML models trained on over 3000 features defined by their data scientists.

Previously, the process of defining, backfilling and maintaining feature lifecycle was error-prone. To address this challenge, Faire’s data team partnered with Astronomer and chose Apache Airflow® on Astro as their tool to democratize their ML feature store framework.

In this webinar, we talked with Faire about how they leverage Airflow and Astro to power their ML training and extend it with a custom framework that powers their feature stores. For a publicly available example highlighting some of the Airflow features described in Faire’s use case, see our example ELT and ML pipeline.

See More Resources

A Deep Dive into the Airflow UI

How to easily test your Airflow DAGs with the new dag.test() function

4 Things To Consider When Deciding How to Run Airflow

Data Engineering Digest and Astronomer | The Ultimate Guide to DAG Writing

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.