WEBINAR

Power your LLMOps with Airflow’s Weaviate Provider

Recorded On October 5, 2023

  • Michael Gregory
  • Kenten Danas

Weaviate is the leading open-source vector database and offers a rich set of features, extreme scalability, and reliability for processing high-dimensional data and vector embeddings. At the core of every Large Language Model (LLM) application is a vector store and many enterprise organizations rely on Weaviate.

Apache Airflow® has the world’s most active open-source community and is the leading workflow and data orchestration framework. Together, these two enable enterprises to build LLMOps pipelines with speed, scale, and efficiency. 

In this webinar, we show how to use the new Weaviate provider to make the most of Airflow’s orchestration power for AI and ML use cases. The demo code shown in the webinar can be found in this repo. You can also view the code behind Ask Astro, an open-source LLM application that is powered by Airflow and Weaviate (among other tools), here.

See More Resources

Intro to Airflow

Intro: Getting Started with Airflow

Data Transformations with the Astro Python SDK

Airflow 2.0 Providers

Try Astro for Free for 14 Days

Sign up with your business email and get up to $500 in free credits.

Get Started

Build, run, & observe your data workflows. All in one place.

Build, run, & observe
your data workflows.
All in one place.

Try Astro today and get up to $500 in free credits during your 14-day trial.