NEW

Introducing Otto: The only data engineering agent built for Airflow. - Learn more

Resources to Build
AI/ML Products

Get full access to our library of ebooks, case studies,
webinars, blog posts, and more.

ebook

The
GenAI Cookbook

Download Now →

White Paper

Guide to Data Orchestration for Generative AI →

Webinar

Optimize ML/AI Workflows with Essential Airflow Features →

Blog

Revolutionizing Data Orchestration and MLOps with Apache Airflow® and Astronomer at Chiper →

Resources

Cookbook Essential Airflow Recipes to Kickstart Your GenAI Projects Get Guide → White Paper Guide to Data Orchestration for Generative AI Download White Paper → Podcast How Laurel Uses Airflow To Enhance Machine Learning Pipelines Listen Now → Webinar Optimize ML/AI Workflows with Essential Airflow Features Watch Webinar → Webinar Run LLMOps in production with Apache Airflow® Watch Webinar → Podcast The Intersection of AI and Data Management at Dosu Listen Now → Case Study Anastasia Delivers AI-Powered Insights with Astro Read Study → Video How the World’s Best ML Teams Get AI into Production Watch Video → Blog Snowflake Anomaly Detection and Cost Management with Machine Learning and Airflow Read Blog Post → Article Gen AI integration and orchestrating the cloud: A blueprint for success Read Article → Webinar Orchestrate next-generation AI tools: Explore six new Airflow providers Watch Webinar → Learn Guide ML pipelines with the Astro Cloud IDE Read Guide → Webinar Power your LLMOps with Airflow’s Weaviate Provider Watch Webinar → Blog Reliable Data Orchestration for AI Applications at Dosu Read Blog Post → Webinar MLOps, AI, and Airflow at Laurel for Perfect Timekeeping Watch Webinar → Learn Guide Orchestrate Pinecone operations with Apache Airflow® Read Guide → Blog Journey to Enhanced Retrieval Augmented Generation (RAG) with Cohere Rerank Read Blog Post →

Reference Implementations

Explore these open-source reference implementations to find guidance or inspiration for deploying your own AI/ML applications.

Ask Astro A chatbot application powered by LLM, used to answer questions about Apache Airflow® and Astronomer. View Source Code → SnowPatrol An MLOps application on Airflow designed to detect anomalies and manage Snowflake costs. View Source Code → MLOps Reference Architectures Explore MLOps reference architectures, from classification to anomaly detection. See Architectures →

Registry

Certified DAG

Use OpenAI LLMs to Embed and Visualize Results

This DAG shows how to use the OpenAI Airflow provider to interact with the OpenAI API.

Apache Airflow® Airflow Community

Certified DAG

Generate Vectors with the Airflow Weaviate Provider

This DAG runs a simple MLOps pipeline to import data, generate vectors, and query the vectors.

Apache Airflow® Airflow Community

Certified DAG

Query Vectors with Pinecone and Airflow

This DAG uses the Pinecone Airflow Provider to import data, generate vectors, then query based on user-provided inputs.

Apache Airflow® Airflow Community

Certified DAG

Train Models with Amazon Sagemaker and Airflow

This DAG shows a training pipeline using the feature engineering, training, and model registry features of Amazon Sagemaker.

Apache Airflow® Airflow Community

Certified DAG

Track Model Training with MLflow and Airflow

This DAG shows how to track training of a RidgeCV model with the MLflow Airflow provider.

Apache Airflow® Airflow Community

Certified DAG

Use Cohere and OpenSearch to Analyze Customer Feedback

This DAG creates vector embeddings and performs a sentiment analysis of customer feedback with Cohere and OpenSearch.

Apache Airflow® Airflow Community