WEBINARS

Secrets Management in Airflow 2.0 - March 2021

Watch Video On Demand

Hosted By

  • Viraj Parekh

Note: For Astronomer customers we also recommend you also check out our docs on how to Configure a secrets backend and the Astronomer Academy module Astro: Secrets Backend.

What are Airflow Secrets?

Secrets are sensitive information that are used as part of your DAG.

Types of Secrets:

To get started check out our webinar below on the best practices for Secrets Management in Airflow 2.0. You can also use these example DAGs from the webinar.

Where are all the Secrets?

Environment Variables

Airflow Metastore DB

secrets-1

secrets-2

secrets-3

secrets-4

Alternative Secrets Backend

Airflow was designed to orchestrate and connect to everything needed for pipelines. So why should your Secrets be any different to Airflow?

GCP Workload Identity & AWS IAM Roles

IAM Integration allows you to connect to cloud resources implicitly with Service Accounts.

secrets-5

So Where Should Secrets Be Kept?

Best Practices

This repo contains an example DAG and configurations that were used in an Astronomer webinar on Secrets Management with Airflow 2.0.

The easiest way to get started with Apache Airflow 2.0 is by using the Astronomer CLI. To make it easy you can get up and running with Airflow by following our Quickstart Guide.

Ready to Get Started?

See how your team can fuel its data workflows with more power and less complexity than ever before.

Start Free Trial →

Which plan works best for your team?

Learn about pricing →

What can Astronomer do for your organization?

Talk to an expert →