Create an Azure Blob Storage connection in Airflow

Microsoft generates two shared access keys by default for every storage account. You can use them to give Airflow access to the data in your storage account.

An Azure Blob Storage connection using a shared access key requires the following information:

• Name of the storage account
• Shared access key

Complete the following steps to retrieve these values:

1. In your Azure portal, open your storage account.
2. Copy the name of your storage account.
3. Follow Microsoft documentation to copy the storage account Key.

A connection string for a storage account includes the authorization information required to access data in your storage account.

An Azure blob storage connection using connection string requires the following information:

• Storage account name
• Storage account connection string

Complete the following steps to retrieve these values:

1. In your Azure portal, open your storage account.
2. Copy the name of your storage account.
3. Follow Microsoft documentation to copy the Connection string.

A shared access signature (SAS) token provides granular access for a storage account.

An Azure blob storage connection using SAS token requires the following information:

• Storage account name
• SAS token

Complete the following steps to retrieve these values:

1. In your Azure portal, navigate to your Storage account view and select your subscription.
2. Copy the name of your storage account.
3. Follow the Microsoft documentation to generate your SAS token. Copy the SAS token.

A service principal for an Azure app provides granular access for a storage account.

An Azure Blob Storage connection using a service principal requires the following information:

• Storage account URL
• Application Client ID
• Tenant ID
• Client secret

Complete the following steps to retrieve these values:

1. In your Azure portal, open your storage account.
2. Follow Azure documentation to copy your Blob Service URL. It should be in the format https://mystorageaccount.blob.core.windows.net/.
3. Open your Microsoft Entra ID application. Then, from the Overview tab, copy the Application (client) ID and Directory (tenant) ID.
4. Create a new client secret for your application to be used in the Airflow connection. Copy the VALUE of the client secret that appears.
5. Assign the Storage Blob Data Contributor role to your app so that Airflow can access blob objects in your storage account.

1. Open your Astro project and add the following line to your requirements.txt file:

   apache-airflow-providers-microsoft-azure
   

   This installs the Microsoft Azure provider package, which makes the Azure Blob Storage connection type available in Airflow.

2. Run astro dev restart to restart your local Airflow environment and apply your changes in requirements.txt.

3. In the Airflow UI for your local Airflow environment, go to Admin > Connections. Click + to add a new connection, then choose the Azure Blob Storage connection type.

4. Fill out the following connection fields using the information you retrieved from Get connection details:

   • Connection Id: Enter a name for the connection.
   • Blob Storage Login: Enter your storage account name.
   • Blog Storage Key: Enter your storage account Key.

5. Click Test. After the connection test succeeds, click Save.

   

1. Open your Astro project and add the following line to your requirements.txt file:

   apache-airflow-providers-microsoft-azure
   

   This installs the Microsoft Azure provider package, which makes the Azure Blob Storage connection type available in Airflow.

2. Run astro dev restart to restart your local Airflow environment and apply your changes in requirements.txt.

3. In the Airflow UI for your local Airflow environment, go to Admin > Connections. Click + to add a new connection, then choose the Azure Blob Storage connection type.

4. Fill out the following connection fields using the information you retrieved from Get connection details:

   • Connection Id: Enter a name for the connection.
   • Blob Storage Connection String: Enter your storage account connection string.

5. Click Test. After the connection test succeeds, click Save.

   

1. Open your Astro project and add the following line to your requirements.txt file:

   apache-airflow-providers-microsoft-azure
   

   This installs the Microsoft Azure provider package, which makes the Azure Blob Storage connection type available in Airflow.

2. Run astro dev restart to restart your local Airflow environment and apply your changes in requirements.txt.

3. In the Airflow UI for your local Airflow environment, go to Admin > Connections. Click + to add a new connection, then choose the Azure Blob Storage connection type.

4. Fill out the following connection fields using the information you retrieved from Get connection details:

   • Connection Id: Enter a name for the connection.
   • Blob Storage Login: Enter the name of your storage account.
   • SAS Token: Enter your SAS token.

5. Click Test. After the connection test succeeds, click Save.

   

1. Open your Astro project and add the following line to your requirements.txt file:

   apache-airflow-providers-microsoft-azure
   

   This installs the Microsoft Azure provider package, which makes the Azure Blob Storage connection type available in Airflow.

2. Run astro dev restart to restart your local Airflow environment and apply your changes in requirements.txt.

3. In the Airflow UI for your local Airflow environment, go to Admin > Connections. Click + to add a new connection, then choose the Azure Blob Storage connection type.

4. Fill out the following connection fields using the information you retrieved from Get connection details:

   • Connection Id: Enter a name for the connection.
   • Account Name: Enter Blob Service URL for your storage account.
   • Blob Storage Login: Enter your Application (client) ID.
   • Blob Storage Key: Enter your client secret Value.
   • Tenant Id: Enter your Directory (tenant) ID.

5. Click Test. After the connection test succeeds, click Save.