This document applies only to Astro Hybrid. To see whether you’re an Astro Hybrid user, click Organization Settings. Your Astro product type is listed under Product Type on the General page.
To create a cluster on Astro Hosted, see Create a dedicated cluster.
To install Astro Hybrid on Azure, Astronomer will create an Astro cluster in a dedicated Azure account that’s hosted and owned by your organization. This ensures that all data remains within your network and allows your organization to manage infrastructure billing.
To complete the installation, you’ll:
Astronomer support will create infrastructure within your Azure account to host the resources and Apache Airflow components necessary to deploy dags and execute tasks. If you need more than one Astro cluster, contact Astronomer support.
A new Azure subscription. For security reasons, Azure subscriptions with existing infrastructure aren’t supported. Also, no Azure policy should be applicable to the subscription’s Azure management group.
A Microsoft Entra ID user with the following role assignments:
Application Administrator. See Understand roles in Microsoft Entra ID.
Owner with permission to create and manage subscription resources of all types. See Azure built-in roles.
This Microsoft Entra ID user is required for data plane activation. You can remove the user or modify their role assignments after the cluster is created.
A CIDR block with a range of /19. If you don’t have any preferred CIDR block, Astro will provision a VPC using a default of 172.20.0.0/19. Astro uses this VPC for four subnets, one each for database, pods, nodes, and private endpoints. See Azure resource reference for details.
A minimum quota of 48 Standard Ddv5-series vCPUs in the selected region. You can use Dv5-series vCPUs, but you’ll need 96 total vCPUs composed of 48 Ddv5-series vCPUs and 48 Dv5-series vCPUs. To adjust your quota limits up or down, see Increase VM-family vCPU quotas.
Confirm that the VM types are available in all Availability Zones in the selected region. For example, you can run the following Azure Az PowerShell command to confirm that the Standard_D4d_v5 VMs (the default for Astro) are available in the CentralUS region:
If the VM types are unavailable, the output returns Restrictions. Contact Microsoft Support to have these VMs enabled.
A subscription to the Astro status page. This ensures that you’re alerted when an incident occurs or when scheduled maintenance is planned.
The following domains added to your organization’s allowlist for any user and CI/CD environments:
https://cloud.astronomer.io/https://api.astronomer.io/https://images.astronomer.cloud/https://auth.astronomer.io/https://updates.astronomer.io/https://install.astronomer.io/https://<your-org>.astronomer.run/https://astro-<your-org>.datakin.com/To give Astro access to any Azure resources on a private network, you must create a VNet peering connection between Astronomer’s VNet and the VNets for your broader network.
To create a VNet peering connection, contact Astronomer Support and provide the following details:
/19 range. This CIDR block can’t overlap with any Azure VNet(s) that you will peer with later. The default CIDR range is 172.20.0.0/19./subscriptions/<Subscription Id>/resourceGroups/myResourceGroupA/providers/Microsoft.Network/virtualNetworks/myVnetA. You can find the resource ID in the Azure portal by following step 7 in Create peering - Azure portal.Additionally, ensure that your Microsoft Entra ID user has at least one of the following role assignments:
From here, Astronomer support will set up the VNet connection to Astro.
Go to https://cloud.astronomer.io/ and create an account, or enter your email address, and then click Continue.
Select one of the following options to access the Astro UI:
If you’re the first person in an Organization to authenticate, you’re added as a Workspace Owner to a new Workspace named after your Organization. You can add other team members to the Workspace without the assistance of Astronomer support. See Manage Workspace users.
To integrate an identity provider (IdP) with Astro, see Set up an identity provider.
The data plane is a collection of Astro infrastructure components that run in your cloud and are managed by Astronomer. This includes a central database, storage for Airflow tasks logs, and the resources required for task execution.
Run the following command to log in to your Azure account:
Run the following command to select your Azure subscription:
Run the following command to add the Astronomer Service Principal to Microsoft Entra ID:
Run the following commands to get details about the Azure subscription and create a new role assignment for the Astronomer service principal:
Run the following commands to register the EncryptionAtHost feature:
After you’ve prepared your environment for data plane activation, provide Astronomer support with the following information:
centralus.172.20.0.0/19.See Azure resource reference for all supported cluster configurations.
After you provide Astronomer support with the setup information for your cluster, Astronomer support creates the cluster on Azure. Wait for confirmation from Astronomer support that the cluster has been created before creating a Deployment.
When Astronomer support confirms that your Astro cluster has been created, you can confirm it in the Astro UI by clicking on the Astronomer icon in the top left corner, click Organization Settings, then click Clusters to see your cluster. You can then create a Deployment and start to develop and deploy your dags.