Run Airflow on Google Cloud with Astro, the fully managed data orchestration platform.
Designed and operated by the core developers behind Apache Airflow and OpenLineage, Astro brings best practices learned from supporting thousands of Airflow environments into a simple, fully managed platform on Google Cloud. With Astro, you can focus on building and optimizing your data pipelines, not managing Airflow.
Orchestrate every component of your Google Cloud data platform
When you’re just starting with Google Cloud, you may only use a handful of services. But as you scale your usage, the complexity grows. A tension can emerge between empowering data teams and centralizing control. Astro allows you to embrace distributed data services, orchestrating across complex, distributed environments with a single control plane.
Airflow offers more than 450 modules to connect to your favorite Google Cloud data services, including Cloud SQL, Cloud Storage, BigQuery, Dataproc, and more. With asynchronous task support built into Astro Runtime — Astro’s hardened, cloud-native distribution of Airflow — you can orchestrate these services with increased resilience and less overhead – no code changes required.
Access the latest community features
Airflow is improving faster than ever, introducing new features like the REST API, asynchronous tasks, and dynamic task mapping. Astro gives you access to new features the day they’re released to the community. Beyond features, running the latest Airflow version means thousands of bugs have been fixed, before they can break your pipeline.
Spend less time managing Airflow
Astro enables you to be up and running in your cloud or ours in less than an hour. Push-button environments, in-place upgrades, and accelerated bug and security fixes free you from dependency on limited DevOps resources. With optimized configuration and auto-scaling built-in, you can count on your tasks running on time instead of getting stuck in the queue.
Learn how Astro lets you focus on building and optimizing your data pipelines, not managing Airflow.Get Started
Understand complex ecosystems
As your data ecosystem grows, dependencies across distributed services and teams can lead to reduced availability of trusted data. Astro integrates OpenLineage into your orchestration environments, providing powerful visibility into the dependencies between datasets, as well as trends in their performance and quality over time.
Integrate securely and seamlessly
Astro’s hybrid architecture allows you to keep orchestration close to your data, with a single-tenant data plane in the region of your choice. Connect privately to your Google Cloud services with Private Service Connect, or establish a peering connection with your VPC. Astro supports native Cloud IAM role authentication and authorization to your data services, or you can use secrets without giving up control with integrated Google Secrets Manager.
Purchase via Google Cloud Marketplace
Astronomer is an official Google Cloud Partner, and Astro can be purchased through the Google Cloud Marketplace. This approach can help speed up the procurement process and consolidate billing. And when purchased through the Google Cloud Marketplace, Astro even counts toward your committed spend for both your license and infrastructure.