Monitors in Astro Observe
Public Preview
This feature is in Public Preview.Astro Observe uses monitors to continuously assess the health of your data products and pipelines. When a monitor detects a failure, it can automatically alert your team through your notification channels such as email or Slack. Monitors help you rapidly identify and resolve operational issues in your data workflows.
Data product monitors
Only one Data Product monitor can be created per data product.
The Proactive Failure Monitor monitors a specific data product and sends an alert when any upstream or final dag in the specified data product fails. This enables you to quickly respond to failures, address the root cause, and understand the downstream impact.
When a monitored failure occurs, the alert:
- Provides a direct link to a lineage view, showing the failing DAG and its failing task.
- Identifies all downstream data products impacted by the failure.
Create a data product monitor
Start monitor creation
For a new data product
For an existing data product
You will be automatically prompted to create a Proactive Failure Monitor as the fourth step in the Data Product creation process. Configure the monitor by selecting a severity level and notification channel(s) to receive alerts as described in the following steps.
Name and describe the monitor
- A suggested name is auto-generated, but you can edit it as needed.
- Optionally, add a description to clarify this monitor’s purpose for your team.
Failure detection behavior
- If: Any upstream or final DAG in the data product fails, an alert will be triggered automatically. This failure condition is managed by Observe and will update dynamically if your pipeline changes.
- Then: Select alert severity level: Info, Warning, or Critical.
- And: Choose one or more notification channels to receive the alerts. Supported channels include email, Slack, and custom integrations. For more on configuration, see Alert Notification Channels.
