Send Remote Execution Agent task logs to external logging provider
For Remote Execution Deployments, the recommended approach for handling task logs is to use a logging shipper that sends logs to your external logging platform. You can configure your Remote Execution Deployment to display links to the external task logs in the Airflow UI, keeping all data within your environment.
To send logs to external logging providers, you must first configure LoggingSidecar in your Remote Execution Agent.
Configure external logging provider for Remote Execution Deployments
-
In the Astro UI, navigate to your Deployment and click the Details tab. Click Edit in the Advanced section.
-
Select External Logging Provider in the Task Logs field.
-
In the URL Template field, enter a templated URL that references the
log_filename_templatevalue from your Airflow config. This inserts a dynamic link in the Airflow UI, where logs would normally appear, that points to the corresponding task logs in your external logging provider.
For example, a templated URL for task logs in Splunk might look like:
