Missed the Webinar? Watch Now.
Do you use Sensors in your data pipelines? Do you need to wait for a file before executing the next step? Are you looking to execute your task after a task completes in another DAG? Would you like to wait for an import in your SQL table before executing the next task?
The answer? Airflow Sensors!
Sensors are pretty basic in their usage. You wait for a condition to be true. It’s as simple as that.
But… That’s not all!
Not only are there some arguments which allow you to make your sensors more reliable, but there are also a large number of sensors covering a wide range of use cases.
By the end of this webinar, from basic to advanced, Sensors won’t hold any more secrets for you.
A few key takeaways:
- Configure your Sensors to avoid freezing your Airflow instance
- Dive into the ExternalTaskSensor
- Smart Sensors, what are they? Should you use them?
Head of Customer Training