Best practices for writing ETL and ELT pipelines
Hosted By
In this webinar, we’ll cover DAG writing best practices applicable to ETL and ELT pipelines, including things like how to approach building ETL and ELT pipelines from scratch.
Astronomer Webinars
Join us for upcoming online events!
DAG Writing Best Practices
Whether you’re writing traditional ELT/ETL pipelines or complex ML workflows, you’ll learn how to make Airflow work best for your use case.
Introduction to Observability for Data Pipelines
In this webinar, we’ll give an overview of data observability for Airflow, including topics like tracking data lineage, detecting anomalies, monitoring data quality, and insights into the performance of your data operations.
Watch Recorded Webinars On-Demand
Implementing data quality checks with the Astro SDK
In this webinar, we’ll give an overview of the Astro SDK and how it can be used to create ELT pipelines with integrated data quality checks in Python or SQL. We’ll cover everything you need to get started using this open source tool to ensure errant data never ends up in production.
How Astro makes Airflow upgrades easy and painless
In this webinar, we’ll cover everything you need to know about managing Airflow versions with Astro Runtime.
What’s New in Airflow 2.6
In this webinar, we’ll cover all the great 2.6 updates that make Airflow even more flexible and production-ready
Simplified DAG authoring with the Astro SDK
In this “Live with Astronomer” session, we’ll give an overview of the Astro SDK and show how it makes writing ELT pipelines easy and efficient. We’ll cover everything you need to get started using this open source tool in just a few minutes.
The easiest way to orchestrate your dbt workflows from Airflow
In this webinar, we’ll cover the new, open-source Astronomer Cosmos tool, a framework for dynamically generating Airflow DAGs from your dbt models that massively simplifies the Airflow-dbt integration.
How to use DuckDB with Airflow
In this “Live with Astronomer” session, we’ll dive into the best ways to use DuckDB with Airflow.
How to pass data between your Airflow tasks
In this webinar, we’ll cover the implementation and nuances of different methods for passing data between your Airflow tasks.
How to test and debug your Airflow connections
We’ll dive into the easiest ways to test and debug your Airflow connections. We’ll show how the new `dag.test()` function allows you to test connections without even running Airflow, how new Airflow UI features make testing connections faster, and how to solve common issues that arise when working with connections.
4 Things To Consider When Deciding How to Run Airflow
Teams can run Airflow themselves, go with a managed infrastructure option like MWAA and GCC, or choose Astro. Whether you’ve been running Airflow in production for years or if you’re just thinking about the right Airflow strategy is for your team, we’ll go through all the options available.
