Using Airflow with Multiple AWS Accounts

Summary

In AWS, it’s common for organizations to use multiple AWS accounts for various reasons, from Dev, Stage, Prod accounts to accounts being dedicated to LOBs. What do you do when your Data Pipeline needs to span AWS accounts? This webinar will show how you can run a single DAG across multiple AWS accounts in a secure manner.

In this webinar we covered:

• Authoring DAGs that leverage AWS services
• Airflow Connections
• IAM roles vs Access Keys
• Connecting to multiple AWS accounts in a single DAG