- Course
- Cloud
- Data
Orchestrating and Automating AWS Data Pipelines
Manual triggers and fragile coordination cause outages. This course will teach you to orchestrate and automate AWS data pipelines with Amazon EventBridge, AWS Step Functions, and Amazon MWAA.
What you'll learn
Pipelines scheduled by cron alone miss real events, duplicate work, and fail silently. In this course, Orchestrating and Automating AWS Data Pipelines, you’ll gain the ability to coordinate and automate multi‑stage workflows on Amazon Web Services. First, you’ll explore when to prefer time‑based scheduling versus event‑driven orchestration. Next, you’ll discover how to design AWS Step Functions workflows for linear and parallel execution with robust retries. Finally, you’ll learn how to route and filter events with Amazon EventBridge and when to incorporate Amazon MWAA or external orchestrators. When you’re finished with this course, you’ll have the skills and knowledge of AWS‑native orchestration needed to build reliable, event-aware pipelines.
Table of contents
About the author
Rupesh is an independent consultant with over 12 years of experience in software development. As a software architect Rupesh creates web applications for the various domains industries using JavaScript, Node, Angular, Typescript, C#, and .Net.