- Course
Change Data Capture (CDC) Pipelines with AWS
Learn how to efficiently capture and sync data changes using AWS CDC tools. This course will teach you to build and optimize near-real-time data pipelines with AWS DMS, Redshift, and S3 for scalable, cost-effective analytics and archiving.
Intermediate
- Course
Change Data Capture (CDC) Pipelines with AWS
Learn how to efficiently capture and sync data changes using AWS CDC tools. This course will teach you to build and optimize near-real-time data pipelines with AWS DMS, Redshift, and S3 for scalable, cost-effective analytics and archiving.
Intermediate
Get started today
Access this course and other top-rated tech content with one of our business plans.
Try this course for free
Access this course and other top-rated tech content with one of our individual plans.
This course is included in the libraries shown below:
- Cloud
- Data
What you'll learn
In data, capturing and syncing changes in near real-time keeps pipelines current without costly full refreshes. In this course, Change Data Capture (CDC) Pipelines with AWS, you’ll learn to build and optimize efficient, near-real-time data pipelines using CDC. First, you’ll explore the fundamentals of CDC and why it outperforms full data refresh methods. Next, you’ll discover how to capture and replicate data changes using AWS Database Migration Service (DMS) and integrate these changes with Amazon Redshift and Amazon S3 for analytics and archiving. Finally, you’ll learn how to optimize pipeline performance and ensure data consistency while monitoring and troubleshooting your CDC workflows with AWS CloudWatch and DMS logs. When you’re finished with this course, you’ll have the skills and knowledge of building scalable, efficient CDC pipelines using AWS services needed to maintain up-to-date data lakes and warehouses with minimal latency and operational overhead.
Change Data Capture (CDC) Pipelines with AWS
Intermediate
Table of contents
Noreen Hasan has been a software engineer for over a decade in several industries ranging from startups to financial institutions. Her focus was on iOS mobile development, and in the last years her focus shifted to AWS and cloud computing. Her mantra has always been 'Building to Solve, Building to Empower' because solving problems and empowering others is the main reason she feels fulfilled in this field. When she is not developing technical solutions, she enjoys swimming, Zumba, reading and listening to podcasts.