Deploying Data Pipelines in Microsoft Azure

by Marcelo Pastorino

In this course, you will learn foundational knowledge needed to apply CI/CD methodologies to your pipeline creation process in Azure Data Factory to deploy robust and well-tested data pipelines to production.

What you'll learn

Data engineers working with Azure Data Factory can take advantage of Continuous Integration and Continuous Delivery practices to deploy robust and well-tested data pipelines to production.

In this course, Deploying Data Pipelines in Microsoft Azure, you will learn foundational knowledge to apply CI/CD methodologies to your data pipeline creation process.

First, you will learn to create the right environments to fall into the pit of success when creating data pipelines in ADF.

Next, you will discover how to deploy data pipelines using ADF visual tools and ARM templates.

Finally, you will explore how to create a release pipeline in Azure DevOps to automate the deployment process between three distinct environments: development, staging, and production.

When you are finished with this course, you will have the skills and knowledge to apply CI/CD practices to your data pipeline creation process, effortlessly.

Table of contents

Course Overview
2mins

About the author

Marcelo has 18 years professional experience solving business problems by architecting solutions and developing software for the web, cloud, and mobile using C#, .NET Framework and .NET Core, Azure, Xamarin, JavaScript and modern front-end frameworks among other technologies. He is a passionate and pragmatic developer who sold his first piece of software at age 16. A fan of clean code and best practices, Marcelo started coding for fun in the early 90's in an old IBM 8086 XT. Since then Marcelo... more

Ready to upskill? Get started