Data pipelines and processes transform raw data into meaningful insights for organizations that can drive future business direction. This course explores how to monitor the pipelines and the processes within to ensure accurate and timely insights.
Organizations need to get business insights from multiple, disparate sources and it is important that the pipelines and processes that enable this insight are healthy. In this course, Monitoring Microsoft Azure Data Pipelines and Processing, you will learn foundational knowledge of the core structure of data pipeline services and how to monitor them. First, you will examine the foundation of data pipelines and processes. Next, you will discover how to monitor Azure Data Factory as a control flow solution. Finally, you will explore how to monitor the HDInsight and Databricks data flow solution. When you’re finished with this course, you will have the skills and knowledge of monitoring data pipelines and processes needed to ensure the health and accuracy of generated business insights.
John Savill is an 11-time MVP, and he holds many Microsoft certifications
including Azure Infrastructure and Azure Architecture specialist. John is
the author of the popular FAQ for Windows and a senior contributing editor
to Windows IT Pro. John has written eight books on Microsoft technologies
including Mastering Microsoft Azure Infrastructure Services and Mastering
Windows Server 2016 Hyper-V.
Course Overview (Music) Hi everyone. My name is John Savill, and welcome to my course, Monitoring Microsoft Azure Data Pipelines and Processing. I'm a principal technical architect at the Dallas Microsoft Technology Center. Data pipelines and processing take raw data and enable real, meaningful insights that are usable by the business. In this course, we're going to look at the monitoring options related to the various data pipeline and processing services that are available in Azure. By the end of this course, you'll know the capabilities available in Azure that can be used to provide that monitoring and that insight into your Azure-based data pipeline and processing solutions. I hope you'll join me on this journey to learn all about the monitoring for data pipeline services in Azure, with the Monitoring Microsoft Azure Data Pipelines and Processing course, at Pluralsight.