Simple play icon Course
Skills

Create and Monitor Data Pipelines for a Stream Processing Solution

by Ana Voicu

This course will teach you how to create, configure, monitor, and troubleshoot Azure Stream Analytics jobs to process live streaming data.

What you'll learn

Azure gives you all of the resources you need to create and monitor data pipelines and find the data processing solutions you need. In this course, Create and Monitor Data Pipelines for a Stream Processing Solution, you'll learn how to work with stream processing pipelines in Azure in order to create, configure, monitor, and troubleshoot Azure Stream Analytics jobs. First, you'll discover the components of a stream analytics job and why each of them are important. Next, you'll explore how to handle the data coming from the pipeline (insert and update), how to visualize the data in different time windows, and how to troubleshoot such a job. Finally, you'll learn how to improve the performance of your job, by choosing the number of streaming units, parallelizing the query, and using repartitioning to scale your query. By the end of this course, you'll have a better understanding of what it means to create and monitor real-time data processing solutions in Azure.

About the author

Ana Voicu is a software developer passionate about databases, Business Intelligence, and data science. She works on developing enterprise level Business Intelligence solutions for various types of industries, with a focus on performance optimization, pattern recognition, efficient analysis of the business processes, and interactive visualizations. What Ana loves most is overcoming challenges related to database performance, mostly related to data warehouse solutions. Ana discovered a while ago t... more

Ready to upskill? Get started