- Lab
- Cloud
Developing a Stream Processing Solution with Azure Services
In this hands-on lab scenario, you are a data engineer for Awesome Company. You have been tasked with creating a stream processing solution in Azure that will analyze crowdsourced weather information and provide running averages. Previously, you have provisioned an Azure Data Lake Storage Gen2 account to hold the uploaded files, and now you need to configure the appropriate Azure services to both view and store the average temperatures per country in near-real time. Performing the actions of this hands-on lab will help you become familiar with building a complete stream processing solution using Azure services.
Path Info
Table of Contents
-
Challenge
Simulate Data Uploads
Use Azure Cloud Shell within the Azure portal to run the file creation simulator located on GitHub.
-
Challenge
Process Streaming Data with Azure Stream Analytics
Configure an Azure Stream Analytics job to obtain the average temperatures of each country across a three-minute tumbling window. Have the output stored in an Azure Cosmos DB database.
-
Challenge
Verify the Data
Query the Azure Cosmos DB database to make sure the correct information is being stored.
What's a lab?
Hands-on Labs are real environments created by industry experts to help you learn. These environments help you gain knowledge and experience, practice without compromising your system, test without risk, destroy without fear, and let you learn from your mistakes. Hands-on Labs: practice your skills before delivering in the real world.
Provided environment for hands-on practice
We will provide the credentials and environment necessary for you to practice right within your browser.
Guided walkthrough
Follow along with the author’s guided walkthrough and build something new in your provided environment!
Did you know?
On average, you retain 75% more of your learning if you get time for practice.