The Big Data revolution has exposed the limitations of traditional data processing models like cubes and ETL. Learn a different way of doing things with the Azure Data Lake, using the U-SQL language to query raw data files and create databases.
Building good reporting structures can be difficult, especially when those pesky users keep asking for new reports. Throw Big Data into the mix and things become a lot more complicated. What if you didn’t need to build any data models at all, or you could build models that could be quickly put up and torn down? In this course, Introduction to the Azure Data Lake and U-SQL, you'll be introduced to Azure Data Lake and the U-SQL language, and learn how to abandon ETL. First, you'll delve into querying by using the powerful U-SQL language, built straight into the Azure Data Lake. Next, you'll discover how to throw your files into the Data Lake and query them directly without needing to load them into a database. Finally, you'll learn about how Azure Data Lakes offers the best of both worlds, with support for unstructured files and structured databases. By the end of this course, you’ll not only know what a Data Lake is, you’ll know how to populate it, query it, and develop for it using Visual Studio. Software required: Visual Studio 2017 Community Edition and Azure subscription (optional).
Course Overview Hi everyone, my name is Mike McQuillan and welcome to my course, Introduction to Azure Data Lakes and U-SQL. I'm a data specialist, consulting at various organizations we're all reliant on data these days, lots of data, big data; big data has exposed the inflexibility of traditional data processing solutions, like ETL and cubes, the Azure Data Lake offers an alternative approach which is much faster, very flexible, and fun. In this course we'll learn what Azure Data Lakes are and why they are incredibly useful. No prior experience is required. Some of the major topics we will cover include: the advantages of a data lake against traditional data processing solutions, creating data lake solutions with Visual Studio, creating databases and tables in the cloud, and writing queries with the U-SQL language. By the end of this course you'll know exactly what a data lake is, how to populate it, and how to query it using the U-SQL language. You'll be able to start creating your own really cool data lake solutions. Before beginning the course you should be familiar with general database concepts and some basic knowledge of the SQL language will be helpful. I hope you'll join me on this journey to learn about Azure Data Lakes, with the introduction to Azure Data Lakes and U-SQL course at Pluralsight.