Expanded Library

Delta Lake with Azure Databricks: Deep Dive

by Mohit Batra

In this course, you'll learn about Delta Lake using Azure Databricks and its ecosystem – Delta Lake Storage, Delta Engine, Delta Architecture, Delta Live Tables, etc. – and how it provides warehouse-like features that you can use to build a Lakehouse.

What you'll learn

Delta Lake is an open-source storage layer that brings reliability to Data Lakes, by providing data warehouse-like features, on top of Data Lake.

It has a big ecosystem, and there are various tools and architectures based on that - Delta Lake Storage, Delta Engine, Delta Architecture, Delta Live Tables, Delta Sharing, etc. It can also handle Batch and Streaming data seamlessly. And these components and features can you help build an optimized, and well-integrated Lakehouse architecture.

In this course, Delta Lake with Azure Databricks: Deep Dive, you’ll learn how Delta Lake and various components in its ecosystem, allows us to build a Lakehouse architecture. And to do that, we will be using Azure Databricks.

First, you’ll learn what Delta Lake is, and how it works. You’ll also see the different components in its ecosystem. Then, you’ll discover how to work with Delta Lake storage and its various features. Next, you’ll see how to handle streaming data on Delta Lake. After, you’ll explore Delta Engine in Databricks to optimize storage and queries. Followed by this, you’ll see how to build a Lakehouse architecture. And you’ll also see how to build reliable ETL pipelines with Delta Live Tables. Finally, you’ll end with some common use cases, and how to implement them. By the end of this course, you’ll have the knowledge and skills to work with Delta Lake and use its ecosystem components to build an optimized, well-integrated Lakehouse solution.

Table of contents

Course Overview

About the author

Mohit is a Data Engineer, a Microsoft Certified Trainer (MCT) and a consultant. Mohit has 15+ years of extensive experience in architecting large scale Business Intelligence, Data Warehousing and Big Data solutions with companies like Microsoft and some leading investment banks. As an expert in his field, Mohit has often shared his knowledge in Azure, Spark, SQL Server and Power BI at various public forums and as a corporate trainer. Mohit truly loves to teach and enjoys producing high-quality,... more

Ready to upskill? Get started