SQL on Hadoop - Analyzing Big Data with Hive

By Ahmad Alkilani
This course will teach you the Hive query language and how to apply it to solve common Big Data problems. This includes an introduction to distributed computing, Hadoop, and MapReduce fundamentals and the latest features released with Hive 0.11
Get started
Course info
Rating
(571)
Level
Intermediate
Updated
Oct 8, 2013
Duration
4h 16m
Table of contents
Introduction to Hadoop
Introduction 2m Motivation for Hadoop 1m Distributed Computing Challenges 3m Hadoop File System (HDFS) 2m MapReduce 4m Word Count Example 1m Demo: Basic Hadoop Commands and Environment Setup 10m Summary 1m
Introduction to Hive
Introduction 1m Hive Motivation 2m Hive Architecture 2m Hive Principles - Schema on Read 1m Hive Principles - The Hive Warehouse 2m Hive Query Language Basics - SELECT and Sub Queries 4m Creating Databases and Tables with HiveQL 8m Demo: Working with Hive Tables and Loading Data into Warehouse 12m Loading Data - Hive Managed and External Tables 2m Demo: External Tables and Create Table Alternatives 10m Summary 1m
Hive Query Language
Introduction 1m Data Types 8m Type Conversions 1m Managed Partitioned Tables 7m External Partitioned Tables 4m Demo: Table Partitioning 19m Multi Inserts and Dynamic Partition Inserts 14m Demo: Loading Data Use Case 6m Data Retrieval - Group By and Functions 13m Sorting and Controlling Data Flow 8m The CLI and Variable Substitution 7m Summary 1m
Advanced HiveQL
Introduction 1m Bucketing 4m Bucket and Block Sampling 4m Joins 4m Joins in Depth and Join Optimizations 6m Map-side Joins for Bucketed Tables 2m Distributed Cache 3m UDTFs, Explode and Lateral View 6m Demo: Extending Hive - Creating Your own UDF 7m Demo: Extending Hive - Compiling and Testing Custom UDF 5m Extending Hive - Custom UDF Recap 3m Demo: Hive Initialization File 1m Accessing The Distributed Cache 1m Hadoop Streaming and Transform() 5m Windowing and Analytics Functions 3m Demo: Putting it All Together Using Transform 13m Demo: Analytics Functions 4m Demo: Ranking Functions 5m Summary 1m
Storage and The Eco-System
Create Table Statement - File Formats and SerDes 7m HCatalog 2m Sqoop 4m DistCP 1m Hadoop Eco-System Projects 2m References and Resources 2m Summary 1m
Description
Course info
Rating
(571)
Level
Intermediate
Updated
Oct 8, 2013
Duration
4h 16m
Your 10-day individual free trial includes:

Expert-led courses

Keep up with the pace of change with thousands of expert-led, in-depth courses.
Start a 10-day free trial
Description

From developer to analyst, this Hive SQL course tackles a few big questions about big data:

  • Why does this technology exist and why do I need it?
  • How can I get the best out of it utilizing something familiar like SQL?
  • How does this all fit together in an ever-evolving eco-system?
This course will introduce the concepts of distributed computing, Hadoop and MapReduce and then goes into great detail into Apache Hive which is an SQL-like query language that can be used with Hadoop and NoSQL databases like HBase and Cassandra.

The course presents some challenges you might experience solving real production problems and how Apache Hive makes that task easier to accomplish.

Course FAQ
Course FAQ
What is Hadoop?

Hadoop is a software framework for storing and processing large sets of data across clusters of hardware. It has large storage for all kinds of data, incredible processing power, and it can handle a seemingly infinite amount of tasks at the same time.

What is the difference between Hive and SQL?

Hive is a data warehouse software project built on top of Hadoop which provides data query and analysis. SQL is a programming language for working with large sets of data in relational databases. While they both query and program big data, Hive handles complicated data more effectively than SQL.

What will I learn in this course?

This course will introduce you to Hadoop and the Hive query language. Some of the topics covered include:

  • The concepts of distributed computing
  • What is MapReduce
  • Creating databases and tables with HiveQL
  • Multi inserts and dynamic partition inserts
  • Bucket and block sampling
  • Storage and the ecosystem
  • Much more
Who is this course for?

This course is great for anyone who wants to learn Hadoop, Hive, and the Hive query language (HiveQL). If you want to be able to solve common Big Data problems, then this is perfect for you.

Are there prerequisites to this course?

This is an intermediate level course, so it does assume some prior knowledge of working with Big Data and query languages like SQL. However, no prior knowledge of Hadoop or Hive is expected.

About the author
Ahmad Alkilani
About the author

Ahmad is a Data Architect specializing in the implementation of high-performance data warehouses and BI systems and enjoys speaking at various user groups and conferences.

More from the author
Applying the Lambda Architecture with Spark, Kafka, and Cassandra
Beginner
6h 4m
Nov 15, 2016
Data Science & Hadoop Workflows at Scale With Scalding
Beginner
2h 8m
Dec 4, 2014
Optimizing OLTP and Data Warehousing with SQL Server 2014
Intermediate
2h 19m
Jan 15, 2014

You're the smartest person in the room

PROVE IT

Your team won't just close the skills gap

THEY'LL HURDLE IT

Course info
Rating
(571)
Level
Intermediate
Updated
Oct 8, 2013
Duration
4h 16m
Pluralsight IQ
Know exactly where everyone on your team stands with assessments and analytics.
Try our full library including this course free for your whole team for 14-days.