Developing Spark Applications with Python & Cloudera

Apache Spark is one of the fastest and most efficient general engines for large-scale data processing. In this course, you will learn how to develop Spark applications for your Big Data using Python and a stable Hadoop distribution, Cloudera CDH.
Course info
Rating
(35)
Level
Beginner
Updated
Feb 27, 2018
Duration
5h 41m
Table of contents
Course Overview
Why Spark with Python and Cloudera?
Getting an Environment & Data: CDH + StackOverflow
Refreshing Your Knowledge: Python Fundamentals for This Course
Understanding Spark: An Overview
Getting Technical with Spark
Learning the Core of Spark: RDDs
Going Deeper into Spark Core
Increasing Proficiency with Spark: DataFrames & Spark SQL
Continuing the Journey on DataFrames and Spark SQL
Understanding a Typed API: Datasets Works with Scala, Not Python
Final Takeaway and Continuing the Journey with Spark
Description
Course info
Rating
(35)
Level
Beginner
Updated
Feb 27, 2018
Duration
5h 41m
Description

At the core of working with large-scale datasets is a thorough knowledge of Big Data platforms like Apache Spark and Hadoop. In this course, Developing Spark Applications with Python & Cloudera, you’ll learn how to process data at scales you previously thought were out of your reach. First, you’ll learn all the technical details of how Spark works. Next, you’ll explore the RDD API, the original core abstraction of Spark. Finally, you’ll discover how to become more proficient using Spark SQL and DataFrames. When you’re finished with this course, you’ll have a foundational knowledge of Apache Spark with Python and Cloudera that will help you as you move forward to develop large-scale data applications that enable you to work with Big Data in an efficient and performant way.

About the author
About the author

Xavier is very passionate about teaching, helping others understand search and Big Data. He is also an entrepreneur, project manager, technical author, trainer, and holds a few certifications with Cloudera, Microsoft, and the Scrum Alliance, along with being a Microsoft MVP.

More from the author
Getting Started with JSON in C# Using Json.NET
Intermediate
3h 47m
Aug 5, 2020
Computer Vision: Executive Briefing
Beginner
29m
Apr 1, 2020
More courses by Xavier Morera