Path icon Learning Paths
Skills Expanded

Apache Spark for Data Scientists

  • Number of Courses11 courses
  • Duration5 hours

Apache Spark is a powerful, open-source framework that enables data scientists to efficiently process, analyze, and transform large-scale data. This learning path equips you with the essential skills necessary to perform data science tasks using Apache Spark. In this path, you'll learn everything from Spark fundamentals, DataFrames, and SQL to advanced data transformations, machine learning, and structured streaming.

Courses in this path

Apache Spark for Data Scientists

Start watching the courses below to get started.

Apache Spark Architecture and Fundamentals

  • by Saravanan Dhandapani
  • 24m 25s Duration

Work with RDDs, DataFrames, and Datasets in Apache Spark

  • by Raphael Alampay
  • 17m 41s Duration

Transform Data Using PySpark

  • by Pinal Dave
  • 43m 35s Duration
  • 4.6  (10)

Transform Data Using Spark SQL

  • by Anand Saravanan
  • 14m 22s Duration

Transform Data Using the Pandas API in Apache Spark

  • by Bismark Adomako
  • 12m 10s Duration

Structured Streaming in Apache Spark

  • by Janani Ravi
  • 59m 17s Duration

Window and Join Operations in Apache Spark

  • by Pinal Dave
  • 18m 15s Duration

Performance Optimization in Apache Spark

  • by Pinal Dave
  • 39m 32s Duration

Machine Learning with Apache Spark

  • by Avdhesh Gaur
  • 25m 28s Duration

Monitor Apache Spark Clusters

  • by Harsh Karna
  • 23m 35s Duration

Graph Operations in Apache Spark Using GraphFrames

  • by Janani Ravi
  • 25m 57s Duration

Learn with the best

Saravanan Dhandapani
Saravanan Dhandapani
I have worked in IT design, development, and architecture for over a decade for some of the top fortune 100 companies. I have designed and architected enterprise applications and developed scalable and portable software. I am a Google Certified Professional Architect. Critical areas where I have worked are architecture and design using Java, ESB, Tomcat, ReactJS, JavaScript, Linux, Oracle, SVN, GIT, and so on, and cloud technologies, including AWS and GCP.
Raphael Alampay
Raphael Alampay
Raphael Alampay is the co-founder of Cloudband Solutions Co., a software development and consultancy company that caters to custom based software for SME around the globe. Using time and tested technology such as Java, Ruby on Rails, Python, PostgreSQL and Linux, he has a passion for creating applications that solve real world problems making businesses more efficient and innovative at the same time. His craft in software is largely based on the philosophy of "kaizen" which means continuous impr... more
Pinal Dave
Pinal Dave
Pinal Dave is an SQL Server Performance Tuning Expert and independent consultant with over 24 years of hands-on experience. He holds a Master of Science degree and numerous database certifications. Pinal has authored 14 SQL Server database books, 91 Pluralsight courses and 11 Code Labs. To freely share his knowledge and help others build their expertise, Pinal has also written more than 5,800 database tech articles on his blog at https://blog.sqlauthority.com.
Anand Saravanan
Anand Saravanan
Anand is a software engineer and is enthusiastic about AI and its multidisciplinary applications. He has always had a passion for technology and how it can be used to help people and businesses. Excellence in various programming languages such as C++, Java, R, Python, SQL, Hadoop, etc., he is a man who has an itch to constantly learn and share his knowledge. He has worked with Fortune 500 companies in various sectors to help them effectively use the data at hand to help make better business dec... more
Bismark Adomako
Bismark Adomako
Bismark believes that education is no longer a one-time investment, but instead a lifelong pursuit and that great authors and mentors can play an invaluable role in finding and developing a fulfilling career. He holds a Bachelor of Science degree in Computer Engineering specializing in Software Engineering, Artificial Intelligence and Distributed computing. He taught courses in robotics and computer vision as a student leader whiles in school, and interned and consulted for the British Counci... more
Janani Ravi
Janani Ravi
Janani has a Masters degree from Stanford and worked for 7+ years at Google. She was one of the original engineers on Google Docs and holds 4 patents for its real-time collaborative editing framework. After spending years working in tech in the Bay Area, New York, and Singapore at companies such as Microsoft, Google, and Flipkart, Janani finally decided to combine her love for technology with her passion for teaching. She is now the co-founder of Loonycorn, a content studio focused on providing ... more
Avdhesh Gaur
Avdhesh Gaur
Avdhesh Gaur is a Senior Data Scientist, an instructor, an author, a storyteller and consultant as well when it comes to bringing insights out of data and presenting the story behind. His career spans more than 10 years with a focus on taking down various business requirements by building Data-driven BI models using Tableau, SQL, Hive, and numerous Statistical data analysis Techniques. ​ Avdhesh Gaur got one of his submissions to Tableau accepted on 7th January 2019. On average, only 1 out of ev... more
Harsh Karna
Harsh Karna
Harsh is a skilled software engineer with over 4 years of experience in Data Engineering and Software Development. He has strong expertise in big data technologies like Hadoop, Spark, and SQL, along with cloud platforms like AWS and Azure, where he has built robust ETL and data frameworks on platforms like Snowflake and Databricks. Proficient in programming languages such as Python, SQL, and Java, Harsh also has experience in Django and Flask frameworks. His work includes designing and implement... more

Join our learners and upskill
in leading technologies