Featured resource
2026 Tech Forecast
2026 Tech Forecast

1,500+ tech insiders, business leaders, and Pluralsight Authors share their predictions on what’s shifting fastest and how to stay ahead.

Download the forecast
  • Learning Path
  • Libraries: This path is only available in the libraries listed. To access this path, purchase a license for the corresponding library.
  • Data

Data Engineering with Apache Spark on Databricks

1 Course
2 Hours
Skill IQ

This learning path is actively in production. More content will be added to this page as it gets published and becomes available in the library. Planned content includes:

1. Up and Running with Apache Spark on Databricks (video course) 2. Manage Data and Delta Tables with Apache Spark on Databricks (video course) 3. Build Batch Pipelines with Apache Spark on Databricks (video course) 4. Build Streaming Pipelines with Apache Spark on Databricks (video course) 5. Build Declarative Pipelines with Apache Spark on Databricks (video course) 6. Build AI-Powered Pipelines with Apache Spark on Databricks (video course) 7. Run Production Workloads with Apache Spark on Databricks (video course) 8. Optimize Apache Spark on Databricks (video course)

Apache Spark can be used within the Databricks platform to build, manage, and optimize scalable data workloads. In this path, you’ll learn how to work with Delta tables, build batch and streaming pipelines, use declarative pipeline workflows, run production workloads, and improve Spark performance in Databricks. You’ll also explore how modern Databricks capabilities support reliable, governed, and AI-ready data engineering.

Try this learning path for free
Access this learning path and other top-rated tech content with a free trial.
What You'll Learn
  • 1. How to get up and running with Apache Spark on Databricks
  • 2. How to manage data and Delta tables with Apache Spark on Databricks
  • 3. How to build batch pipelines with Apache Spark on Databricks
  • 4. How to build streaming pipelines with Apache Spark on Databricks
  • 5. How to build declarative pipelines with Apache Spark on Databricks
  • 6. How to build AI-powered pipelines with Apache Spark on Databricks
  • 7. How to run production workloads with Apache Spark on Databricks
  • 8. How to optimize Apache Spark on Databricks
Prerequisites
  • Apache Spark can be used within the Databricks platform to build, manage, and optimize scalable data workloads. In this path, you’ll learn how to work with Delta tables, build batch and streaming pipelines, use declarative pipeline workflows, run production workloads, and improve Spark performance in Databricks. You’ll also explore how modern Databricks capabilities support reliable, governed, and AI-ready data engineering.
Related topics
  • Apache Spark
  • PySpark
  • Databricks
  • Data Engineering
  • Data Pipelines
Not sure where to start?
With over 500 assessments to choose from, you can see where your skills stand and receive adaptive learning recommendations to fill knowledge gaps in as little as 10 minutes.

Get started with Pluralsight