Featured resource
2025 Tech Upskilling Playbook
Tech Upskilling Playbook

Build future-ready tech teams and hit key business milestones with seven proven plays from industry leaders.

Check it out
  • Course
    • Libraries: If you want this course, consider one of these libraries.
    • Cloud
    • Data

Working with Azure Databricks Programmatically

To carry out large-scale operations on Databricks, you'll need to develop apps or scripts which can interact with this big data service. This course looks into the Databricks CLI, its REST API, and the dbutils library to automate such interactions.

Kishan Iyer - Pluralsight course - Working with Azure Databricks Programmatically
Kishan Iyer
What you'll learn

While nearly every task in Databricks can be accomplished from its Web UI, to perform operations of any complexity at scale, you need to interact with this service from a script or an application. In this course, Working with Azure Databricks Programmatically, you'll learn about the Databricks command-line interface (CLI). First, you'll explore how we can create and use a personal access token for authentication, and how to construct CLI commands to perform a variety of workspace operations. Then, you'll explore the use of the Databricks REST API. Finally, you'll discover the versatility of the dbutils library in order to interact with the Databricks file system from a Python application. Once you complete this course, you'll have a clear understanding of how interactions with a Databricks service can be automated using the Databricks CLI, the REST API, and the dbutils package.

Table of contents

About the author
Kishan Iyer - Pluralsight course - Working with Azure Databricks Programmatically
Kishan Iyer

An engineer at heart, I am drawn to any interesting technical topic. Big Data, ML and Cloud are presently my topics of interest.

Get access now

Sign up to get immediate access to this course plus thousands more you can watch anytime, anywhere.

Get started with Pluralsight