Expanded Library

Connecting to SQL Server from Databricks

by Kishan Iyer

This course covers the steps involved in setting up a SQL Server instance and a Databricks workspace in the same virtual network, and querying the database from a notebook.

What you'll learn

Databricks is a versatile and powerful data platform which can help us perform a lot of processing, analysis and machine learning tasks. But it often needs to source its data from external storage systems, such as relational databases. In this course, Connecting to SQL Server from Databricks, you'll learn how the data in a SQL Server database can be accessed from a Databricks workspace. First, you'll explore provisioning a Databricks workspace in a custom virtual network. Next, you'll discover a number of connection rules to ensure that Databricks and SQL server can communicate with each other, and also enable connections to the database from a local SQL client. Finally, you'll learn how to query a table in the SQL Server database from a notebook in our Databricks workspace. Once you complete this course, you will become aware of the infrastructure set-up needed to ensure that two popular data platforms - Databricks and SQL Server - are able to communicate with one another, and can implement such a link in your own environment.

About the author

I have a Masters in Computer Science from Columbia University and have worked previously as a developer and DevOps engineer. I now work at Loonycorn which is a studio for high-quality video content. My interests lie in the broad categories of Big Data, ML and Cloud.

Ready to upskill? Get started