Azure Data Lake Gen2 From the Command Line

Libraries: If you want this lab, consider one of these libraries.
Cloud
Data

Azure Data Lake Gen2 From the Command Line

Azure Data Lake Gen2 is built on Azure Blob Storage but offers additional features. With Data Lake Gen2, you can store unstructured Blob data hierarchically, providing greater flexibility in how your data is organized. In this lab, you will have the opportunity to work with Azure Data Lake Gen2 storage from a Linux command line. You will retrieve, edit, and upload some Azure Data Lake Gen2 data from within the Bash Azure Cloud Shell.

Get started Contact sales

Lab Info

Level

Intermediate

Last updated

Sep 04, 2025

Duration

30m

Challenge

Download the configuration file.
Log in to the Azure portal. In a separate tab, log in to the Azure cloud shell (bash) at shell.azure.com.

There is an existing storage account and file share that you can use for the bash cloud shell. After selecting Bash for the Azure Cloud Shell, go to the Advanced Settings.
- For Cloud Shell region, select West US.
- For Storage Account, select Use existing, then choose the storage account with the name that begins with cloudshell.
- For File Share, select UJse existing and enter cloudshell.
Authenticate with the Azure Storage service.
```
azcopy login
```
The command will provide a URL and an authentication code. Open the URL and enter the code to authenticate your azcopy cli tool.

Set an environment variable containing the name of the storage account so that you can easily refer to it. You can find the storage account name in Azure Portal. Its name begins with sattconfigs.
```
storage_account=<storage account name>
```
Download the configuration file from Azure Data Lake.
```
azcopy copy "https://${storage_account}.dfs.core.windows.net/configuration/inventory/processor/invprocessor.conf" invprocessor.conf
```
You can verify the file downloaded successfully by viewing the contents. You should see some configuration data.
```
cat invprocessor.conf
```
Challenge

Make the requested changes and upload the edited configuration file.
Edit the configuration file:
```
vi invprocessor.conf
```
Change the numThreads configuration value to 100:
```
...
numTreads=100
...
```
Upload the edited file to Azure Data Lake, replacing the existing file:
```
azcopy copy invprocessor.conf "https://${storage_account}.dfs.core.windows.net/configuration/inventory/processor/invprocessor.conf"
```

About the author

Pluralsight Skills

Pluralsight Skills gives leaders confidence they have the skills needed to execute technology strategy. Technology teams can benchmark expertise across roles, speed up release cycles and build reliable, secure products. By leveraging our expert content, skill assessments and one-of-a-kind analytics, keep up with the pace of change, put the right people on the right projects and boost productivity. It's the most effective path to developing tech skills at scale.

Real skill practice before real-world application

Hands-on Labs are real environments created by industry experts to help you learn. These environments help you gain knowledge and experience, practice without compromising your system, test without risk, destroy without fear, and let you learn from your mistakes. Hands-on Labs: practice your skills before delivering in the real world.

Learn by doing

Engage hands-on with the tools and technologies you’re learning. You pick the skill, we provide the credentials and environment.

Follow your guide

All labs have detailed instructions and objectives, guiding you through the learning process and ensuring you understand every step.

Turn time into mastery

On average, you retain 75% more of your learning if you take time to practice. Hands-on labs set you up for success to make those skills stick.