Table of Contents

1. Challenge

   Set Up the Azure Environment

   1. Create an Azure Data Lake Gen2 account.
   2. Create a container called taxidata in the Data Lake account.
   3. Upload the TaxiRides.csv file to the container.

      Note: Make sure you have downloaded the TaxiRides.csv file that is located in this GitHub repository.

   4. Create an Azure Data Factory instance.
2. Challenge

   Set Up a New Repository in GitHub

   1. Log in to an existing GitHub account, or create a new GitHub account if necessary. The link to the GitHub site is available in the Additional Information and Resources section.
   2. Create a new public repository.
3. Challenge

   Configure GitHub in Azure Data Factory

   1. Authenticate to GitHub from Data Factory, and configure the repository.
   2. Define collaboration and publish branches.
   3. Select the collaboration branch as the working branch.
4. Challenge

   Save Changes to Collaboration Branch

   1. Create a pipeline with Copy activity. Do not fill all the properties so that the pipeline remains invalid.
   2. Save the pipeline with invalid changes, and verify them in the collaboration branch of the GitHub repository.
   3. Complete the pipeline by copying a file from one data lake folder to another. Create a linked service to the data lake and two datasets (one for the source file and the other for the sink file).
   4. Save the pipeline with valid changes, and verify them in the collaboration branch of the GitHub repository.
5. Challenge

   Publish the Changes to Publish Branch

   1. Publish the pipeline with valid changes.
   2. Verify that an ARM (Azure Resource Manager) template has been generated and stored in the publish branch.