- A Cloud Guru
Working with BigQuery in Google Cloud Shell
Cloud BigQuery boasts extremely fast processing—terabytes of information in seconds, petabytes in minutes—while remaining straightforward to query via standard SQL. Best of all, BigQuery is accessible through a number of methods, including web console and API. In this hands-on lab, you’ll use another pathway (Google Cloud Shell) to perform a series of BigQuery operations, including creating a dataset, defining a table and its schema, importing data into that table and, finally, running a series of SQL queries on the BigQuery platform.
Table of Contents
Activate Cloud Shell
- Click the Activate Cloud Shell icon at the top of the console page.
Retrieve the Data Files
- In the Cloud Shell, run the following command: gsutil cp gs://acg-gcp-labs-resources/essentials/MetObjects_BQ_Lab.csv .
Create a BigQuery Dataset
- Create a BigQuery dataset with the following command: bq mk metobjects
- List the current datasets with the following command: bq ls
Load the Data
- Import the data into the dataset with the following command: bq load --source_format=CSV --skip_leading_rows=1 metobjects.linkedObjects MetObjects_BQ_Lab.csv title:STRING,artist:STRING,year:INTEGER,link:STRING
- View the dataset with the following commands: bq ls metobjects bq show metobjects.linkedObjects
Query the Dataset
- Execute a SQL query with the following command:
bq query "SELECT year,title,artist FROM metobjects.linkedObjects WHERE year > 2000 ORDER BY year DESC LIMIT 15"
- Execute a second SQL query:
bq query "SELECT title,link FROM metobjects.linkedObjects WHERE year > 2000 ORDER BY year DESC LIMIT 15"
- Test the available links.
What's a lab?
Hands-on Labs are real environments created by industry experts to help you learn. These environments help you gain knowledge and experience, practice without compromising your system, test without risk, destroy without fear, and let you learn from your mistakes. Hands-on Labs: practice your skills before delivering in the real world.