Skip to main content

Home

BigQuery details page

From the BigQuery details page, you can get the processing details of all the queries running in your BigQuery jobs. Moreover, you can also identify the utilization of resources based on each stage and the performance of a query.

Menu bar

When you open a BigQuery details page, the following details are displayed in the upper section of the page:

bigquery-menu-bar-4770.png

Item No

Description

1

Name of the BigQuery. Click the download.png Download icon to download the job metrics as a JSON file. The JSON file includes all the details shown on the BigQuery details page in a raw format.

2

An email ID of the owner or the service account of the owner who has run the job.

3

Name of the project where the job is run.

4

Type of the queue.

  • Interactive: For Interactive queues, the query jobs are run immediately after the query is executed. This is the default queue.

  • Batch: For Batch queues, the query jobs are run in batches during a scheduled time.

Note

Click the copy-icon.png Copy icon to copy the name, owner, project name, and queue name of the BigQuery for debugging.

KPIs
KPIs-4770.png

Option

Description

Status

Displays the status (Success, Failed, or Running) of the job.

Duration

Total time of the job run.

Type

Displays the type of job run in BigQuery. For example, the following job types are displayed:

  • QUERY: Runs queries as interactive or batch query jobs

  • LOAD: Loads the data into BigQuery tables from Excel sheets and other data sources

  • COPY: Copies the data from one data set to another data set or copies the data between different projects

  • EXTRACT: Exports the data from Google Cloud Platform to the outside environment

Note

Based on the job type, the available KPIs are displayed.

Data I/O

Total data read and written by the job.

Start Time

Start time of the job.

End Time

End time of the job.

Query Output Row Count

Total number of rows that the BigQuery job has provided as an output.

Slot MS

Total time of the job run in the virtual CPU.

Billed Bytes

A number of bytes (data) on which BigQuery is charging the amount. BigQuery provides the initial 1GB of data free of cost.

Processed Bytes

The number of bytes the job has processed.

Cost in USD

The cost associated with the query. The cost is displayed in Cents. The cost is computed based on the BigQuery pricing for the billed bytes related to on-demand pricing.

Database

Name of the database where the job runs.

App Summary

The following tabs are displayed in the App Summary section:

AppSummary.png

Tab name

Description

Analysis

Query

Displays the query that was run.

Tables

Lists the names of the tables that were involved in the query run. The tables are categorized into Input and Output columns.

After you click the table name, the Data page is displayed (if the table information is recorded on the Data page). The No data present message is displayed if the table information is not recorded on the Data page.

Error View

Lists the errors for the failed queries.

From the Error View tab, you can do the following:

  • Search for a specific error

  • Download error messages into a CSV file. You can send the file to the appropriate team for debugging.

Tags

Lists tags associated with BigQuery. For example, department, person name, location, and so on.

For more information, see Tagging.Tagging

Child Jobs

Lists child jobs of the selected parent job. Displays the date and timestamp when the child job is executed. Click the job ID link to return to the child App Summary page.

Stages

A query is executed in a series of stages. The details of each stage are shown on the BigQuery details page.

Multiple stages are executed parallel to increase time and efficiency when a query runs. For example, INPUT, SORT, and JOIN. For example, a JOIN stage that generates far more output rows than input rows can indicate an opportunity to filter earlier in the query. These stages improve data distribution throughout query workers.

stages-4770.png

To view the details of all the stages, click the expander-arrows.png expander arrows on the left panel of the BigQuery details page. In the Stages section, you can perform the following actions:

  • View timeline details along with the name and status of the stage. The timeline details include Start Time, Duration, and Slot MS.

  • Search for a specific stage.

  • Download stages into a CSV file.

After you click each stage, the selected stage summary is displayed in the right section.

Click the Close icon to return to the App Summary page.

  • Stage Summary: Lists KPIs of each stage, such as Status, Duration, Start Time, Shuffle Output Bytes, Shuffle Output Bytes Spilled, Slot MS, Input Rows, and Output Rows. You can also view metric details of a specific stage.

  • Error View: Lists errors of each failed stage.

  • Metrics: Lists all the metrics involved in running the job, their values, and corresponding definitions.

For information about query stages and their metrics, see Google BigQuery documentation.