Skip to main content

Home

Data Overview

The Overview tab provides a quick view of the tables' and partitions' sizes, usage, and KPIs with corresponding graphs. You can choose the metastore in a specific cluster for the bigquery metastore. Optionally, you can also configure the metastore type that should be available for selection on the Data page. The following sections are included in this tab:

Note

Ensure that the required configurations are set to get data to the Data page. Refer to Data page configurations. Data Page

View table KPIs and trends
  1. On the Unravel UI, go to the Data > Overview tab.

  2. From the Metastore Type drop-down, select bigquery.

  3. From the Project Id drop-down, select a project ID.

    The KPIs listed in the following table are shown for both the last day and the last 90 days in a trend.

    KPI

    Description

    Number of Tables Created

    The number of tables created for that time period.

    Size of Tables Created

    The size of all the tables created for that time period.

    Total Number of Tables

    The total number of tables in the system for that time period.

    Number of Tables Accessed

    The number of tables that are accessed for that time period.

    Number of Queries

    The total number of queries that accessed the tables within the system for that time period.

    Number of Users

    The number of users who have accessed the tables for that time period.

Define heat label for tables

You can define the following color-coded heat label for the tables:

  • Hot (hot.png)

  • Warm (warm.png)

  • Cold (cold.png)

  • Unknown (unknown.png (Shows the uncategorized tables)

The temperatures are defined based on the following parameters:

  • Age: the period since the table was created.

  • Last App Access: The last time the table was accessed by an application.

To define a heat label for the table, do the following

  1. Go to Data > Overview > Table state section.

  2. Click column-setting.png. The Label Tables dialog is displayed.

    datapage-heat-label.png
  3. Move the color-slider to set the period for the tables to be defined under a specific color-coded heat label.

  4. Click Save Rules. The corresponding donut chart displays the proportion of tables that are in the defined Hot (hot.png), Warm (warm.png), and Cold (cold.png) states.

    bigquery-data-page-heat-labels.png

    These states of a table are classified based on the following logic:

    A table is marked as unknown.pngUnknown when either Age or Last App Access is unknown.

    When both the metrics are known, then the following logic is applied:

    • A table is Hot (hot.png) when at least one of the metrics (Age or Last App Access) is hot.

    • A table is Warm (warm.png) when both metrics (Age and Last App Access) are warm or when one is warm and the other is cold.

    • A table is Cold (cold.png) when both metrics (Age and Last App Access) are cold.

View partition KPIs and trends

Note

This feature is supported only on Hive Metastore Type and Bigquery.

datapage-partition-kpis.png
  1. On the Unravel UI, go to the Data > Overview tab.

  2. From the Metastore Type drop-down, select bigquery.

    The following partition KPIs are shown for both the last day and the last 90 days in a trend.

    KPI

    Description

    Number of Partitions Created

    The number of partitions created for that time period.

    Size of Partitions Created

    The accumulated size of all the partitions created for that time period.

    Total Number of Partitions

    Total Number of partitions currently in the system for that time period.

    Total size of Partitions

    The accumulated size of all partitions in the system for that time period.