Home

Resources

The Resources tab displays the usage of resources by the clusters, for a specific period. The resources usage can be grouped by any of the following filters:

  • Application Type

  • User

  • Queue

  • User-defined tag key (see What is tagging)

  • Input/output tables

cluster-resources-main.png

Unravel polls the Resource Manager every 90 seconds to get the resources (VCores, Memory, and running containers) for all the running and pending apps. Applications that run for less than 90 seconds are not captured. Unless the application is running at the exact moment the Resource Manager is polled, the application data is not captured. Therefore, for any specific point in time, the total number of applications running may not match the number of applications in Jobs > All Applications if you filter at the same time.

Viewing resources usage

To view the resources usage, do the following:

  1. Go to the Clusters > Resources tab.

  2. From the Cluster drop-down, select a cluster.

  3. From the Group By drop-down, select an option. You can filter the Group By options further from the Filter options box. Click the Deselect-X.png next to an option to deselect it.

    For example, if you select Application Type as a Group By option, then all the application types are listed in the Filter options box. You can then drill down to a specific application type such as Spark.

  4. Select the period range from the date picker drop-down. You can also provide a custom period range. The graphs corresponding to the selected filters are displayed.

  5. Click any point in the graph. The details of the resources used for the running jobs are displayed in a table.

Graphs (Resources)

The following graphs plot the resource usage for a selected filter in the specified period range. You can hover the mouse pointer over the graph to view the corresponding values on the trend line. You can select a section of the graph and drag the pointer to zoom in. Click Reset Zoom to zoom out.

  • VCores

    The Vcores graph plots the total available and total allocated VCores in your cluster for the specified period. Select or deselect the checkboxes to hide or show the available and allocated VCores.

  • Memory

    The Memory graph plots the total available and total allocated memory in your clusters for the specified period. Select or deselect the checkboxes to hide or show the total available and total allocated memory.

  • VCores (Group By, Filter) and Memory (Group By, Filter)

    This graph plots the VCores and memory resources usage by any of the following options in a cluster for the specified period.

    • Application type

    • User

    • Queue

    • User-defined tag key (see What is tagging)

    • Input/output tables

    Further Filter options can be determined based on the selected Group By option.

You can click export-format.png in the graph to export the graph and the table data to any of the following formats:

  • PDF

  • PNG

  • JPEG

  • SVG

  • CSV

  • XLS

When you click any point in the graph, the following details of the resources used for a job run are displayed. Click a row in this table and the APM page of the corresponding application is displayed. Click column-setting.png columns in the table to select the columns that must be displayed.

Items

Description

Type

The type of application where the job is running.

User

Name of the user running the job.

State

Status of the job.

App Name/ID

Name or ID of the application where the job is running.

Start Time

The time when the job was started.

Duration

Period till when the job has been running.

Queue

Queue

Progress

Percentage of the progress of the running job.

Memory MB

Memory in MB that is used by the job.

VCores

No of VCores that are used by the job.

Running Containers

No of running containers.