Skip to main content

Home

Applications

From the Applications tab, you can view the details of all the jobs running in your cluster based on the application types. By default, all the Jobs that are running for all the applications in the last hour are displayed. The required job details of an application can be listed quickly by:

  • Cluster-ID

  • Job ID, Keyword

  • Date/time range

These filters can vary based on the tab that you are viewing. For instance:

  • You can only filter the All and Running list of jobs by keyword or job ID.

  • You can filter all the views by Application Type.

The total number of applications that meet the filtering criteria is shown on the top of the left panel. You can easily filter the jobs from any of the following tabs and by the corresponding options provided on the left panel:

  • All: All the jobs in all the applications are listed, for a selected time range, regardless of the status.

  • Running: All the applications, which are in running status during the selected time range are listed.

  • Inefficient: All the applications, which had inefficient events during their run are listed.

Note

These settings are not propagated across views. In other words, changing any of these values does not alter the settings for the other tabs. Like across the UI, your state is saved when you leave the view.

The Reset button sets all criteria, except date range, to the defaults. Therefore, the only filter applied is the date range.

  • Click any listed jobs to bring up the Application details page for that job.

  • Click column-setting.png in the header row to select the columns to be displayed.

All applications

This tab displays all the jobs running on various application types. By default, this tab shows all the jobs running in all the applications in the past hour. The jobs are sorted in descending order on Start Time. To sort the results by another column, click the sort arrows (sort-notused.png ) next to the column header. Click the top arrow to sort the column by ascending order and the bottom by descending order. The column the list is currently sorted on has the sort choice highlighted (sort-descending.png ). For cached queries, the Cache label is displayed next to the App Name/ ID.

applications-main.png

You can filter the applications by:

  • Entering an app name or string in the text box in the left pane.

  • Selecting a Cluster ID from the pull-down menu next to the date range picker.

You can further filter the jobs using any of the following options:

Filter Options

Description

Application Type

Lists all the application types that are running on your cluster. Select the checkboxes corresponding to the application types to filter and list the jobs as per those application types. You can also click Only corresponding to an application type to filter only the jobs for that application. Click Show all , and all the jobs in all the application types are listed.

Status

Select any of the following statuses to list the jobs that are specific to these states:

applications-legend.png

The colors corresponding to the status options serve as the legend for the all Applications table.

applications-table-legend.png

You can also click Only corresponding to status to list only the jobs in a specific status. Click Show all , and all the jobs for in all the statuses are listed.

Duration

Lists the jobs as per the selected duration of the job run. Use the range slider to adjust the duration. The range of duration for the currently displayed apps, for example, 00:00:21 - 01:12:03.

Events

The upper and lower bound of the events, for example, 1-10. You can select the bounds to use by adjusting the events slider for min and max values.

User

Lists the jobs based on the user. Click in the text box for valid options. Click an option to select it or the Deselect-X.png next to a name to deselect it.

Queue

Lists the jobs based on the queue. Click in the text box for valid options. Click an option to select it or the Deselect-X.png next to a name to deselect it.

Tags

All possible tag keys are listed. Select the check box next to the key . Once selected, a text box is displayed below the tag. Click within the box for the key's tag values . Click a value to select it, and click the Deselect-X.png next to a name to deselect it. The tag values you selected remain when you deselect a tag; in other words, the values selected remain, and the next time you select the tag key, they are still selected. If you are not familiar with tags, see What is tagging? .

The application list displays the following columns:

Columns

Description

Type

Type of applications. For example, Spark, Hive, and so on.

Status

Status of the jobs running on the application. One of the following statuses is displayed.

applications-legend.png

User

The name of the user running the jobs on the application.

App Name/ID

Name or ID of the application. You can click the link to view the corresponding application details page.

Insights

insights.png

Whenever Unravel has an analysis for the jobs that are run for an application, the Insights column displays this (insights.png) icon. For more details, check the Analysis tab on the Application details page for that application.

Cluster ID

The ID of the cluster where the jobs on the application are run.

Start Time

Date and time when the jobs on the applications started.

Duration

The period since the application started.

Cost

Cost related to that query. Currently, the cost is calculated based on the on-demand pricing model of BigQuery.

Queue

The queue to which the jobs belong.

Read

The number of bytes read by the applications.

Write

The number of bytes written by the application.

Events

The upper and lower bound of the events, for example, 1-10. You can select the bounds to use by adjusting the events slider for min and max values.

Parent App

The Parent App column has a link to the parent application of the job or related application. Click the link to bring up the details page of the parent application.

Running applications

This tab lists all the running applications on the cluster.

applications-running-apps.png

Unravel polls the Resource Manager every 90 seconds to get the resources (vCores, Memory MB, and running containers) for all running and pending apps.

Apps that run less than 90 seconds are usually not captured, i.e., unless the application is running at the exact moment the Resource Manager is polled the application data is not captured. Therefore, for any given point in time, the total number of apps running does not match the number of apps in Applications > Applications if you filter at the same time.

See All applications above for details on the filter options. This view does not have a status filter and a date picker for time period, since its shows only the running jobs.

Inefficient Apps

This view lists all the apps which had inefficient events.

applications-apps-inefficient.png

The only filter options are Application Type and Application Events. Hover over the Application Event names to see the complete name. Click the job to bring up the job in its APM page. Go to the analysis tab for the complete explanations of the job's inefficiencies.