Home

Chargeback

This tab allows you to generate chargeback reports for your clusters' usage costs for Yarn jobs and Impala jobs. Multi-cluster feature is supported for Chargeback reports. However, you can view the report of a single cluster at a time.

In case there are no Yarn jobs or Impala jobs running on the selected cluster at the specified time, then chargeback reports are not shown.

Generate chargeback report
  1. From the Chargeback drop-down on the upper left corner, select either Yarn or Impala.

    chargeback_imp_yarn.png
  2. Use the Cluster and date picker pull-down menus to select a specific cluster or change the date range.

  3. Click in the Group By box and select an option. Select a maximum of two Group By options at a time. You can click Deselect-X.png next to the option to deselect an option if you have selected more than one option.

    The chargeback report is generated. If you have selected two Group By options, the combined results are displayed in the donut charts (Jobs, CPU hours, Memory hours) and also in the table below the donut charts. Refer to Drilling down the Chargeback results for more details.

    Example:

    In the following image, the report is grouped by two tags, dept and project. (See What is tagging, if you are unfamiliar with the concept.)

    chargeback-main.png

    There are times when a job cannot be grouped by the selected option.In such cases NULL is listed in the Group By option column. In this case, there are jobs that have neither a dept or project tag.

    Hover over a donut section to see the slice name, the value, and percentage of the whole. Click Download CSV to download the chargeback report.

    The list of all the Yarn jobs/Impala jobs is provided in the tables as shown. You can view 15 records at a time and download the list in a CSV format.

    chargeback-yarn-imp-jobs1.png
    chargeback-yarn-imp-jobs.png
Drilling down the Chargeback results

The chargeback results are displayed in the table as shown in the following image:

chargeback-results-table.png

Click any row to drill down to the next Group By option.

if you click the row again, you can drill down further till all the associated Group By options are exhausted for the Application type option in Yarn jobs and User option in Impala jobs.

chargeback-result-1.png
chargeback-result-2.png
chargeback-result-3.png
chargeback-result-4.png

Use the navigation path corresponding to the Group by to move back to a previous option.

Estimating chargeback cost
  1. From the Chargeback drop-down on the upper right corner, select one of the following options:

    • Yarn

    • Impala

  2. Use the Cluster and date picker pull-down menus to select a specific cluster or change the date range.

  3. Click in the Group By box and select an option. You can select a maximum of two Group By options only at a time. The Chargeback report is displayed.

    The chargeback report is generated.

  4. Enter the vCore/Hour or Memory MB/Hour and click Apply. A quick estimation is displayed in the results table, in the CPU hours or Memory hours column.