Home

Creating AutoActions

Note

See limitations on AutoActions.

To create a new AutoAction click either New from Template or New AutoAction.

  • New from Template has two options

    • By Application: Partially completed templates designed for a specific task organize by application type.

    • Custom: a template which is a text box where you can define your AutoAction using JSON. You

  • New AutoAction: Provides an empty template with all options available.

See AutoActions Templates for descriptions and use of the template's sections.

  • Using New From Templates

    Click New from Template. The available templates are grouped by app type. Click on the application to see the templates available.

    YARN

    • Resource contention in a cluster or queue.

      • Allocated Memory: Monitors overall memory for a cluster usage on a cluster and number of pending/running jobs in order to detect when the cluster is struggling to accommodate all submitted jobs and falls into a resource contention pitfall. Once detected, the specified AutoAction is taken.

      • Alllocated vCores: Monitors overall memory or vCore usage in a queue and number of pending/running jobs in order to detect a state when the queue is struggling to accommodate all submitted jobs and falls into a resource contention pitfall. Once detected, the specified action is taken.

    • Rogue identification

      • Rogue user: Identifies so-called “rogue” users on a cluster who can potentially affect other users and the cluster as a whole, that is, users submitting jobs that use too much of the cluster resources (memory or vCores). Once the rogue user is detected, the specified action is taken.

      • Rogue app: Identifies so-called “rogue” apps on a cluster that can potentially affect other apps and the cluster as a whole, that is, apps using too much of the cluster resources (memory or vCores). Once the rogue app is detected, the specified action is taken.

    • Long-running Jobs

      • Long-running YARN app: Monitors elapsed time of a running YARN app, MapReduce, Spark, Hive, etc., and executes the action if the job runs longer than desired.

      • Long-running Hive query: Tracks Hive jobs by monitoring the total elapsed time of a running Hive query and executes the action if the job runs longer than desired.

      • Long-running workflow: Tracks workflow jobs by monitoring total elapsed time of a running workflow and executes the action if the job runs longer than desired.

    Impala

    • Login Running Impala Query

    • Rogue Application

    Kafka

    Expert

    This is simply a text box. We recommend that you only use this option if you are familiar with AutoAction and how they work. It is possible to wreak havoc upon your queue and cluster if you are not. Please consult the Expert rule section for help in developing your AutoAction.

    Complete the template. Note:

    Note

    Changing the predefined ruleset can result in the action not behaving as anticipated.

Click Save AutoAction.

In this section: