Skip to main content

Home

Elasticsearch

This tab lets you monitor various metrics in the Elasticsearch clusters. You can select a cluster and the period range to monitor the metrics for each cluster, each node in the cluster, as well as for the corresponding indices. The monitoring of the Elasticsearch clusters can be enabled by configuring the Elasticsearch properties in the unravel.properties file.

es-mainpage.png
Enable monitoring for Elasticsearch clusters

Set the properties for Elasticsearch. Refer to ELK configuration for the method to set the properties.

View Elasticsearch cluster metrics

By default, the cluster metrics are summarized and shown for all the nodes in the cluster for the past one hour. To view the Elasticsearch cluster KPIs for a specific time period:

  1. Go to Clusters > Elasticsearch.

  2. Select a cluster from the Cluster drop-down.

  3. Optionally select a period range.

    The following Elasticsearch KPIs of a cluster are displayed on top of the page:

    Cluster Metrics

    Metrics

    Description

    Status

    Status of the cluster.

    Nodes

    Total number of nodes in the cluster.

    Indices

    Total count of indices in the cluster.

    Total Shards

    Total number of shards in the cluster.

    Unassigned Shards

    Total number of unassigned shards in the cluster.

    Documents

    Total count of indexed documents in the cluster.

    Successful Shards

    Total number of successful shards in the cluster.

    Active Shards

    Total number of active shards in the cluster.

    Initializing Shards

    Number of initializing shards in the cluster.

    Relocating Shards

    Number of relocating shards in the cluster.

    Cluster Graphs

    The following graphs plot various Elasticsearch KPIs for a selected cluster in a specified time range:

    • Search Rate: This graph plots the rate at which documents are queried in Elasticsearch for the selected cluster.

      es-cluster-search-rate.png
    • Search Latency: This graph plots the time taken to execute the search request for the selected cluster.

      es-cluster-search-latency.png
    • Indexing Rate: This graph plots the rate at which documents are indexed in the selected cluster.

      es-cluster-indexing-rate.png
    • Indexing Latency: This graph plots the time taken to index the documents in the selected cluster.

      es-cluster-indexing-latency.png
View Elasticsearch node metrics

You can monitor the Elasticsearch metrics at the node level. To view the metric details of a specific node in an Elasticsearch cluster:

  1. Go to Clusters > Elasticsearch.

  2. Select a cluster from the Cluster drop-down.

  3. Optionally select a period range.

  4. Click the Nodes tab. All the nodes in the cluster and the corresponding details are listed in the Nodes tab.

  5. Select a node. The node details are displayed in a table. The node metrics are displayed on the upper right side.

    You can use the toggle button sort-notused.png to sort the columns, of the node details table, in an ascending and descending order. You can also click the column-setting.png icon to set the columns to be displayed in the Nodes tab.

    Node Details

    The following details are displayed for each node:

    Column

    Description

    Name

    Name of the node.

    CPU usage

    Total CPU usage for the node.

    Disk Total

    Total disk space available for the Elasticsearch node.

    Disk Used

    Total disk space used by the Elasticsearch node.

    Load Average

    The load average of a CPU in an operating system.

    Jvm Memory

    JVM heap memory used.

    Node Metrics

    The following node metrics are displayed for the selected node:

    Metrics

    Description

    Documents

    The total number of indexed documents in the node.

    Free Disk Space

    The available disk space in the node.

    Heap Percent

    Percentage of heap memory used.

    Flush Latency

    Time taken to flush the indices in a node.

    Flush Rate

    The rate at which the indices are flushed.

    CPU

    The CPU utilization by the operating system in percentage.

    RAM

    RAM utilization in percentage.

    Total Read Operations

    Total amount of read operations processed.

    Total write Operations

    Total amount of write operations processed.

    Uptime

    Time since the node is up and active.

    Node Graphs

    The following graphs plot various Elasticsearch KPIs for a selected node in a specified time range:

    • JVM Heap: This graph plots the total heap used by Elasticsearch in the JVM for a selected node.

      es-node-jvmheap.png
    • Index Memory: This graph plots the heap memory used for indexing in a selected node.

      es-node-indexmem.png
    • CPU Utilization: This graph plots the percentage of CPU usage for the Elasticsearch process in the selected node.

      es-node-cpuutil.png
    • System Load: The graph plots the load average per minute for the selected node.

      es-node-systemload.png
    • Segment Count: This graph plots the maximum segment count for the selected node.

      es-node-segmentcount.png
    • Search Latency: This graph plots the average search latency for the selected node.

      es-node-searchlatency.png
    • Indexing Latency: This graph plots the average latency for indexing documents in the selected node.

      es-node-indexinglatency.png
    • Documents: This graph plots the count of indexed documents for the selected node.

      es-node-documents.png
View Elasticsearch indices metrics

To view the metric details of an index in an Elasticsearch cluster:

  1. Go to Clusters > Elasticsearch.

  2. Select a cluster from the Cluster drop-down.

  3. Select a period range.

  4. Click the Indices tab. All the indices in the cluster are listed in the Indices tab.

  5. Select an index. The index details are displayed in a table. The index metrics are displayed on the upper right side.

    You can use the toggle button sort-notused.png to sort the columns, of the index details table, in an ascending and descending order. You can also click the column-setting.png icon to set the columns to be displayed in the Indices tab.

    Indices Details

    The following details are displayed for each of the indices:

    Column

    Description

    Name

    Name of the index.

    Docs

    Number of indexed documents.

    Store Size

    Storage size of the indexed documents.

    Search Rate

    Number of search requests being executed.

    Active Shards

    Total number of active shards in an index.

    Unassigned Shards

    Total number of unassigned shards in an index.

    Index Metrics

    The following metrics are displayed for the selected index:

    Metrics

    Description

    Flush Total

    Total number of flushed indices.

    Flushed Latency

    Time taken to flush an index.

    Flush Rate

    The rate at which indices are flushed.

    Segments count

    Count of segments.

    The following graphs represent various Elasticsearch KPIs for a selected index in a specified time range. By default, all the indices are checked in the graphs. You can select single or multiple indices in the graph.

    Indices Graphs

    The following graphs plots various metrics for the selected indices in a specified time range:

    • Search Rate: This graph plots the number of search requests that are being executed in Elasticsearch.

      es-index-searchrate.png
    • Indexing Latency: This graph plots the time taken to index the documents in Elasticsearch.

      es-index-indexlatency.png
    • Indexing Rate: This graph plots the rate at which documents are indexed in Elasticsearch

      es-index-indexrate.png
    • Segments Count: This graph plots the count of indexing segments operation.

      es-index-seg-count.png
    • Fetch Latency: This graph plots the fetch latency for the indices.

      es-index-fetchlatency.png
    • Fetch Rate: This graph plots the time taken to fetch the query results.

      es-index-fetch-rate.png
    • Flush Latency: This graph plots the time taken to flush indices.

      es-index-flush-latency.png
    • Flush Rate: This graph plots the rate at which indices are flushed.

      es-index-flush-rate.png