Corporate logotype
  • Free Trial
  • Blog
  • Unravel
  • Select version
    • Unravel 4.4
    • Unravel 4.3
    • Unravel 4.2
    • Unravel 4.1
Corporate logotype
  • Overview
    • Release notes
      • v4.5 Release notes
        • v4.5.3 Release notes
          • v4.5.3.2 Release notes
            • v4.5.3.1 Release notes
            • v4.5.2 Release notes
              • v4.5.2.1 Release notes
              • v4.5.1 Release notes
                • v4.5.1.1 Release notes
                • v4.5.0 Release notes
                  • v4.5.0.9 Release notes
                    • v4.5.0.8 Release notes
                      • v4.5.0.7 Release notes
                        • v4.5.0.6 Release notes
                          • v4.5.0.5 Release notes
                            • v4.5.0.4 Release notes
                              • v4.5.0.3 Release notes
                                • v4.5.0.2 Release notes
                                • v4.5.x Upgrades
                                  • v4.5.3.x - Upgrade instructions
                                  • v4.5.2.x - Upgrade instructions
                                  • v4.5.1.x - Upgrade instructions
                                  • v4.5.x - Updates to Unravel properties
                                  • v4.4 Release notes
                                    • v4.4.2.0 Release notes
                                      • v4.4.2.1 Release notes
                                      • v4.4.1 Release notes
                                        • v4.4.1 - New configuration properties
                                        • v4.4.1.1 Release notes
                                        • v4.4.0 Release notes
                                          • v4.4.x New Unravel properties
                                            • v4.4.x - Upgrade instructions
                                            • v4.3 Release notes
                                              • v4.3.1.0 Release notes
                                                • v4.3.1.10
                                                • v4.3.1.9 Release notes
                                                • v4.3.1.7 Release notes
                                                • v4.3.1.6 Release notes
                                                • v4.3.1.5 Release notes
                                                • v4.3.1.4 Release notes
                                                • v4.3.1.3 Release notes
                                                • v4.3.1.2 Release notes
                                                • v4.3.1.1 Release notes
                                              • v4.3.0 Release notes
                                              • v4.2 Release notes
                                                • v4.2.7 Release notes
                                                  • v4.2.6 Release notes
                                                    • v4.2.5 Release notes
                                                      • v4.2.4 Release notes
                                                        • v4.2.3 Release notes
                                                          • v4.2 Release notes
                                                          • v4.0-v4.1 Release notes
                                                            • v4.1.9.4 Release notes
                                                          • Compatibility Matrix
                                                            • By platform
                                                              • By Unravel version
                                                              • Downloads
                                                                • Unravel 4.5
                                                                  • Unravel 4.5.3.2
                                                                    • Unravel 4.5.3.1
                                                                      • Unravel 4.5.3.0
                                                                      • Unravel 4.5.2.1
                                                                        • Unravel 4.5.2.0
                                                                          • Unravel 4.5.1.1
                                                                            • Unravel 4.5.1.0
                                                                              • Unravel 4.5.0.9
                                                                                • Unravel 4.5.0.8
                                                                                  • Unravel 4.5.0.7
                                                                                    • Unravel 4.5.0.6
                                                                                      • Unravel 4.5.0.5
                                                                                        • Unravel 4.5.0.4
                                                                                          • Unravel 4.5.0.3
                                                                                            • Unravel 4.5.0.2
                                                                                              • Unravel 4.5.0.0
                                                                                              • Unravel 4.4
                                                                                                • Unravel 4.4.2.1
                                                                                                  • Unravel 4.4.2.0
                                                                                                    • Unravel 4.4.1.1
                                                                                                      • Unravel 4.4.1.0
                                                                                                        • Unravel 4.4.0
                                                                                                        • Unravel 4.3
                                                                                                          • Unravel 4.3.1.9
                                                                                                            • Unravel 4.3.1.8 - Not Available
                                                                                                            • Unravel 4.3.1.7
                                                                                                              • Unravel 4.3.1.6
                                                                                                                • Unravel 4.3.1.5
                                                                                                                  • Unravel 4.3.1.4
                                                                                                                    • Unravel 4.3.1.3
                                                                                                                      • Unravel 4.3.1.2
                                                                                                                        • Unravel 4.3.1.1
                                                                                                                          • Unravel 4.3.1.0
                                                                                                                          • Unravel 4.2
                                                                                                                            • Unravel 4.2.7
                                                                                                                              • Unravel 4.2.6
                                                                                                                                • Unravel 4.2.5
                                                                                                                              • Open Source Information
                                                                                                                              • Unravel 4.5 Documentation
                                                                                                                                • Installation
                                                                                                                                  • Quick start guide
                                                                                                                                    • Platforms
                                                                                                                                      • Cloudera Distribution of Apache Hadoop (CDH)
                                                                                                                                        • Prerequisites
                                                                                                                                        • Part 1: Installing Unravel Server on CDH+CM
                                                                                                                                        • Part 2: Enabling additional instrumentation
                                                                                                                                        • Part 3: Next steps
                                                                                                                                        • Creating an alternate principal
                                                                                                                                        • Troubleshooting
                                                                                                                                      • Hortonworks Data Platform (HDP)
                                                                                                                                        • Prerequisites
                                                                                                                                        • Part 1: Installing Unravel Server
                                                                                                                                        • Part 2: Enabling additional instrumentation
                                                                                                                                        • Part 3: Next steps
                                                                                                                                      • MapR
                                                                                                                                        • Prerequisites
                                                                                                                                        • Part 1: Installing Unravel Server on MapR
                                                                                                                                        • Part 2: Enabling additional instrumentation
                                                                                                                                        • Part 3: Next steps
                                                                                                                                      • Amazon Elastic MapReduce (EMR)
                                                                                                                                        • Prerequisites
                                                                                                                                        • Architecture
                                                                                                                                        • Planning guidance
                                                                                                                                        • Installing Unravel Server on an EC2 instance
                                                                                                                                        • Connecting Unravel Server to a new or existing EMR cluster
                                                                                                                                        • Setting up Amazon RDS (optional)
                                                                                                                                        • Setting up VPC peering (optional)
                                                                                                                                        • Adding instrumentation for a new node
                                                                                                                                        • Testing and troubleshooting
                                                                                                                                        • Operational guidance
                                                                                                                                        • Deleting the Unravel EC2 instance
                                                                                                                                        • Deploying Unravel from the AWS Marketplace
                                                                                                                                      • Amazon Athena (preview only)
                                                                                                                                        • Creating private subnets for Unravel's Lambda function
                                                                                                                                      • Microsoft Azure HDInsight
                                                                                                                                        • Prerequisites
                                                                                                                                        • Creating Azure storage
                                                                                                                                        • Part 1: Installing Unravel on a Separate Azure VM
                                                                                                                                        • Part 2: Connecting Unravel to an HDInsight cluster
                                                                                                                                        • Finding properties in Azure
                                                                                                                                        • Using Azure HDInsight APIs
                                                                                                                                        • Upgrading Unravel Server
                                                                                                                                      • Microsoft Azure Databricks (preview only)
                                                                                                                                        • Prerequisites
                                                                                                                                        • Part 1: Installing Unravel on a separate Azure VM
                                                                                                                                        • Part 2: Connecting Unravel to a Databricks cluster
                                                                                                                                        • Running the Databricks_setup.sh script
                                                                                                                                        • Uninstalling Unravel Server and Sensors on Azure Databricks
                                                                                                                                    • Add-ons
                                                                                                                                      • MySQL
                                                                                                                                        • Install and configure MySQL for Unravel
                                                                                                                                        • Moving MySQL to a custom location
                                                                                                                                        • Partitioning MySQL and migrating data
                                                                                                                                      • OnDemand
                                                                                                                                        • Installing or upgrading OnDemand
                                                                                                                                        • Library versions and licensing for OnDemand
                                                                                                                                      • Matomo (preview only)
                                                                                                                                    • Next steps
                                                                                                                                    • Upgrades
                                                                                                                                      • Upgrading Unravel Server
                                                                                                                                      • Upgrading sensors on CDH
                                                                                                                                      • Upgrading EMR and Unravel Sensors
                                                                                                                                        • Upgrading sensors on HDP
                                                                                                                                        • Upgrading sensors on MapR
                                                                                                                                    • User guide
                                                                                                                                      • Getting started
                                                                                                                                        • Common UI features
                                                                                                                                        • Event panel & insights
                                                                                                                                          • Operations page
                                                                                                                                            • Applications page
                                                                                                                                              • All applications
                                                                                                                                              • Running applications
                                                                                                                                              • Sessions
                                                                                                                                                • Workflow
                                                                                                                                              • Reports page
                                                                                                                                                • Operational insights
                                                                                                                                                  • Data insights
                                                                                                                                                    • Migration planning
                                                                                                                                                      • Reports archive
                                                                                                                                                        • Scheduled reports
                                                                                                                                                        • Scheduling reports
                                                                                                                                                      • Unravel for Azure Databricks
                                                                                                                                                        • Operations page
                                                                                                                                                          • Applications page
                                                                                                                                                            • Reports page
                                                                                                                                                              • Operational Insights
                                                                                                                                                              • Data insights
                                                                                                                                                          • Application Performance Management (APM)
                                                                                                                                                            • Typical APM layout
                                                                                                                                                            • Spark APM
                                                                                                                                                              • Hive APM
                                                                                                                                                                • Impala APM
                                                                                                                                                                  • Kafka APM
                                                                                                                                                                    • MapReduce APM
                                                                                                                                                                      • Tez APM
                                                                                                                                                                        • Workflow APM
                                                                                                                                                                          • Athena APM (preview)
                                                                                                                                                                            • Cascading and Pig APM
                                                                                                                                                                              • HBase alerts and metrics
                                                                                                                                                                              • AutoActions
                                                                                                                                                                                • Overview
                                                                                                                                                                                  • Limitations
                                                                                                                                                                                    • Templates
                                                                                                                                                                                      • Creating AutoActions
                                                                                                                                                                                      • Expert rule
                                                                                                                                                                                        • Same logical operator
                                                                                                                                                                                          • Snooze feature
                                                                                                                                                                                            • AutoActions examples
                                                                                                                                                                                              • Running AutoAction demos
                                                                                                                                                                                                • Supported cluster metrics
                                                                                                                                                                                                • Use Cases
                                                                                                                                                                                                  • Detecting resource contention in the cluster
                                                                                                                                                                                                    • Detecting apps using resources inefficiently
                                                                                                                                                                                                    • Identifying rogue apps
                                                                                                                                                                                                    • End-to-end monitoring of HBase databases and clusters
                                                                                                                                                                                                      • Best practices for end-to-end monitoring of Kafka
                                                                                                                                                                                                        • Kafka detecting lagging or stalled partitions
                                                                                                                                                                                                          • Optimizing the performance of Spark apps
                                                                                                                                                                                                            • Using Unravel to tune Spark data skew and partitioning
                                                                                                                                                                                                              • How to intelligently monitor Kafka/Spark Streaming data pipeline
                                                                                                                                                                                                                • Using RDD caching to improve a Spark app's performance
                                                                                                                                                                                                              • Miscellaneous
                                                                                                                                                                                                                • Some keywords and error message
                                                                                                                                                                                                                  • Resource metrics
                                                                                                                                                                                                              • Advanced topics
                                                                                                                                                                                                                • Advanced instrumentation options
                                                                                                                                                                                                                  • Enabling the JVM sensor
                                                                                                                                                                                                                    • Enabling the JVM sensor on HDP cluster-wide for MapReduce2 (MR)
                                                                                                                                                                                                                  • Adding additional Spark instrumentation
                                                                                                                                                                                                                    • Monitoring individual Spark apps
                                                                                                                                                                                                                    • Uploading Spark programs to Unravel
                                                                                                                                                                                                                  • Integrating with Informatica Big Data Management
                                                                                                                                                                                                                    • Monitoring individual Hive queries
                                                                                                                                                                                                                    • Advanced installation options
                                                                                                                                                                                                                      • Modifying the behavior of unravel_es
                                                                                                                                                                                                                        • Deploying Unravel on security-enhanced Linux
                                                                                                                                                                                                                          • Enabling multiple daemons for high-volume data
                                                                                                                                                                                                                          • Running verification scripts and benchmarks
                                                                                                                                                                                                                            • Uninstalling Unravel Server
                                                                                                                                                                                                                          • Configurations
                                                                                                                                                                                                                            • Cloud
                                                                                                                                                                                                                              • Creating an AWS RDS CloudWatch Alarm for Free Storage Space
                                                                                                                                                                                                                            • HBase
                                                                                                                                                                                                                              • Configuring HBase
                                                                                                                                                                                                                            • Connecting to the Hive Metastore
                                                                                                                                                                                                                              • Configuring a Hive Metastore
                                                                                                                                                                                                                              • Configuring access for an Oracle database
                                                                                                                                                                                                                              • Configuring Microsoft JDBC to connect to Hive Metastore
                                                                                                                                                                                                                              • Configuring Hive Metastore read-only user permissions
                                                                                                                                                                                                                              • Obtaining Hive Metastore details
                                                                                                                                                                                                                            • Kafka
                                                                                                                                                                                                                              • Connecting to a Kafka cluster
                                                                                                                                                                                                                              • Kafka security
                                                                                                                                                                                                                            • Miscellaneous
                                                                                                                                                                                                                              • Configuring email alerts
                                                                                                                                                                                                                              • Creating Active Directory Kerberos principals and keytabs for Unravel
                                                                                                                                                                                                                              • Enable authentication for the Unravel Elastic daemon
                                                                                                                                                                                                                              • Encrypting passwords in Unravel properties and settings
                                                                                                                                                                                                                              • Importing a private certificate into Unravel truststore
                                                                                                                                                                                                                              • Running Unravel daemons with custom user
                                                                                                                                                                                                                              • Setting retention time in Unravel server
                                                                                                                                                                                                                              • Using a private certificate authority with Unravel
                                                                                                                                                                                                                            • OnDemand reports
                                                                                                                                                                                                                              • OnDemand configurations
                                                                                                                                                                                                                              • Configuring forecasting and migration planning reports
                                                                                                                                                                                                                              • Configuring small files and files reports
                                                                                                                                                                                                                              • Triggering an import of FSimage
                                                                                                                                                                                                                            • Secure UI access
                                                                                                                                                                                                                              • Adding SSL and TLS to Unravel web UI
                                                                                                                                                                                                                              • Enabling LDAP authentication for Unravel UI
                                                                                                                                                                                                                              • Enabling SAML authentication for Unravel Web UI
                                                                                                                                                                                                                              • Enabling TLS to Unravel Web UI directly
                                                                                                                                                                                                                            • Spark
                                                                                                                                                                                                                              • Enable/disable live monitoring of Spark Streaming applications
                                                                                                                                                                                                                              • Configure Spark properties for Spark Worker daemon @ Unravel
                                                                                                                                                                                                                            • User interface
                                                                                                                                                                                                                              • Defining a custom banner
                                                                                                                                                                                                                              • Defining a custom web UI port
                                                                                                                                                                                                                              • Disabling browser telemetry
                                                                                                                                                                                                                              • Disabling support/comments panel
                                                                                                                                                                                                                              • Restricting direct access to Unravel UI
                                                                                                                                                                                                                              • Specifying a cluster ID or name
                                                                                                                                                                                                                            • Unravel admins
                                                                                                                                                                                                                              • Adding more admins to Unravel
                                                                                                                                                                                                                              • Adding read-only admins to Unravel
                                                                                                                                                                                                                              • Changing Unravel admin's password
                                                                                                                                                                                                                            • Workflows
                                                                                                                                                                                                                              • Monitoring Airflow workflows
                                                                                                                                                                                                                              • Monitoring Oozie workflows
                                                                                                                                                                                                                          • Miscellaneous
                                                                                                                                                                                                                            • Backup and archive metric database
                                                                                                                                                                                                                            • Cluster wide report
                                                                                                                                                                                                                              • Stopping, restarting, and configuring the AutoAction daemon
                                                                                                                                                                                                                            • REST API
                                                                                                                                                                                                                              • Swagger content
                                                                                                                                                                                                                              • Authentication through Unravel UI
                                                                                                                                                                                                                              • Applications API
                                                                                                                                                                                                                              • Apps API
                                                                                                                                                                                                                              • AutoActions API
                                                                                                                                                                                                                              • Capacity forecasting API
                                                                                                                                                                                                                              • Chargeback reports API
                                                                                                                                                                                                                              • Cluster optimization reports API
                                                                                                                                                                                                                              • Data insights API
                                                                                                                                                                                                                              • File reports API
                                                                                                                                                                                                                              • Jobs API
                                                                                                                                                                                                                              • Migration reports API
                                                                                                                                                                                                                              • Operational
                                                                                                                                                                                                                              • Operations API
                                                                                                                                                                                                                              • Queue analysis reports API
                                                                                                                                                                                                                              • Report archives API
                                                                                                                                                                                                                              • Scheduled reports API
                                                                                                                                                                                                                              • Small files reports API
                                                                                                                                                                                                                              • Top "x" reports API
                                                                                                                                                                                                                              • Workflows API
                                                                                                                                                                                                                              • Use case - AutoActions and Pagerduty
                                                                                                                                                                                                                                • All endpoints by resource name
                                                                                                                                                                                                                                  • Apps endpoints
                                                                                                                                                                                                                                  • AutoAction endpoints
                                                                                                                                                                                                                                  • Celery endpoints
                                                                                                                                                                                                                                  • Chargeback reports
                                                                                                                                                                                                                                  • Cluster reports
                                                                                                                                                                                                                                  • Common endpoints
                                                                                                                                                                                                                                  • Job endpoints
                                                                                                                                                                                                                                  • Kafka endpoints
                                                                                                                                                                                                                                  • Report endpoints
                                                                                                                                                                                                                                  • Search endpoints
                                                                                                                                                                                                                                  • Authentication API
                                                                                                                                                                                                                                  • Workflow endpoints
                                                                                                                                                                                                                                  • YARN Resource Manager endpoints
                                                                                                                                                                                                                              • Roles and Role Based Access Control (RBAC)
                                                                                                                                                                                                                                • RBAC roles
                                                                                                                                                                                                                                  • Configuring RBAC general properties
                                                                                                                                                                                                                                  • Configuring LDAP or SAML RBAC properties
                                                                                                                                                                                                                                    • Example RBAC configurations
                                                                                                                                                                                                                                      • Manage page
                                                                                                                                                                                                                                      • RBAC UI
                                                                                                                                                                                                                                      • Tagging
                                                                                                                                                                                                                                        • What is tagging?
                                                                                                                                                                                                                                          • Tagging applications
                                                                                                                                                                                                                                            • Tagging workflows
                                                                                                                                                                                                                                              • Tagging a Hive on Tez query
                                                                                                                                                                                                                                              • Unravel properties
                                                                                                                                                                                                                                                • Unravel basic properties
                                                                                                                                                                                                                                                • Executor logs properties
                                                                                                                                                                                                                                                  • Airflow properties
                                                                                                                                                                                                                                                  • AutoAction properties
                                                                                                                                                                                                                                                  • Azure properties
                                                                                                                                                                                                                                                  • Btrace properties
                                                                                                                                                                                                                                                  • Celery properties
                                                                                                                                                                                                                                                  • Cluster properties
                                                                                                                                                                                                                                                  • Cluster manager properties
                                                                                                                                                                                                                                                  • Custom banner properties
                                                                                                                                                                                                                                                  • Email properties
                                                                                                                                                                                                                                                  • File reports properties
                                                                                                                                                                                                                                                  • Forecasting report properties
                                                                                                                                                                                                                                                  • FSimage properties
                                                                                                                                                                                                                                                  • HBase properties
                                                                                                                                                                                                                                                  • Hive Hook SSL properties
                                                                                                                                                                                                                                                  • Hive Metastore access properties
                                                                                                                                                                                                                                                  • Hive Metastore JDBC properties
                                                                                                                                                                                                                                                  • HiveServer2 properties
                                                                                                                                                                                                                                                  • Impala properties
                                                                                                                                                                                                                                                  • Kafka properties
                                                                                                                                                                                                                                                  • LDAP properties
                                                                                                                                                                                                                                                  • Migration planning properties
                                                                                                                                                                                                                                                  • Oozie properties
                                                                                                                                                                                                                                                  • Queue analysis properties
                                                                                                                                                                                                                                                  • Role Based Access Control (RBAC) properties
                                                                                                                                                                                                                                                  • S3 monitoring properties
                                                                                                                                                                                                                                                  • SAML properties
                                                                                                                                                                                                                                                  • Sensor properties
                                                                                                                                                                                                                                                  • Sessions properties
                                                                                                                                                                                                                                                  • Small files report properties
                                                                                                                                                                                                                                                  • Small files and file reports properties
                                                                                                                                                                                                                                                  • Spark properties
                                                                                                                                                                                                                                                  • Spark S3 specific properties
                                                                                                                                                                                                                                                  • SSL/TLS properties
                                                                                                                                                                                                                                                  • Tagging properties
                                                                                                                                                                                                                                                  • Tez properties
                                                                                                                                                                                                                                                  • Yarn Timeline Properties
                                                                                                                                                                                                                                                  • Top X properties
                                                                                                                                                                                                                                              • Appendices
                                                                                                                                                                                                                                                • Unravel server reference
                                                                                                                                                                                                                                                • Troubleshooting
                                                                                                                                                                                                                                                  • Sending Diagnostics to Unravel Support
                                                                                                                                                                                                                                              • Newsletters

                                                                                                                                                                                                                                              Home

                                                                                                                                                                                                                                              • Free Trial
                                                                                                                                                                                                                                              • Blog
                                                                                                                                                                                                                                              • Unravel
                                                                                                                                                                                                                                              • Select version
                                                                                                                                                                                                                                                • Unravel 4.4
                                                                                                                                                                                                                                                • Unravel 4.3
                                                                                                                                                                                                                                                • Unravel 4.2
                                                                                                                                                                                                                                                • Unravel 4.1
                                                                                                                                                                                                                                              print
                                                                                                                                                                                                                                              • Prev
                                                                                                                                                                                                                                              • Next
                                                                                                                                                                                                                                              •  Home
                                                                                                                                                                                                                                              • Release notes
                                                                                                                                                                                                                                              • v4.5 Release notes

                                                                                                                                                                                                                                              v4.5 Release notes

                                                                                                                                                                                                                                              • v4.5.3

                                                                                                                                                                                                                                                • v4.5.3.2

                                                                                                                                                                                                                                                • v4.5.3.1

                                                                                                                                                                                                                                              • v4.5.2

                                                                                                                                                                                                                                                • v.4.5.2.1

                                                                                                                                                                                                                                              • 4.5.1

                                                                                                                                                                                                                                                • v4.5.1.1

                                                                                                                                                                                                                                              • v4.5.0

                                                                                                                                                                                                                                                • v4.5.0.9

                                                                                                                                                                                                                                                • v4.5.0.8

                                                                                                                                                                                                                                                • v4.5.0.7

                                                                                                                                                                                                                                                • v4.5.0.6

                                                                                                                                                                                                                                                • v4.5.0.5

                                                                                                                                                                                                                                                • v4.5.0.4

                                                                                                                                                                                                                                                • v4.5.0.3

                                                                                                                                                                                                                                                • v4.5.0.2

                                                                                                                                                                                                                                              • Updates to Unravel configuration properties

                                                                                                                                                                                                                                              • Upgrading

                                                                                                                                                                                                                                                • v4.5.3.x

                                                                                                                                                                                                                                                • v4.5.2.x

                                                                                                                                                                                                                                                • v4.5.1.x

                                                                                                                                                                                                                                              In this section:

                                                                                                                                                                                                                                              Search results

                                                                                                                                                                                                                                                No results found

                                                                                                                                                                                                                                                Was this helpful?

                                                                                                                                                                                                                                                Would you like to provide feedback? Just click here to suggest edits.

                                                                                                                                                                                                                                                • Prev
                                                                                                                                                                                                                                                • Next
                                                                                                                                                                                                                                                © 2016-2019 Unravel Data Inc. All rights reserved.
                                                                                                                                                                                                                                                Last modified: 2019-09-03
                                                                                                                                                                                                                                                Publication date: 2019-09-25