Reference Guide
This reference covers both on-premises and cloud deployments. Some daemons and properties only apply to on-premises deployments.
Daemons
The Unravel service is composed of many daemons which are summarized in the next table. The suffix _N
means 1, 2, 3, or 4 separate daemons.
Daemon Logical Name | Description |
---|---|
| AutoAction worker |
| Datastore REST API HTTP server |
| Elasticsearch |
| Event worker |
| Health check |
| Hitdoc Loader |
| Hive worker |
| Hive Hook Worker EMR |
| Host Monitor |
| Bundled Kafka (on a custom port) |
| Kafka Monitor |
| Log Receiver |
| |
| Metrics Analyzer |
| MySQL |
| aNGular Web UI |
| |
| |
| Oozie v3 sensor |
| Spark Worker |
| Table Worker |
| Tidy Dir cleans up and archives hdfs directories, db retention cleaner. |
| Cluster Access Service - provides access to cluster services and files (Unravel Edge node). |
| Databricks sensor (Unravel remote node) |
| Embedded metrics DB |
| EMR sensor (Unravel remote node) |
| Job Analyzer summarizes jobs |
| Job Collector sensor YARN for EMR |
| Universal sensor/Impala |
| Job Collector sensor YARN |
| Job Collector sensor worker YARN |
| Bundled Zookeeper (on a custom port) |
Directories and files
The following is a cross-reference of notable directories and files used by Unravel Server:
Adjustable properties
The file unravel.properties
contains settings that can be preserved during an RPM upgrade. These properties are described in the following table:
Property Type/Property Name/Description | Default Value |
---|---|
General Unravel | |
com.unraveldata.tmpdir The base location for Unravel process control files where Unravel's temp files reside. | /srv/unravel/tmp |
HDFS | |
com.unraveldata.hdfs.batch.monitoring.interval.sec Number of seconds between checks for presence of hive queries and MR logs to load into Unravel for batch visibility; should be between 300 and 1800 (inclusive). | 300 |
com.unraveldata.hdfs.interactive.monitoring.interval.sec Number of seconds between checks for presence of hive queries and MR logs to load into Unravel for interactive visibility; should be between 5 and 60 (inclusive). | 30 |
Zookeeper | |
com.unraveldata.zk.quorum Embedded Zookeeper ensemble in form host1:port1,host2:port2. | 127.0.0.1:4181 |