Reference Guide
This reference covers both on-premises and cloud deployments. Some daemons and properties only apply to on-premises deployments.
Daemons
The Unravel service is composed of many daemons which are summarized in the next table. The suffix _N
means 1, 2, 3, or 4 separate daemons.
Daemon Logical Name |
Description |
---|---|
|
AutoAction worker |
|
Datastore REST API HTTP server |
|
Elasticsearch |
|
Event worker |
|
Health check |
|
Hitdoc Loader |
|
Hive worker |
|
Hive Hook Worker EMR |
|
Host Monitor |
|
Bundled Kafka (on a custom port) |
|
Kafka Monitor |
|
Log Receiver |
|
|
|
Metrics Analyzer |
|
MySQL |
|
aNGular Web UI |
|
|
|
|
|
Oozie v3 sensor |
|
Spark Worker |
|
Table Worker |
|
Tidy Dir cleans up and archives hdfs directories, db retention cleaner. |
|
Cluster Access Service - provides access to cluster services and files (Unravel Edge node). |
|
Databricks sensor (Unravel remote node) |
|
Embedded metrics DB |
|
EMR sensor (Unravel remote node) |
|
Job Analyzer summarizes jobs |
|
Job Collector sensor YARN for EMR |
|
Universal sensor/Impala |
|
Job Collector sensor YARN |
|
Job Collector sensor worker YARN |
|
Bundled Zookeeper (on a custom port) |
Directories and files
The following is a cross-reference of notable directories and files used by Unravel Server:
Adjustable properties
The file unravel.properties
contains settings that can be preserved during an RPM upgrade. These properties are described in the following table:
Property Type/Property Name/Description |
Default Value |
---|---|
General Unravel |
|
com.unraveldata.tmpdir The base location for Unravel process control files where Unravel's temp files reside. |
/srv/unravel/tmp |
HDFS |
|
com.unraveldata.hdfs.batch.monitoring.interval.sec Number of seconds between checks for presence of hive queries and MR logs to load into Unravel for batch visibility; should be between 300 and 1800 (inclusive). |
300 |
com.unraveldata.hdfs.interactive.monitoring.interval.sec Number of seconds between checks for presence of hive queries and MR logs to load into Unravel for interactive visibility; should be between 5 and 60 (inclusive). |
30 |
Zookeeper |
|
com.unraveldata.zk.quorum Embedded Zookeeper ensemble in form host1:port1,host2:port2. |
127.0.0.1:4181 |