In Cloudera Manager, go to the Parcels page by clicking the parcels glyph () on the top of the page.

Click Configuration to see the Parcel Settings pop-up.

In the Parcel Settings pop-up, go to the Remote Parcel Repository URLs section, and click the + glyph to add a new entry.

In a new browser tab, copy the exact directory name for your CDH version from the http://unravel-host:3000/parcels/ directory.

For example, the exact directory name might be cdh5.16 or cdh6.0.

Add http://unravel-host:3000/parcels/cdh-version/ (including the trailing slash).

Where:

cdh-version is your version of CDH. For example, cdh5.16 or cdh6.0.

unravel-host is the hostname or LAN IP address of Unravel Server. On a multi-host Unravel Server, this would be the host where the unravel_lr daemon is running.

Click Save.

Click Check for New Parcels.

On the Parcels page, pick a target cluster in the Location box.

In the list of Parcel Names, find the UNRAVEL_SENSOR parcel that matches the version of the target cluster and click Download.

Click Distribute.

If you have an old parcel from Unravel, deactivate it now.

On the new parcel, click Activate.

In Cloudera Manager, select the target cluster, click Hive | Configuration, and search for hive-env.

In Gateway Client Environment Advanced Configuration Snippet (Safety Valve) for hive-env.sh enter the following exactly as shown, with no substitutions:

AUX_CLASSPATH=${AUX_CLASSPATH}:/opt/cloudera/parcels/UNRAVEL_SENSOR/lib/java/unravel_hive_hook.jar

If Sentry is enabled, grant privileges on the JAR files to the Sentry roles that run Hive queries.

Sentry commands may also be needed to enable access to the Hive Hook JAR file. Grant privileges on the JAR files to the roles that run hive queries. Log in to Beeline as user hive and use the Hive SQL GRANT statement to do so.

For example (substitute role as appropriate),

GRANT ALL ON URI 'file:///opt/cloudera/parcels/UNRAVEL_SENSOR/lib/java/unravel_hive_hook.jar' TO ROLE role

Copy the Hive Hook snippet into hive-site.xml:

From the Unravel server OS, use the command cat <Unravel installation directory>/hive-hook/hive-site.xml.snip, copy the contents, and paste them into hive-site.xml.

In Cloudera Manager, go to the Hive service.

Select the Configuration tab.

Search for hive-site.xml in the middle of the page.

Add the snippet to Hive Client Advanced Configuration Snippet for hive-site.xml (Gateway Default Group).

To edit, click View as XML.

If you configure CDH with Cloudera Navigator's safety valve setting, you must edit the following keys hive.exec.post.hooks, hive.exec.pre.hooks, hive.exec.failure.hooks and append the value com.unraveldata.dataflow.hive.hook.UnravelHiveHook without any space.

For example:

<property>  
<name>hive.exec.post.hooks</name>  
<value>com.unraveldata.dataflow.hive.hook.UnravelHiveHook,com.cloudera.navigator.audit.hive.HiveExecHookContext,org.apache.hadoop.hive.ql.hooks.LineageLogger</value>  
<description>for Unravel, from unraveldata.com</description>
</property>

Add custom property com.unraveldata.host and set the value to unravel-gateway-internal-IP-hostname.

Add the snippet to HiveServer2 Advanced Configuration Snippet for hive-site.xml.

To edit, click View as XML.

If you configure CDH with Cloudera Navigator's safety valve setting, you must edit the following keys hive.exec.post.hooks, hive.exec.pre.hooks, hive.exec.failure.hooks and append the valuecom.unraveldata.dataflow.hive.hook.UnravelHiveHook without any space.

For example:

<property>
<name>hive.exec.post.hooks</name>  
<value>com.unraveldata.dataflow.hive.hook.UnravelHiveHook,com.cloudera.navigator.audit.hive.HiveExecHookContext,org.apache.hadoop.hive.ql.hooks.LineageLogger</value>  
<description>for Unravel, from unraveldata.com</description>
</property>

Add custom property com.unraveldata.host and set the value to unravel-gateway-internal-IP-hostname.

Save the changes with optional comment Unravel snippet in hive-site.xml.

Deploy the Hive client configuration by clicking the deploy glyph () or by using the Actions pull-down menu.

Restart the Hive service.

Check Unravel UI to see if all Hive queries are running.

In Cloudera Manager, select the target cluster and then click Spark.

Select Configuration.

Search for spark-defaults.

In Spark Client Advanced Configuration Snippet (Safety Valve) for spark-conf/spark-defaults.conf, enter the following text, replacing placeholders with your particular values:

spark.unravel.server.hostport=unravel-host:4043 
spark.driver.extraJavaOptions=-javaagent:/opt/cloudera/parcels/UNRAVEL_SENSOR/lib/java/btrace-agent.jar=config=driver,libs=spark-version
spark.executor.extraJavaOptions=-javaagent:/opt/cloudera/parcels/UNRAVEL_SENSOR/lib/java/btrace-agent.jar=config=executor,libs=spark-version
spark.eventLog.enabled=true

On a multi-host Unravel Server deployment, use host2's FQDN or logical hostname for unravel-host.

Save changes.

Deploy the client configuration by clicking the deploy glyph () or by using the Actions pull-down menu. Your spark-shell will ensure new JVM containers are created with the necessary extraJavaOptions for the Spark drivers and executors.

Enable Spark streaming.

The Spark streaming probe is disabled by default and you must enable it manually by editing spark-defaults.conf.

Search for spark.driver.extraJavaOptions and set it to the following. Be sure to substitute the correct version of Spark for spark-version.

javaagent:unravel-sensor-path/btrace-agent.jar=script=DriverProbe.class:SQLProbe.class:StreamingProbe.class,libs=spark-spark-version.

Check Unravel UI to see if all Spark jobs are running.

In Cloudera Manager, go to YARN service.

Select the Configuration tab.

Search for Application Master Java Opts Base and concatenate the following XML block properties snippet (ensure to start with a space and add below).

-javaagent:/opt/cloudera/parcels/UNRAVEL_SENSOR/lib/java/btrace-agent.jar=libs=mr -Dunravel.server.hostport=unravel-host:4043 

Search for MapReduce Client Advanced Configuration Snippet (Safety Valve) for mapred-site.xml in the middle of the page.

Enter the following XML four-block properties snippet to Gateway Default Group. (Click View as XML.)

<property>
<name>mapreduce.task.profile</name>
<value>true</value>
</property> 
<property>
<name>mapreduce.task.profile.maps</name>
<value>0-5</value>
</property> 
<property>
<name>mapreduce.task.profile.reduces</name>
<value>0-5</value>
</property> 
// this is one line 
<property>
<name>mapreduce.task.profile.params</name>
<value>-javaagent:/opt/cloudera/parcels/UNRAVEL_SENSOR/lib/java/btrace-agent.jar=libs=mr -Dunravel.server.hostport=unravel-host:4043</value></property> 

Save the changes.

Deploy the client configuration by clicking the deploy glyph () or by using the Actions pull-down menu.

Cloudera Manager will specify a restart which is not necessary to effect these changes. (Click Restart Stale Services if that is visible. However, you can also perform this later when you have a planned maintenance.)