Skip to main content

Home

Upgrading sensors on MapR

unravel-host is the Unravel Server's fully qualified domain name or IP address.

spark-version is the target Spark version. for example, 1.6.0, 2.0.1, 2.2.0.

hive-version is the target Hive version, for example, 1.2.0.

Warning

Only activate the sensors when there are no Hive or Spark jobs running as the restart may affect running jobs.

  1. On Unravel Server and on all nodes in the cluster that have Unravel Sensors deployed, create backups of the old sensor folders and then remove the folders.

    cd /usr/local/
sudo tar -cvf unravel-sensors-`date +%m%d%y`.tar  unravel-agent unravel_client
sudo rm -rf /usr/local/unravel-agent
sudo rm -rf /usr/local/unravel_client
cd /opt/mapr/spark/spark-spark-version/conf/
sudo mv spark-defaults.conf.pre_unravel spark-defaults.conf.pre_unravel.copy

    Note

    From Unravel version 4.6.1.7 onwards the file spark-defaults.conf.pre_unravel is renamed as spark-defaults.conf.preunravel.

  2. On Unravel Server, run the sensor package script.

    cd /usr/local/unravel/install_bin/cluster-setup-scripts/
python2 unravel_mapr_setup.py --unravel-server unravel-host:3000  --spark-version spark-version --hive-version hive-version —sensor-only

    Running the sensor package script creates the sensor packages in /usr/local/unravel-agent and /usr/local/unravel_client.

  3. Compress /usr/local/unravel-agent and /usr/local/unravel_client and copy the compressed file (unravel-new-sensors.tar) to all nodes in the cluster.

    cd /usr/local/
tar -cvf unravel-new-sensors.tar  unravel-agent  unravel_client
scp unravel-new-sensors.tar  cluster-node:/usr/local/

  4. On the cluster node, extract the copied unravel-new-sensors.tar file on the cluster nodes.

    cd /usr/local/ 
tar -xvf unravel-new-sensors.tar
In this section: