Skip to main content

Home

Upgrading sensors on Databricks

To upgrade sensors on Databricks, run the databricks_setup.sh script as follows for each of the existing workspaces:

Important

Run this script as the same username that you used to install the Unravel server.

usr/local/unravel/install_bin/databricks_setup.sh --add-workspace -i <Workspace> -n <Workspace Name> -t <Workspace Token> -r <Workspace URL> -u <Unravel VM Private IP>:4043 -p <Tier>

##For example:
/usr/local/unravel/install_bin/databricks_setup.sh --add-workspace -i 0000000000000000 -n myworkspace -t xxxx -r https://adb-0000000000000000.16.azuredatabricks.net -u 127.0.0.1:4043 -p premium

Option

Description

--add-workspace | -a

Sets up or updates a Databricks workspace for monitoring by Unravel. Valid values:

-i

Id of the workspace to be configured.

-n

Workspace name.

-r

Workspace instance. Must start with https://.

For example, https://eastus.databricks.com

-t

Workspace access token.

-u

Unravel LR Endpoint. (e.g: 10.0.0.4:4043)

-p

(Optional) Workspace tier. Accepted values are - premium, standard. The default is premium.

-e

Enables/disables SSL for Databricks sensor and agent.

Valid values: true, false.

Default: false.

-c

(Optional) Enables/disables SSL connections to Unravel endpoints without certificates. This option is only in effect if -e is set to true.

Valid values: true, false.

Default: false.

-v

(Optional) Spark version to be used.

Default: 2.3.

-d

(Optional) Enables debug logs for Unravel Databricks sensor installation.

Default: false.

-m

(Optional) Specifies the frequency in seconds in which to poll cluster metrics.

Default: 30.

--print-spark-conf | -p

Print the minimal Spark configuration required to monitor cluster using Unravel.

-u

Unravel server URL.

For example, 0.0.0.1:4043

-e

Enables/disables SSL for Databricks sensor and agent.

Valid values: true, false.

Default: false.

-c

(Optional) Enables/disables SSL connections to Unravel endpoints without certificates. This option is only in effect if -e is set to true.

Valid values: true, false.

Default: false.

-v

(Optional) Spark version to be used. Default: 2.3.

--help | -h

Prints the usage of this script.