Home

v4.5.2.x - Upgrade instructions

You can only upgrade from 4.5.0.5 or 4.5.2.x otherwise you must do a fresh installation.

Upgrade/Fresh installation

Unravel supports WASB, ADL Gen1, and ABFS storage. You must define the following properties based upon your storage type. If you are upgrading from 4.5.2.x using WASB storage you have already defined the WASB properties.

Upgrade - WASB

Property

Replace with

Where to find the value

com.unraveldata.hdinsight.storage-account.X

com.unraveldata.azure.storage.wasb.account-name.X

Name of the WASB storage account that the HDInsight cluster uses.

You must define this property for each WASB storage account.X. X=1 for the first storage account and the is incremented by one for each new account, that is, account numbers must be consecutive.

  • Go to Azure portal.

  • Go to HDInsight Clusters.

  • Select the cluster.

  • Click on Storage accounts.

You can just use the account name, without adding the suffix ‘.blob.core.windows.net’. However, adding that would also work.

com.unraveldata.hdinsight.access-key.X

com.unraveldata.azure.storage.wasb.access-key.X

  • Go to Azure portal.

  • Go to Storage accounts.

  • Select the storage account.

  • Go to Access keys.

  • Use one of them.

Upgrade - ADL GEN1

Property

Replacement

Where to find the value

com.unraveldata.adl.accountFQDN

com.unraveldata.azure.storage.adl.account-name.X

The Azure Data Lake Gen1 storage account. The name does not need to be fully qualified. For instance, you can use mydatalake or mydatalake.azuredatalakestore.net.

You must define this property for each storage account. X starts with 1 and then is incremented by 1 for each additional account. The account numbers must be consecutive.

  • Go to Azure portal.

  • Go to HDInsight Clusters.

  • Select the cluster.

  • Click on Storage accounts.

You can just use the account name, without adding the suffix ‘.blob.core.windows.net’. However, adding that would also work.

com.unraveldata.adl.clientId

com.unraveldata.azure.storage.adl.client-id.X

An application ID. An application registration has to be created in the Azure Active Directory.

  • Go to Azure portal.

  • Go to Azure Active Directory.

  • Click on App registrations.

  • Select the application.

  • Get Application (client) ID in Overview.

com.unraveldata.adl.clientKey

com.unraveldata.azure.storage.adl.client-key.X

An application's "secret" (key) described in the ADL Gen1 client-id field.

  • Go to Azure portal.

  • Go to Azure Active Directory.

  • Click on App registrations.

  • Select the application.

  • Click on Certificates and secrets.

  • Click New client secret. Follow the instructions to add a client secret. Copy the secret at the end.

com.unraveldata.adl.accessTokenEndpoint

com.unraveldata.azure.storage.adl.access-token-endpoint.X

The OAUTH 2.0 Access Token Endpoint. It is obtained from the application registration tab on Azure portal.

  • Go to Azure portal.

  • Go to Azure Active Directory.

  • Click on App registrations.

  • Select the application.

  • Click on Endpoints.

  • Select the value for OAuth2.0 token endpoint (v1).

com.unraveldata.adl.clientRootPath

No replacement as no longer needed

Upgrade - ABFS

Property

Where to find the value

com.unraveldata.azure.storage.abfs.account-name.X

Name of the ABFS storage account that the HDInsight cluster uses.

You must define this property for each ABFS storage account.X. X=1 for the first storage account and then is incremented by one for each new account, that is, account numbers must be consecutive.

Format: string

  • Go to Azure portal.

  • Go to HDInsight Clusters.

  • Select the cluster.

  • Click on Storage accounts.

In 4.5.2.0, you can just use the account name, without adding the suffix ‘.dfs.core.windows.net’. However, adding that would also work.

com.unraveldata.azure.storage.abfs.access-key.X

The access key for the corresponding ABFS storage account.

Format: string

  • Go to Azure portal.

  • Go to Storage accounts.

  • Select the storage account.

  • Go to Access keys.

  • Use one of them.

In 4.5.2.0, you can just use the account name, without adding the suffix ‘.dfs.core.windows.net’. However, adding that would also work.

For support issues, contact Unravel Support.

In this section: