When you install Unravel, the metastore type corresponding to your cluster type is available on the Data page for filtering purposes. Depending on the cluster type, the following metastore types are available by default:
If the cluster type is GCP, the default is bigquery and hive.
If the cluster type is BigQuery, the default is bigquery
For any other cluster type, the default is hive.
However, you can configure Unravel to list multiple types of metastore for filtering on the Data page irrespective of your cluster type. See Configure metastore types for Data page filtering.
All the clusters/workspaces in your system are available for filtering. However, you can also configure specific clusters/workspaces with metastore that you want to be listed on the Data page. See Configure Clusters/Workspace for Data page filtering
To set the metastore types on the Data page, do the following:
Stop Unravel
<Unravel installation directory>/unravel/manager stop
Set the following property.
<Unravel installation directory>/unravel/manager config properties set com.unraveldata.metastore.types
<HIVE/BIGQUERY>
For example: /opt/unravel/manager config properties set com.unraveldata.metastore.types hive,bigqueryNote
If your cluster type is not GCP, you can either set both the BigQuery and Hive (for Dataproc) or set only BigQuery or only Hive (for Dataproc) metastore types available for filtering on the Data page.
In case you want to make both BigQuery and Dataproc metastores available for filtering on the Data page, set the property as follows:
<Unravel installation directory>/unravel/manager config properties set com.unraveldata.metastore.types hive,bigquery
In case you want to make only Dataproc metastores available for filtering on the Data page, set the property as follows:
<Unravel installation directory>/unravel/manager config properties set com.unraveldata.metastore.types hive
In case you want to make only BigQuery metastores available for filtering on the Data page, set the property as follows:
<Unravel installation directory>/unravel/manager config properties set com.unraveldata.metastore.types bigquery
Apply the changes.
<Unravel installation directory>/unravel/manager config apply
Start Unravel
<Unravel installation directory>/unravel/manager start
You can set specific clusters or workspaces with metastores for Data page filtering instead of listing all the available clusters and workspaces. Do the following to set specific clusters or workspaces for Data page filtering.
Stop Unravel
<Unravel installation directory>/unravel/manager stop
Set the following property for clusters:
<Unravel installation directory>/unravel/manager config properties set com.unraveldata.datapage.cluster.names
<cluster-names>
##For example: /opt/unravel/manager config properties set com.unraveldata.datapage.cluster.names c1,c2Set the following property for workspaces:
<Unravel installation directory>/unravel/manager config properties set com.unraveldata.datapage.workspace.names
<workspace-names>
For example: /opt/unravel/manager config properties set com.unraveldata.datapage.workspace.names w1,w2Apply the changes.
<Unravel installation directory>/unravel/manager config apply
Start Unravel
<Unravel installation directory>/unravel/manager start
The clusters and workspaces with metastores that you have set will be available on the Data page for filtering.