Data insights
Property/Description | Set by user | Unit | Default |
|---|---|---|---|
com.unraveldata.datainsights.get.dfs.size Toggles the size calculations for tables and partitions in Data Insights. true: calculates the table and partition sizes. | boolean | true | |
com.unraveldata.datapage.batchsize The record number to retrieve in a batch from the database for the Data Insights Details page. Range: 100000 ≤ value ≥ 400000. | range | 300000 | |
com.unraveldata.fsimage.updates.dfs.size true: Fsimage is used to calculate sizes for Table and Partition which then populate Data Insights Table and Partition size information. As of now, this calculation is restricted to Managed Table and Partitions, i.e., those paths which are under Hive warehouse directory. This property takes precedence over com.unraveldata.hdfs.connector.updates.dfs.size. NoteIf set to true, and Hive Metastore and Small Files Report accesses are configured correctly, then no other configuration is required for FSimage to upload partition/table size info to the Data Page | boolean | true | |
com.unraveldata.hdfs.connector.updates.dfs.size Unravel will only try to fetch the sizes from HDFS if it is unable to fetch the information from Small Files. true: tries to get table and partition sizes from HDFS API/CLI (hdfs dus). | boolean | true |