- Home
- Work-in-Progress Documentation
- Reference Guide
- Unravel Properties reference
- Small files and file reports
Small files and file reports
Property/Description | Set by user | Unit | Default |
|---|---|---|---|
com.unraveldata.ngui.sfhivetable.schedule.interval Frequency, in days, in which to trigger FSimage extraction, for example, every 3 days The scheduler schedules extraction relative to the 1st of the month and then sets each extraction such that it 1st, 1st + X days, 1st + 2X days until 1st + nX days crosses into the next month, at which point the schedule resets to the 1st. See below for an example. Format: | day | 1d | |
com.unraveldata.ngui.sfhivetable.schedule.time Specify the time to download in hours (using 24 hour time) the FSimage. Format: two digits between 00 and 23. | two digits (set member) | 00 |
Note
You must restart the unravel_ondemand and unravel_ngui daemons for any configuration changes to take effect. Execute the following commands:
<Unravel installation directory>/unravel/manager restart unravel_ngui <Unravel installation directory>/unravel/manager restart unravel_ondemand
Property/Description | Set by user | Unit | Default |
|---|---|---|---|
unravel.python.reporting.files.disable Enables or disables Unravel ability to generate Small Files and File Reports. Note
| boolean | false | |
unravel.python.reporting.files.hive.database Hive Database where Ondemand creates five Hive tables (four temporary, one permanent) for Small Files/File Reports. When not set, tables are created in the default Hive Database. In addition, the Hive queries used for this feature run against the default MR queue. It must point to a valid Hive database. | string | default database | |
unravel.python.reporting.files.hive.mr.queue The Hive queries ran by the Ondemand process run against this MR queue. It must point to a valid MR queue. | string | default |
Note
These are global properties that apply to both Small Files Report and File Reports. They each have equivalent "local" properties. The "local" property takes precedence over the equivalent global property.
Should you unset/delete any of the below properties and their equivalent properties in Small Files Report or Files Report, Unravel has hard-coded values to ensure your reports are generated.
Property/Description | Set by user | Unit | Default |
|---|---|---|---|
unravel.python.reporting.files.files.use.avg.file.size_flag
| Optional | boolean | - |
unravel.python.reporting.files.min.parent.dir.depth Directory depth to end the search at. For instance, if depth=2, a directory having depth more than or equal to 2 can be included in the report. Thus a directory such as | Optional | count | - |
unravel.python.reporting.files.max.parent.dir.depth Directory depth to end search at. The maximum is 50. For instance, if depth=5, a directory having a depth less than or equal to 5 can be included in the report. Thus a directory, for example, | Optional | count | - |
unravel.python.reporting.drill.down.subdirs.flag Determines to which ancestor directories a filesize is accounted for. If this is True then the file size is accounted for all ancestor directories. If this is False the file size is accounted for only the parent directory.
For example, given a file under a directory /one/two/three. when when /one - lists files in one. /one/two - lists files in /one/two. true: / - lists files in /, /one, and /one/two. /one - lists files in /one, and /one/two. /one/two - lists files in /one/two. | Optional | boolean | true |