Setting retention time in Unravel server
To adjust the retention time (time horizon), you need to set the following properties
com.unraveldata.retention.max.days: number of days to keep the heaviest data (such as error logs and drill-down details) in the SQL Database.
com.unraveldata.history.maxSize.weeks: number of weeks retained for search results in Elastic Search.
When changing these settings, be aware that long retention requires significant disk space. As a rule of thumb, each map-reduce or Spark job requires about 1 MB of disk space; you can store approximately 1000 jobs per 1 GB of disk.
Stop Unravel
<Unravel installation directory>/unravel/manager stop
Set the following properties:
For example: <Unravel installation directory>/unravel/manager config properties set com.unraveldata.retention.max.days 30 com.unraveldata.history.maxSize.weeks 5
com.unraveldata.retention.max.days is the most significant factor in controlling disk space usage in the database used by Unravel.
Apply the changes.
<Unravel installation directory>/unravel/manager config apply
Start Unravel
<Unravel installation directory>/unravel/manager start