Skip to main content

Snowflake Documentation

Data retention time

You can set the database retention time and the Elasticsearch storage retention time using the Manager service.

When changing these settings, remember that long retention requires significant disk space. As a rule of thumb, each map-reduce or Spark job requires about 1 MB of disk space; you can store approximately 1000 jobs per 1 GB of disk.

  • Setting Database retention time

    1. Stop Unravel

      <Unravel installation directory>/unravel/manager stop

    2. Run the following command:

      <Unravel installation directory>/unravel/manager config set retention database <Database retention in days>

##For example:
<Unravel installation directory>/unravel/manager config set retention database 30

      Important

      Ensure to specify the retention period in days.

    3. Apply the changes.

      <Unravel installation directory>/unravel/manager config apply

    4. Start Unravel

      <Unravel installation directory>/unravel/manager start

  • Setting Elasticsearch storage retention time

    1. Stop Unravel

      <Unravel installation directory>/unravel/manager stop

    2. Run the following command:

      <Unravel installation directory>/unravel/manager config set retention elasticsearch <Elasticsearch retention in weeks>

##For example:
<Unravel installation directory>/unravel/manager config set retention elasticsearch 5

      Important

      Ensure to specify the retention period in weeks.

    3. Apply the changes.

      <Unravel installation directory>/unravel/manager config apply

    4. Start Unravel

      <Unravel installation directory>/unravel/manager start
In this section: