Data Retention

All data stored in MONIT must comply with CERN's data privacy and data retention policies:

• Data Privacy Policy
• Data Retention Policy

HDFS

Data stored in HDFS (logs and metrics) is kept by default for 13 months.

Longer retention policies are allowed but must follow the “exception” procedure:

1. Open a SNOW ticket to MONIT requesting a new exception
2. Specify the new desired data retention (in months)
3. Make sure all data older than 13 months do not contain personal data
4. The request is forwarded to the corresponding Service Owner for approval
5. Once the request is approved the new data retention is set

This retention policy was announced in the following SSB entries:

• for logs: OTG0056808
• for metrics: OTG0062990

OpenSearch

Data stored in OpenSearch (logs and metrics) is kept by default for 1 month.

Longer retention policies are possible under these exceptions

Mimir

Data stored in Mimir is configured with a default retention policy of 40d. Longer retention policies are possible in the case of the user providing already pre-aggregated metrics or low volume.