Data Retention

All data stored in MONIT must comply with CERN's data privacy and data retention policies:

• Data Privacy Policy
• Data Retention Policy

HDFS

Data stored in HDFS (logs and metrics) is kept by default for 13 months.

Longer retention policies are allowed but must follow the “exception” procedure:

1. Open a SNOW ticket to MONIT requesting a new exception
2. Specify the new desired data retention (in months)
3. Make sure all data older than 13 months do not contain personal data
4. The request is forwarded to the corresponding Service Owner for approval
5. Once the request is approved the new data retention is set

This retention policy was announced in the following SSB entries:

• for logs: OTG0056808
• for metrics: OTG0062990

OpenSearch

Data stored in ES (logs and metrics) is kept by default for 1 month.

For metrics data, longer retention policies are possible under these exceptions:

• <13 months retention: selected metrics produced by WLCG and Experiments (when requested)
• >13 months retention: aggregated metrics produced by MONIT not containing personal data