Overview
Retention policies control how long XIMP stores metric, log, and flow data. Longer retention enables deeper historical analysis and incident review; shorter retention reduces storage costs. Downsampled metric retention provides long-term trend data at a fraction of the storage cost of raw metrics.Prerequisites
- Administrator credentials with the
adminrole - Confirmation from compliance and operations teams on required retention periods before reducing existing values
Recommended Retention Settings
| Data Type | Recommended Retention | Storage Impact | Notes |
|---|---|---|---|
| Metrics (raw, 30s resolution) | 30 days | ~2 GB per node per month | Full resolution for recent incidents |
| Metrics (5-min downsampled) | 1 year | ~200 MB per node per month | Medium-term trend analysis |
| Metrics (1-hour downsampled) | 3 years | ~20 MB per node per month | Long-term capacity planning |
| Logs | 90 days | Varies by log verbosity | Incident review and audit |
| Flow data | 30 days | ~5 GB per Gbps per month | Network forensics |
Configuring Retention
- Dashboard
- CLI
Navigate to Monitoring → Administration → Retention Policies and configure
retention for each data type.
- Select the data type (Metrics Raw, Metrics Downsampled, Logs, Flows)
- Enter the retention duration (e.g.,
30d,90d,1y) - Click Apply
Downsampling Configuration
Downsampling aggregates raw metric points into lower-resolution summaries at configurable intervals. This enables long-term retention at a fraction of the storage cost.| Downsampling Level | Resolution | Applied After | Storage vs Raw |
|---|---|---|---|
| Level 1 | 5 minutes | 7 days | ~10× reduction |
| Level 2 | 1 hour | 30 days | ~120× reduction |
Downsampled data retains statistical aggregates: min, max, sum, count, and average.
Exact per-second values are not recoverable after the raw data retention period expires.
Ensure raw retention is long enough for the typical incident investigation window.
Compliance Retention Requirements
For regulatory compliance, consult the following minimum retention guidelines:| Regulation | Minimum Log Retention | Notes |
|---|---|---|
| ISO 27001 | 1 year | Security events and access logs |
| SOC 2 Type II | 1 year | Covers audit period plus review buffer |
| PCI DSS | 1 year (3 months online) | Transaction-related system logs |
| HIPAA | 6 years | Healthcare system access logs |
Next Steps
Log Collection
Control log ingestion volume by configuring which services are collected
Architecture
Understand storage layer sizing for your retention requirements
Security
Access controls for retention policy management
Troubleshooting
Diagnose storage pressure caused by high-cardinality metrics or high log volume