Brief Description
-----------------
The distributed cloud logs (/var/log/dcmanager/dcmanager.log and /var/log/dcmanager/audit.log) are rotating out in less than one day when 200 subclouds are configured. This will make debugging customer issues extremely difficult as the logs may no longer exist when they are collected.
Severity
--------
Major: System/Feature is usable but degraded
Steps to Reproduce
------------------
Install a distributed cloud system with 200 subclouds.
Expected Behavior
-----------------
In normal conditions, the system should retain two weeks of logs.
Actual Behavior
---------------
Less than a day of distributed cloud logs are being retained.
Reproducibility
---------------
Reproducible
System Configuration
--------------------
Distributed Cloud
Branch/Pull Time/Commit
-----------------------
SW_VERSION="21.05"
BUILD_TARGET="Host Installer"
BUILD_TYPE="Formal"
BUILD_ID="2021-05-05_20-00-10"
SRC_BUILD_ID="20"
BUILD_DATE="2021-05-05 20:02:01 -0400"
Last Pass
---------
Unknown
Timestamp/Logs
--------------
[root@controller-0 dcmanager(keystone_admin)]# ll
total 34252
drwxr-xr-x 2 root root 24576 May 8 12:31 ansible
rw-r---- 1 root root 1244263 May 10 18:07 audit.log
rw-r---- 1 root root 707391 May 10 11:52 audit.log.10.gz
rw-r---- 1 root root 704436 May 10 11:11 audit.log.11.gz
rw-r---- 1 root root 720434 May 10 10:30 audit.log.12.gz
rw-r---- 1 root root 704373 May 10 09:48 audit.log.13.gz
rw-r---- 1 root root 721350 May 10 09:07 audit.log.14.gz
rw-r---- 1 root root 699986 May 10 08:25 audit.log.15.gz
rw-r---- 1 root root 702828 May 10 07:44 audit.log.16.gz
rw-r---- 1 root root 699267 May 10 07:02 audit.log.17.gz
rw-r---- 1 root root 702918 May 10 06:21 audit.log.18.gz
rw-r---- 1 root root 701166 May 10 05:40 audit.log.19.gz
rw-r---- 1 root root 705920 May 10 18:02 audit.log.1.gz
rw-r---- 1 root root 704129 May 10 04:59 audit.log.20.gz
rw-r---- 1 root root 702416 May 10 17:21 audit.log.2.gz
rw-r---- 1 root root 708640 May 10 16:40 audit.log.3.gz
rw-r---- 1 root root 720314 May 10 15:59 audit.log.4.gz
rw-r---- 1 root root 700632 May 10 15:17 audit.log.5.gz
rw-r---- 1 root root 704501 May 10 14:36 audit.log.6.gz
rw-r---- 1 root root 697963 May 10 13:55 audit.log.7.gz
rw-r---- 1 root root 705210 May 10 13:14 audit.log.8.gz
rw-r---- 1 root root 700696 May 10 12:33 audit.log.9.gz
rw-r---- 1 root root 10000278 May 10 18:07 dcmanager.log
rw-r---- 1 root root 469352 May 10 07:54 dcmanager.log.10.gz
rw-r---- 1 root root 453641 May 10 06:52 dcmanager.log.11.gz
rw-r---- 1 root root 455146 May 10 05:50 dcmanager.log.12.gz
rw-r---- 1 root root 478895 May 10 04:48 dcmanager.log.13.gz
rw-r---- 1 root root 450988 May 10 03:46 dcmanager.log.14.gz
rw-r---- 1 root root 448862 May 10 02:44 dcmanager.log.15.gz
rw-r---- 1 root root 462944 May 10 01:43 dcmanager.log.16.gz
rw-r---- 1 root root 451840 May 10 00:42 dcmanager.log.17.gz
rw-r---- 1 root root 464016 May 9 23:41 dcmanager.log.18.gz
rw-r---- 1 root root 445211 May 9 22:39 dcmanager.log.19.gz
rw-r---- 1 root root 445706 May 10 17:10 dcmanager.log.1.gz
rw-r---- 1 root root 520472 May 9 21:37 dcmanager.log.20.gz
rw-r---- 1 root root 453725 May 10 16:09 dcmanager.log.2.gz
rw-r---- 1 root root 458233 May 10 15:07 dcmanager.log.3.gz
rw-r---- 1 root root 474471 May 10 14:05 dcmanager.log.4.gz
rw-r---- 1 root root 451344 May 10 13:04 dcmanager.log.5.gz
rw-r---- 1 root root 452953 May 10 12:02 dcmanager.log.6.gz
rw-r---- 1 root root 464730 May 10 11:00 dcmanager.log.7.gz
rw-r---- 1 root root 465153 May 10 09:58 dcmanager.log.8.gz
rw-r---- 1 root root 466608 May 10 08:56 dcmanager.log.9.gz
rw-r---- 1 root root 357444 May 8 03:04 orchestrator.log
Test Activity
-------------
Developer Testing
Workaround
----------
None
The submission for https:/
which is this review https:/
prevents the audit from auditing too much every 30 seconds should help
Going to look at what other logs can be revised