haproxy and swift logs are not rotated

Bug #1940118 reported by Isaac Prior
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
kolla-ansible
Fix Released
Medium
Unassigned

Bug Description

Fluent writes haproxy and swift logs to /var/log/kolla/{haproxy,swift} - they are rotated and compressed but never deleted. This slowly fills the hosts filesystem and causes further problems.

Tested with CentOS8, kolla-ansible stable/train and td-agent 1.11.5 but confirmed applicable to all kolla-ansible releases since fluentd was added.

Changed in kolla-ansible:
status: New → In Progress
Mark Goddard (mgoddard)
Changed in kolla-ansible:
importance: Undecided → Medium
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (master)

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/797900
Committed: https://opendev.org/openstack/kolla-ansible/commit/79b59e2c0b43936a12a9c676d8a48cd62c733a0f
Submitter: "Zuul (22348)"
Branch: master

commit 79b59e2c0b43936a12a9c676d8a48cd62c733a0f
Author: Isaac Prior <email address hidden>
Date: Thu Jun 24 14:12:48 2021 +0100

    Fix log rotation for fluentd created files

    Overrides default fluentd buffer config to stop log files from using
    datestamped filenames, allowing logrotate to manage them.

    Closes-Bug: #1940118
    Change-Id: I40c4e209470d21e0a02fd447fb628acfdae9fa9d

Changed in kolla-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/xena)

Fix proposed to branch: stable/xena
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/828404

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/wallaby)

Fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/828405

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/victoria)

Fix proposed to branch: stable/victoria
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/828406

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/xena)

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/828404
Committed: https://opendev.org/openstack/kolla-ansible/commit/a763f586b652a30d55e8d94a4e0dfef4bffeb9d7
Submitter: "Zuul (22348)"
Branch: stable/xena

commit a763f586b652a30d55e8d94a4e0dfef4bffeb9d7
Author: Isaac Prior <email address hidden>
Date: Thu Jun 24 14:12:48 2021 +0100

    Fix log rotation for fluentd created files

    Overrides default fluentd buffer config to stop log files from using
    datestamped filenames, allowing logrotate to manage them.

    Closes-Bug: #1940118
    Change-Id: I40c4e209470d21e0a02fd447fb628acfdae9fa9d
    (cherry picked from commit 79b59e2c0b43936a12a9c676d8a48cd62c733a0f)

tags: added: in-stable-xena
tags: added: in-stable-wallaby
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/wallaby)

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/828405
Committed: https://opendev.org/openstack/kolla-ansible/commit/b33c6fa91a72cd6ae8631819ee7ac229e631f595
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit b33c6fa91a72cd6ae8631819ee7ac229e631f595
Author: Isaac Prior <email address hidden>
Date: Thu Jun 24 14:12:48 2021 +0100

    Fix log rotation for fluentd created files

    Overrides default fluentd buffer config to stop log files from using
    datestamped filenames, allowing logrotate to manage them.

    Closes-Bug: #1940118
    Change-Id: I40c4e209470d21e0a02fd447fb628acfdae9fa9d
    (cherry picked from commit 79b59e2c0b43936a12a9c676d8a48cd62c733a0f)

tags: added: in-stable-victoria
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/victoria)

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/828406
Committed: https://opendev.org/openstack/kolla-ansible/commit/aaa56405d33656104fd7b1972b3688bd4aadd95f
Submitter: "Zuul (22348)"
Branch: stable/victoria

commit aaa56405d33656104fd7b1972b3688bd4aadd95f
Author: Isaac Prior <email address hidden>
Date: Thu Jun 24 14:12:48 2021 +0100

    Fix log rotation for fluentd created files

    Overrides default fluentd buffer config to stop log files from using
    datestamped filenames, allowing logrotate to manage them.

    Closes-Bug: #1940118
    Change-Id: I40c4e209470d21e0a02fd447fb628acfdae9fa9d
    (cherry picked from commit 79b59e2c0b43936a12a9c676d8a48cd62c733a0f)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 14.0.0.0rc1

This issue was fixed in the openstack/kolla-ansible 14.0.0.0rc1 release candidate.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 11.4.0

This issue was fixed in the openstack/kolla-ansible 11.4.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 12.4.0

This issue was fixed in the openstack/kolla-ansible 12.4.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 13.1.0

This issue was fixed in the openstack/kolla-ansible 13.1.0 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.