fluentd is configured to log to stdout

Bug #1888852 reported by Michal Nasiadka
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla-ansible
Fix Released
Medium
Michal Nasiadka
Stein
Won't Fix
Medium
Unassigned
Train
Fix Released
Medium
Unassigned
Ussuri
Fix Released
Medium
Unassigned
Victoria
Fix Released
Medium
Michal Nasiadka

Bug Description

Fluentd is configured to log to stdout, which is effectively a json file (unless using different log driver) in /var/lib/docker.
This causes:
1) Big and long log file on long-running deploys
2) Hard to read older logs, no log rotation in place (besides docker daemon log truncation)
3) Hard to find real problems with fluentd (stderr and stdout in one JSON file)

Changed in kolla-ansible:
assignee: nobody → Michal Nasiadka (mnasiadka)
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (master)

Reviewed: https://review.opendev.org/742663
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=696533f22883d0b23f4a428dbdf5e22f3f1910ea
Submitter: Zuul
Branch: master

commit 696533f22883d0b23f4a428dbdf5e22f3f1910ea
Author: Michal Nasiadka <email address hidden>
Date: Thu Jul 23 15:22:41 2020 +0200

    fluentd: log to a file instead of stdout

    fluentd logs currently to stdout, which is known to produce big docker logs
    in /var/lib/docker. This change makes fluentd to log to /var/log/kolla/fluentd.

    Closes-Bug: #1888852
    Change-Id: I8fe0e54cb764a26d26c6196cef68aadc6fd57b90

Changed in kolla-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/ussuri)

Fix proposed to branch: stable/ussuri
Review: https://review.opendev.org/743456

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/train)

Fix proposed to branch: stable/train
Review: https://review.opendev.org/743457

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/stein)

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/743458

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on kolla-ansible (stable/stein)

Change abandoned by Michal Nasiadka (<email address hidden>) on branch: stable/stein
Review: https://review.opendev.org/743458

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/train)

Reviewed: https://review.opendev.org/743457
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=9648a0aa461e93da36cfe2f63b1f8d184bead8c0
Submitter: Zuul
Branch: stable/train

commit 9648a0aa461e93da36cfe2f63b1f8d184bead8c0
Author: Michal Nasiadka <email address hidden>
Date: Thu Jul 23 15:22:41 2020 +0200

    fluentd: log to a file instead of stdout

    fluentd logs currently to stdout, which is known to produce big docker logs
    in /var/lib/docker. This change makes fluentd to log to /var/log/kolla/fluentd.

    Closes-Bug: #1888852
    Change-Id: I8fe0e54cb764a26d26c6196cef68aadc6fd57b90
    (cherry picked from commit 696533f22883d0b23f4a428dbdf5e22f3f1910ea)

tags: added: in-stable-train
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/ussuri)

Reviewed: https://review.opendev.org/743456
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=9a38592ebff44181b518bd40072ce2007d3893fc
Submitter: Zuul
Branch: stable/ussuri

commit 9a38592ebff44181b518bd40072ce2007d3893fc
Author: Michal Nasiadka <email address hidden>
Date: Thu Jul 23 15:22:41 2020 +0200

    fluentd: log to a file instead of stdout

    fluentd logs currently to stdout, which is known to produce big docker logs
    in /var/lib/docker. This change makes fluentd to log to /var/log/kolla/fluentd.

    Closes-Bug: #1888852
    Change-Id: I8fe0e54cb764a26d26c6196cef68aadc6fd57b90
    (cherry picked from commit 696533f22883d0b23f4a428dbdf5e22f3f1910ea)

tags: added: in-stable-ussuri
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 10.2.0

This issue was fixed in the openstack/kolla-ansible 10.2.0 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 9.3.0

This issue was fixed in the openstack/kolla-ansible 9.3.0 release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.