Log paths provided to fluentd are incorrect for containerized deployment

Bug #1716427 reported by Lars Kellogg-Stedman
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Invalid
High
Unassigned

Bug Description

The existing logging configuration assumes logs are located in /var/log (paths look something like "/var/log/nova/nova-api.log", but this is incorrect in a containerized deployment. We need to either transform the path or provide a container-specific logging configuration.

tags: added: tripleo-heat-templates
tags: added: pike-backport-potential
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to puppet-tripleo (master)

Fix proposed to branch: master
Review: https://review.openstack.org/502501

Changed in tripleo:
assignee: nobody → Lars Kellogg-Stedman (larsks)
status: New → In Progress
Changed in tripleo:
milestone: none → queens-1
importance: Undecided → High
Changed in tripleo:
assignee: Lars Kellogg-Stedman (larsks) → Juan Antonio Osorio Robles (juan-osorio-robles)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to puppet-tripleo (master)

Reviewed: https://review.openstack.org/502501
Committed: https://git.openstack.org/cgit/openstack/puppet-tripleo/commit/?id=1ff0903a3950bc4adbc8c84b5153df6ca0fb6a3d
Submitter: Jenkins
Branch: master

commit 1ff0903a3950bc4adbc8c84b5153df6ca0fb6a3d
Author: Lars Kellogg-Stedman <email address hidden>
Date: Mon Sep 11 10:00:18 2017 -0600

    Allow log path transformation in fluentd glue

    Logs in a containerized deployment are not in the same location as on
    a baremetal deployment. This commit adds the $fluentd_path_transform
    paramter to the fluentd glue module. This is a regular expression that
    is used to transform log paths. To use this feature, include in your
    hiera configuration something like:

        tripleo::profile::base::logging::fluentd::fluentd_path_transform:
          - /var/log/
          - /var/log/containers/

    Change-Id: I585b6877074353b5de62e5efaabfbe62432c473d
    Partial-bug: #1716427

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to puppet-tripleo (stable/pike)

Fix proposed to branch: stable/pike
Review: https://review.openstack.org/507494

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to puppet-tripleo (stable/pike)

Reviewed: https://review.openstack.org/507494
Committed: https://git.openstack.org/cgit/openstack/puppet-tripleo/commit/?id=265a13a8e5166ca4cd4cecbf64cb8229e3dcd106
Submitter: Jenkins
Branch: stable/pike

commit 265a13a8e5166ca4cd4cecbf64cb8229e3dcd106
Author: Lars Kellogg-Stedman <email address hidden>
Date: Mon Sep 11 10:00:18 2017 -0600

    Allow log path transformation in fluentd glue

    Logs in a containerized deployment are not in the same location as on
    a baremetal deployment. This commit adds the $fluentd_path_transform
    paramter to the fluentd glue module. This is a regular expression that
    is used to transform log paths. To use this feature, include in your
    hiera configuration something like:

        tripleo::profile::base::logging::fluentd::fluentd_path_transform:
          - /var/log/
          - /var/log/containers/

    Change-Id: I585b6877074353b5de62e5efaabfbe62432c473d
    Partial-bug: #1716427
    (cherry picked from commit 1ff0903a3950bc4adbc8c84b5153df6ca0fb6a3d)

tags: added: in-stable-pike
Changed in tripleo:
milestone: queens-1 → queens-2
Changed in tripleo:
milestone: queens-2 → queens-3
Changed in tripleo:
assignee: Juan Antonio Osorio Robles (juan-osorio-robles) → Juan Badia Payno (jbadiapa)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to puppet-tripleo (master)

Reviewed: https://review.openstack.org/530780
Committed: https://git.openstack.org/cgit/openstack/puppet-tripleo/commit/?id=c1ba5f7316167179685a3bcfcc1399a2817767a3
Submitter: Zuul
Branch: master

commit c1ba5f7316167179685a3bcfcc1399a2817767a3
Author: Juan Badia Payno <email address hidden>
Date: Tue Jan 2 18:33:50 2018 +0100

    Fluentd: Transform path by service

    Currently, the configuration delivered via
    service_config_settings does not provide the
    transformation path regarding the logs for
    containerized deployments. So logs are not
    correctly configured on fluentd on containerized
    deployments.

    This path added this feature so the logs are
    properly located on fluentd configuration.

    Added unit test for this issue

    Partial-bug: #1715187
    Partial-bug: #1716427
    Change-Id: Ie7df4b8b94cb0ae38096ab95800f211ef1cd8455

Changed in tripleo:
milestone: queens-3 → queens-rc1
Changed in tripleo:
milestone: queens-rc1 → rocky-1
Changed in tripleo:
milestone: rocky-1 → rocky-2
Changed in tripleo:
milestone: rocky-2 → rocky-3
Changed in tripleo:
assignee: Juan Badia Payno (jbadiapa) → nobody
status: In Progress → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.