Renaming payload fails for Fluentd Monasca config

Bug #1830184 reported by Doug Szumski
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla-ansible
Fix Released
Medium
Doug Szumski
Rocky
Fix Released
Medium
Unassigned
Stein
Fix Released
Medium
Unassigned
Train
Fix Released
Medium
Doug Szumski

Bug Description

In 00-record-transformer.conf the following snippet is used to rename the `Payload` field to `message` for the Fluentd Monasca output plugin:

```
<filter *.**>
  @type record_transformer
  #enable_ruby true
  <record>
    message ${record["Payload"]}
  </record>
  remove_keys Payload
</filter>
```

The problem is that when the `Payload` key is removed, the `message` field is also removed, likely due to a shallow copy. If the line to remove the `Payload` field is removed, the `message` field is send to Monasca with the contents of the log message, as expected, however it also contains the `Payload` field.

Doug Szumski (dszumski)
Changed in kolla-ansible:
assignee: nobody → Doug Szumski (dszumski)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (master)

Fix proposed to branch: master
Review: https://review.opendev.org/660990

Changed in kolla-ansible:
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/stein)

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/661018

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to kolla-ansible (stable/rocky)

Fix proposed to branch: stable/rocky
Review: https://review.opendev.org/661025

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/stein)

Reviewed: https://review.opendev.org/661018
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=a5cd622396700ff995d5fa7f70ff5bdeb2156013
Submitter: Zuul
Branch: stable/stein

commit a5cd622396700ff995d5fa7f70ff5bdeb2156013
Author: Doug Szumski <email address hidden>
Date: Thu May 23 12:03:14 2019 +0100

    Set log message field name in Monasca Fluentd plugin

    Let the Monasca Fluentd output plugin handle mapping of the log
    message.

    Change-Id: I4a74a91b9b38d5c172397a7e7204e626bcedcfac
    Closes-Bug: #1830184
    Depends-On: https://review.opendev.org/#/c/660988/

tags: added: in-stable-stein
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (stable/rocky)

Reviewed: https://review.opendev.org/661025
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=2ee13e179ffdac4ddc199e2d4d35ef8b18fcfb29
Submitter: Zuul
Branch: stable/rocky

commit 2ee13e179ffdac4ddc199e2d4d35ef8b18fcfb29
Author: Doug Szumski <email address hidden>
Date: Thu May 23 12:03:14 2019 +0100

    Set log message field name in Monasca Fluentd plugin

    Let the Monasca Fluentd output plugin handle mapping of the log
    message.

    Change-Id: I4a74a91b9b38d5c172397a7e7204e626bcedcfac
    Closes-Bug: #1830184
    Depends-On: https://review.opendev.org/#/c/660988/
    (cherry picked from commit a5cd622396700ff995d5fa7f70ff5bdeb2156013)

tags: added: in-stable-rocky
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to kolla-ansible (master)

Reviewed: https://review.opendev.org/660990
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=0351ec2e626301ce8bc9970a8da9bdf8bc7616d9
Submitter: Zuul
Branch: master

commit 0351ec2e626301ce8bc9970a8da9bdf8bc7616d9
Author: Doug Szumski <email address hidden>
Date: Thu May 23 12:03:14 2019 +0100

    Set log message field name in Monasca Fluentd plugin

    Let the Monasca Fluentd output plugin handle mapping of the log
    message.

    Change-Id: I4a74a91b9b38d5c172397a7e7204e626bcedcfac
    Closes-Bug: #1830184
    Depends-On: https://review.opendev.org/#/c/660988/

Changed in kolla-ansible:
status: In Progress → Fix Released
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 7.1.1

This issue was fixed in the openstack/kolla-ansible 7.1.1 release.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 8.0.0.0rc2

This issue was fixed in the openstack/kolla-ansible 8.0.0.0rc2 release candidate.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix included in openstack/kolla-ansible 9.0.0.0rc1

This issue was fixed in the openstack/kolla-ansible 9.0.0.0rc1 release candidate.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.