RabbitMQ logs are not being collected by Fluentd

[Doug Szumski]

The following report is based on a Centos deployment.

On Rocky:

* RabbitMQ log name defaults to `<email address hidden>`. The hostname is included by default because the log file name is not set in the Rabbit config. Fluentd is set to ingest the RabbitMQ log from `rabbit.log`, so it is never picked up.

* When the Fluentd config is fixed so that the log is ingested the pattern matching is broken, and Fluentd spits out parsing errors.

* We don't collect the SASL log

In Stein:

RabbitMQ is upgraded to 3.7.10 from 3.6.5

* The same issue with log file naming as in Rocky exists.

* The SASL log (which is not ingested in Rocky) becomes part of the main RabbitMQ log and the log format changes.

* An upgrade log now exists

* Crash logs now exist

The expected behaviour is at the very least Fluentd should ingest the main rabbitmq log so that we can alert on failures.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/692976

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/692976
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=bf979282a1bf31a4897e007589e029ba92d2b40a
Submitter: Zuul
Branch: master

commit bf979282a1bf31a4897e007589e029ba92d2b40a
Author: lklimin <email address hidden>
Date: Tue Nov 5 13:44:13 2019 +0300

    Collect rabbitmq logs by fluentd

    Change-Id: I49b24545501085d5a44f4de73f0c6dd21e06e2a0
    Closes-Bug: #1835501

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/train
Review: https://review.opendev.org/693764

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/stein
Review: https://review.opendev.org/693783

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/693764
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=a33d86c67652d5426c8b5079c06c17afb586dd02
Submitter: Zuul
Branch: stable/train

commit a33d86c67652d5426c8b5079c06c17afb586dd02
Author: lklimin <email address hidden>
Date: Tue Nov 5 13:44:13 2019 +0300

    Collect rabbitmq logs by fluentd

    Change-Id: I49b24545501085d5a44f4de73f0c6dd21e06e2a0
    Closes-Bug: #1835501
    (cherry picked from commit bf979282a1bf31a4897e007589e029ba92d2b40a)

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/rocky
Review: https://review.opendev.org/694275

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/693783
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=7d11946439a06bf04b40960650a4b649eedf04e1
Submitter: Zuul
Branch: stable/stein

commit 7d11946439a06bf04b40960650a4b649eedf04e1
Author: lklimin <email address hidden>
Date: Tue Nov 5 13:44:13 2019 +0300

    Collect rabbitmq logs by fluentd

    Change-Id: I49b24545501085d5a44f4de73f0c6dd21e06e2a0
    Closes-Bug: #1835501
    (cherry picked from commit bf979282a1bf31a4897e007589e029ba92d2b40a)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 9.0.0.0rc2 release candidate.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 7.2.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 8.1.0 release.