nova-placement api glance and cinder logs not showing in kibana

[kamal saurabh]

I am not able to discover logs in kibana with the following programname
cinder-volume
cinder-api
cinder-backup
cinder-scheduler
cinder-volume

I looked at elasticsearch documents also, cinder* related documents are not there. So i am guessing fluentd
is not publishing to elastic search.

Found these recent changes, to add filter, I added entries related to cinder in this file,

 https://github.com/openstack/kolla-ansible/tree/master/ansible/roles/common/templates/conf/filter

like so,
rewriterule14 programname ^(cinder-api|cinder-backup|cinder-scheduler|cinder-volume).* openstack_python

I see the following message appear in docker logs fluentd

2017-03-14 14:27:38 +0000 [info]: #0 adding rewrite_tag_filter rule: rewriterule14 ["programname", /^(cinder-api|cinder-backup|cinder-scheduler|cinder-volume).*/, "", "openstack_python"]
    rewriterule14 programname ^(cinder-api|cinder-backup|cinder-scheduler|cinder-volume).* openstack_python
2017-03-14 14:27:38 +0000 [info]: #0 following tail of /var/log/kolla/cinder/cinder-manage.log
2017-03-14 14:27:38 +0000 [info]: #0 following tail of /var/log/kolla/cinder/cinder-api.log
2017-03-14 14:27:38 +0000 [info]: #0 following tail of /var/log/kolla/cinder/cinder-scheduler.log
2017-03-14 14:27:38 +0000 [info]: #0 following tail of /var/log/kolla/cinder/cinder-volume.log
2017-03-14 14:27:38 +0000 [info]: #0 following tail of /var/log/kolla/cinder/cinder-backup.log

BUT still no documents being pushed to elastic search and consequently logs not showing up in kibana

[Satya Sanjibani Routray (satroutr)]

currentlu glance and nova placement api logs are also missing

[Satya Sanjibani Routray (satroutr)]

currentlu -> currently

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/446078

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/446078
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=b586f41967232ce28d2e7d20260abb2a097a4061
Submitter: Jenkins
Branch: master

commit b586f41967232ce28d2e7d20260abb2a097a4061
Author: satya <email address hidden>
Date: Wed Mar 15 22:45:54 2017 +0530

    Implement Cinder, Nova Placement and mistral logs for kibana

    Nova placement api, cinder api, volume logs along with mistral logs
    are missing from the filter which will allow elastic search to fetch it
    from the fluentd

    Fixes the issue

    Change-Id: I7899ce6e010bfc6534a88f0a2117dc0a9e60c7c7
    Closes-Bug: #1673002

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/461937
Committed: https://git.openstack.org/cgit/openstack/kolla-ansible/commit/?id=2fb737385f0c86ca7ec8b84cc9bc7615979a927a
Submitter: Jenkins
Branch: stable/ocata

commit 2fb737385f0c86ca7ec8b84cc9bc7615979a927a
Author: satya <email address hidden>
Date: Wed Mar 15 22:45:54 2017 +0530

    Implement Cinder, Nova Placement and mistral logs for kibana

    Nova placement api, cinder api, volume logs along with mistral logs
    are missing from the filter which will allow elastic search to fetch it
    from the fluentd

    Fixes the issue

    Change-Id: I7899ce6e010bfc6534a88f0a2117dc0a9e60c7c7
    Closes-Bug: #1673002
    (cherry picked from commit b586f41967232ce28d2e7d20260abb2a097a4061)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 5.0.0.0b2 development milestone.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 4.0.2 release.