Neutron metadata service may generate too many files triggering a high load for Heka

[Simon Pasquier]

Tested with MOS 8 RC1 and LMA 0.9.x.

When running Rally tests that create and delete lots of Neutron networks, the /var/log/neutron directory gets filled with neutron-ns-metadata-proxy-*.log files. Heka creates as many log splitters and decoders as needed but when the number of files reaches a certain value, it has several unwanted consequences:
- High CPU load for the Heka process, see related issue on Github [1].
- Crash of the heka_monitoring filter.

[1] https://github.com/mozilla-services/heka/issues/1841
[2] https://bugs.launchpad.net/lma-toolchain/+bug/1545743

[Swann Croiset (swann-w)]

let's Hekad only collect useful logs:

ls /var/log/neutron|grep -v neutron-ns-metadata-proxy-
dhcp-agent.log
l3-agent.log
metadata-agent.log
neutron-netns-cleanup.log
openvswitch-agent.log
server.log
server.log.1

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/282305

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/282305
Committed: https://git.openstack.org/cgit/openstack/fuel-plugin-lma-collector/commit/?id=59d8fd8604eee1f3fb7d537c8eeda2182e83133d
Submitter: Jenkins
Branch: master

commit 59d8fd8604eee1f3fb7d537c8eeda2182e83133d
Author: Swann Croiset <email address hidden>
Date: Fri Feb 19 13:11:20 2016 +0100

    Specify explicitly Neutron log file names parsed by Hekad

    Fixes-bug: #1546424
    Change-Id: Icacfb8f7c6b81817856df468aeb592978a8d26e8

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/0.9
Review: https://review.openstack.org/282998

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/282998
Committed: https://git.openstack.org/cgit/openstack/fuel-plugin-lma-collector/commit/?id=9a9e6181bb1d252738bc062fefd71ed79d05bf13
Submitter: Jenkins
Branch: stable/0.9

commit 9a9e6181bb1d252738bc062fefd71ed79d05bf13
Author: Swann Croiset <email address hidden>
Date: Fri Feb 19 13:11:20 2016 +0100

    Specify explicitly Neutron log file names parsed by Hekad

    Fixes-bug: #1546424
    Change-Id: Icacfb8f7c6b81817856df468aeb592978a8d26e8
    (cherry picked from commit 59d8fd8604eee1f3fb7d537c8eeda2182e83133d)