Tracebacks aren't logged in the Rsyslog files

[Simon Pasquier]

Tested on MOS8 (ISO #165)

When nova-api logs a traceback, it isn't present in the /var/log/nova-all.log [1] although it is present in /var/log/nova/nova-api.log [2]. My guess is that it is the same for all OpenStack services. This might be related to bug #1520330.

[1] http://paste.openstack.org/show/481640/
[2] http://paste.openstack.org/show/481637/

[Éric Lemoine (elemoine)]

This will be fixed with https://review.openstack.org/#/c/255418/.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/255418
Committed: https://git.openstack.org/cgit/openstack/fuel-plugin-lma-collector/commit/?id=813f111880c13db1da2435b3b5c6b660006f357d
Submitter: Jenkins
Branch: master

commit 813f111880c13db1da2435b3b5c6b660006f357d
Author: Éric Lemoine <email address hidden>
Date: Tue Dec 8 01:49:01 2015 +0100

    Read OpenStack logs from OpenStack log files

    Notes about this change:

    * The nova, neutron, cinder, glance, heat, keystone, horizon and murano logs
      are now read from /var/log/<service> (where <service> is the OpenStack
      service name). So we no longer rely on rsyslog for these services.
    * We make an exception for Swift which only writes its logs to syslog. So we
      still assume Rsyslog and the Fuel-defined Rsyslog log pattern for Swift.
    * The "heka" user is now part of the "keystone" group. This is for Heka to be
      able to read the Keystone logs from /var/log/keystone.
    * We used to read Keystone logs from two different places, namely
      /var/log/keystone-all.log and /var/log/user.log. This is no longer the case.
      The Keystone logs are read from the files in /var/log/keystone.

    Things to do next (with separate changes):

    * Correctly parse Tracebacks (which are multi-line).
    * Correctly parse other multi-line logs (Command: logs from
      neutron.agent.linux.utils for example).
    * Add an Heka message field to store the Python module name.
    * Document the new defined types in the module's README.md file.
    * Move patterns in openstack_log.lua to patterns.lua and add unit-tests.
    * Read Keystone HTTP logs from /var/log/apache2/keystone_wsgi_*_access.log to
      still be able to generate HTTP metrics for Keystone.

    Change-Id: I667376030bff054e8ce9921d92f202e06f71269f
    Implements: blueprint lma-without-fuel
    Closes-Bug: #1520330
    Related-Bug: #1525247