logstash: response codes, bytes and timings not registering for some services

Bug #1399367 reported by Ian Cordasco
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack-Ansible
Fix Released
Wishlist
Jesse Pretorius
Icehouse
Fix Released
Wishlist
Jesse Pretorius
Juno
Fix Released
Wishlist
Jesse Pretorius
Trunk
Fix Released
Wishlist
Jesse Pretorius

Bug Description

Opened by odyssey4me on 2014-11-25 21:55:18+00:00 at https://github.com/rcbops/ansible-lxc-rpc/issues/651

------------------------------------------------------------

Without the correct data in the correct fields, kibana queries are far less useful than they should be.

services:

nova
cinder
neutron

Tags:

====================== COMMENTS ============================

David Wilde (dave-wilde)
Changed in openstack-ansible:
importance: Undecided → Medium
assignee: nobody → David Wilde (david-wilde-rackspace)
Changed in openstack-ansible:
milestone: none → 10.1.0
milestone: 10.1.0 → next
milestone: next → none
Changed in openstack-ansible:
importance: Medium → Wishlist
Revision history for this message
Jesse Pretorius (jesse-pretorius) wrote :
Changed in openstack-ansible:
assignee: David Wilde (david-wilde-rackspace) → Jesse Pretorius (jesse-pretorius)
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-ansible-deployment (master)

Reviewed: https://review.openstack.org/145195
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=2231094cfd19a47469dab42fbcab59cbb271eb95
Submitter: Jenkins
Branch: master

commit 2231094cfd19a47469dab42fbcab59cbb271eb95
Author: Jesse Pretorius <email address hidden>
Date: Tue Jan 6 10:36:19 2015 +0000

    Implement logstash filter changes to improve log processing

    This patch implements changes to the logstash filter configurations in
    order to improve log processing such that all logs are tagged and passed
    through to elasticsearch properly. It implements a change in the initial
    'rsyslog' filter logic and several tweaks in the follow-up filters,
    resulting in no more grok parse failures.

    This patch also includes log parsing for swift, neutron and the mysql
    slow query log.

    Co-Authored-By: Steve Lewis <email address hidden>
    Change-Id: Id6180b080f11fada00386e39c64f8d7338f8c94d
    Closes-Bug: #1403890
    Closes-Bug: #1399371
    Closes-Bug: #1399367

Changed in openstack-ansible:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to os-ansible-deployment (juno)

Fix proposed to branch: juno
Review: https://review.openstack.org/150361

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to os-ansible-deployment (icehouse)

Fix proposed to branch: icehouse
Review: https://review.openstack.org/150561

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-ansible-deployment (icehouse)

Reviewed: https://review.openstack.org/150561
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=5a44cc7433e608814d2f73abc36092f46123024d
Submitter: Jenkins
Branch: icehouse

commit 5a44cc7433e608814d2f73abc36092f46123024d
Author: Jesse Pretorius <email address hidden>
Date: Tue Jan 6 10:36:19 2015 +0000

    Implement logstash filter changes to improve log processing

    This patch implements changes to the logstash filter configurations in
    order to improve log processing such that all logs are tagged and passed
    through to elasticsearch properly. It implements a change in the initial
    'rsyslog' filter logic and several tweaks in the follow-up filters,
    resulting in no more grok parse failures.

    This patch also includes log parsing for swift, neutron and the mysql
    slow query log.

    Co-Authored-By: Steve Lewis <email address hidden>
    Change-Id: Id6180b080f11fada00386e39c64f8d7338f8c94d
    Closes-Bug: #1403890
    Closes-Bug: #1399371
    Closes-Bug: #1399367
    (cherry picked from commit 2231094cfd19a47469dab42fbcab59cbb271eb95)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-ansible-deployment (juno)

Reviewed: https://review.openstack.org/150361
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=86327da7d4d8d70c740aa57c1595f8f2a04c366c
Submitter: Jenkins
Branch: juno

commit 86327da7d4d8d70c740aa57c1595f8f2a04c366c
Author: Jesse Pretorius <email address hidden>
Date: Tue Jan 6 10:36:19 2015 +0000

    Implement logstash filter changes to improve log processing

    This patch implements changes to the logstash filter configurations in
    order to improve log processing such that all logs are tagged and passed
    through to elasticsearch properly. It implements a change in the initial
    'rsyslog' filter logic and several tweaks in the follow-up filters,
    resulting in no more grok parse failures.

    This patch also includes log parsing for swift, neutron and the mysql
    slow query log.

    Co-Authored-By: Steve Lewis <email address hidden>
    Change-Id: Id6180b080f11fada00386e39c64f8d7338f8c94d
    Closes-Bug: #1403890
    Closes-Bug: #1399371
    Closes-Bug: #1399367
    (cherry picked from commit 2231094cfd19a47469dab42fbcab59cbb271eb95)

Changed in openstack-ansible:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.