OpenStack-Ansible

logstash: parse swift logs

Bug #1399371 reported by Ian Cordasco
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack-Ansible
Invalid
High
Jesse Pretorius
Juno
Fix Released
High
Jesse Pretorius
OpenStack-Ansible 10.1.2
Trunk
Invalid
High
Jesse Pretorius

Bug Description

Opened by odyssey4me on 2014-11-25 16:16:19+00:00 at https://github.com/rcbops/ansible-lxc-rpc/issues/645

------------------------------------------------------------

We need to add filters to logstash in order to parse the logs from swift.

Tags:

====================== COMMENTS ============================

Justin Shepherd (jshepher)
Changed in openstack-ansible:
milestone: none → 10.1.0
importance: Undecided → High
Jesse Pretorius (jesse-pretorius)
Changed in openstack-ansible:
assignee: nobody → Jesse Pretorius (jesse-pretorius)
Jesse Pretorius (jesse-pretorius)
Changed in openstack-ansible:
assignee: Jesse Pretorius (jesse-pretorius) → Steve Lewis (steve-lewis)
status: New → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to os-ansible-deployment (master)

Fix proposed to branch: master
Review: https://review.openstack.org/141164

Darren Birkett (darren-birkett)
tags: added: juno-backport-potential
Kevin Carter (kevin-carter)
Changed in openstack-ansible:
milestone: 10.1.0 → 10.1.2
Revision history for this message
Jesse Pretorius (jesse-pretorius) wrote :

Fix proposed: https://review.openstack.org/145195

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on os-ansible-deployment (master)

Change abandoned by Steve Lewis (<email address hidden>) on branch: master
Review: https://review.openstack.org/141164
Reason: This work has been incorporated into Change Id6180b080f11fada00386e39c64f8d7338f8c94d

Jesse Pretorius (jesse-pretorius)
Changed in openstack-ansible:
assignee: Steve Lewis (steve-lewis) → Jesse Pretorius (jesse-pretorius)
Kevin Carter (kevin-carter)
no longer affects: openstack-ansible/icehouse
no longer affects: openstack-ansible/juno
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-ansible-deployment (master)

Reviewed: https://review.openstack.org/145195
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=2231094cfd19a47469dab42fbcab59cbb271eb95
Submitter: Jenkins
Branch: master

commit 2231094cfd19a47469dab42fbcab59cbb271eb95
Author: Jesse Pretorius <email address hidden>
Date: Tue Jan 6 10:36:19 2015 +0000

    Implement logstash filter changes to improve log processing

    This patch implements changes to the logstash filter configurations in
    order to improve log processing such that all logs are tagged and passed
    through to elasticsearch properly. It implements a change in the initial
    'rsyslog' filter logic and several tweaks in the follow-up filters,
    resulting in no more grok parse failures.

    This patch also includes log parsing for swift, neutron and the mysql
    slow query log.

    Co-Authored-By: Steve Lewis <email address hidden>
    Change-Id: Id6180b080f11fada00386e39c64f8d7338f8c94d
    Closes-Bug: #1403890
    Closes-Bug: #1399371
    Closes-Bug: #1399367

Changed in openstack-ansible:
status: In Progress → Fix Committed
Jesse Pretorius (jesse-pretorius)
tags: removed: juno-backport-potential
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to os-ansible-deployment (juno)

Fix proposed to branch: juno
Review: https://review.openstack.org/150361

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to os-ansible-deployment (icehouse)

Fix proposed to branch: icehouse
Review: https://review.openstack.org/150561

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-ansible-deployment (icehouse)

Reviewed: https://review.openstack.org/150561
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=5a44cc7433e608814d2f73abc36092f46123024d
Submitter: Jenkins
Branch: icehouse

commit 5a44cc7433e608814d2f73abc36092f46123024d
Author: Jesse Pretorius <email address hidden>
Date: Tue Jan 6 10:36:19 2015 +0000

    Implement logstash filter changes to improve log processing

    This patch implements changes to the logstash filter configurations in
    order to improve log processing such that all logs are tagged and passed
    through to elasticsearch properly. It implements a change in the initial
    'rsyslog' filter logic and several tweaks in the follow-up filters,
    resulting in no more grok parse failures.

    This patch also includes log parsing for swift, neutron and the mysql
    slow query log.

    Co-Authored-By: Steve Lewis <email address hidden>
    Change-Id: Id6180b080f11fada00386e39c64f8d7338f8c94d
    Closes-Bug: #1403890
    Closes-Bug: #1399371
    Closes-Bug: #1399367
    (cherry picked from commit 2231094cfd19a47469dab42fbcab59cbb271eb95)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to os-ansible-deployment (juno)

Reviewed: https://review.openstack.org/150361
Committed: https://git.openstack.org/cgit/stackforge/os-ansible-deployment/commit/?id=86327da7d4d8d70c740aa57c1595f8f2a04c366c
Submitter: Jenkins
Branch: juno

commit 86327da7d4d8d70c740aa57c1595f8f2a04c366c
Author: Jesse Pretorius <email address hidden>
Date: Tue Jan 6 10:36:19 2015 +0000

    Implement logstash filter changes to improve log processing

    This patch implements changes to the logstash filter configurations in
    order to improve log processing such that all logs are tagged and passed
    through to elasticsearch properly. It implements a change in the initial
    'rsyslog' filter logic and several tweaks in the follow-up filters,
    resulting in no more grok parse failures.

    This patch also includes log parsing for swift, neutron and the mysql
    slow query log.

    Co-Authored-By: Steve Lewis <email address hidden>
    Change-Id: Id6180b080f11fada00386e39c64f8d7338f8c94d
    Closes-Bug: #1403890
    Closes-Bug: #1399371
    Closes-Bug: #1399367
    (cherry picked from commit 2231094cfd19a47469dab42fbcab59cbb271eb95)

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.