include CIB and some perfomance related info to diagnostic logs snapshot

Bug #1389155 reported by Bogdan Dobrelya
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
High
Ihor Kalnytskyi

Bug Description

100 nodes scaling blueprint in 6.0 implies there could be perfomance issues at nodes, so we must enhance our diagnostic snapshot tool ASAP.

At least it should provide:
1) Current /var/log/atop/atop_current binary file from all nodes
2) command output for 'pcs status' from controllers
3) command output for 'cibadmin -Q' from controllers (note, some sensitive info (passwords from resources' parameters) will be included as well)
4) command output for 'rabbitmqctl report' from controllers
5) command output cat /proc/interrupts from *all* nodes

Tags: logging scale
Changed in fuel:
milestone: none → 6.1
status: New → Confirmed
importance: Undecided → High
assignee: nobody → Fuel Python Team (fuel-python)
tags: added: logging scale
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :
description: updated
summary: - include pcs status and atop binary files to diagnostic snapshot
+ include CIB and some perfomance related info to diagnostic logs snapshot
Changed in fuel:
milestone: 6.1 → 6.0
Changed in fuel:
assignee: Fuel Python Team (fuel-python) → Igor Kalnitsky (ikalnitsky)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-web (master)

Fix proposed to branch: master
Review: https://review.openstack.org/134136

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-web (master)

Reviewed: https://review.openstack.org/134136
Committed: https://git.openstack.org/cgit/stackforge/fuel-web/commit/?id=5bd676ea0ae4aa5f921da1f24d983ee753499e1c
Submitter: Jenkins
Branch: master

commit 5bd676ea0ae4aa5f921da1f24d983ee753499e1c
Author: Igor Kalnitsky <email address hidden>
Date: Thu Nov 13 10:53:14 2014 +0200

    Add additional info into diagnostic snapshot

    * pack all /var/log/atop/atop* files from all nodes
    * command output for 'pcs status' from controllers
    * command output for 'rabbitmqctl report' from controllers
    * command output cat /proc/interrupts from all nodes

    Change-Id: Ic22b32e31b002ae7334a6c12d648ac6354379acd
    Closes-Bug: #1389155

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
Bogdan Dobrelya (bogdando) wrote :

Description update: we need only atop_current (is a simlink, ensured by atop logrotate script) due to the logs snapshot size considerations

description: updated
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-web (master)

Reviewed: https://review.openstack.org/136308
Committed: https://git.openstack.org/cgit/stackforge/fuel-web/commit/?id=ec0ac4667c2996911e27096ca1a6a17b7ee6fccb
Submitter: Jenkins
Branch: master

commit ec0ac4667c2996911e27096ca1a6a17b7ee6fccb
Author: Sergii Golovatiuk <email address hidden>
Date: Fri Nov 21 12:44:08 2014 +0100

    Add only last atop log to snapshot

    To minimize the size of Diagnostic snapshot only last atop log will be
    added

    Related bug: #1389155
    This patch should be merged after Ib46ad049bc523f120da1ddaf20fb63a7b135153

    Change-Id: I7806a13ff0534f9d139cae27aaf866b3fab11731

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.