Comment 35 for bug 1463433

Revision history for this message
Leontii Istomin (listomin) wrote :

reproduced again. have found that boot_and_delete_server_with_secgroups rally scenari was failed.

from rally.log: http://paste.openstack.org/show/331694/
root@node-76:~# awk '$11==500' /var/log/messages | grep "30 16:09:47"
http://paste.openstack.org/show/331697/
from nova-api.log at the time: http://paste.openstack.org/show/331686/

from <email address hidden>:
=INFO REPORT==== 30-Jun-2015::16:09:46 ===
Stopping RabbitMQ

=INFO REPORT==== 30-Jun-2015::16:09:46 ===
stopped TCP Listener on [::]:5673

root@node-76:~# less /var/log/pacemaker.log:
Jun 30 16:09:45 [15257] node-76.domain.tld crmd: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: unknown error (node=node-76.domain.tld, call=171, rc=1, cib-update=267, confirmed=false)
Jun 30 16:09:45 [15257] node-76.domain.tld crmd: notice: process_lrm_event: node-76.domain.tld-p_rabbitmq-server_monitor_30000:171 [ Killed\n ]
...
Jun 30 16:10:00 [15254] node-76.domain.tld pacemaker_remoted: info: log_finished: finished - rsc:p_rabbitmq-server action:stop call_id:271 pid:27592 exit-code:0 exec-time:14222ms queue-time:0ms

atop from node-74 at 16:09:42: http://paste.openstack.org/show/331865/
atop from node-76 at 16:09:42: http://paste.openstack.org/show/331864/
atop from node-81 at 16:09:42: http://paste.openstack.org/show/331866/

Diagnostic snapshot is here: http://mos-scale-share.mirantis.com/fuel-snapshot-2015-07-01_09-31-23.tar.xz