reproduced again. have found that boot_and_delete_server_with_secgroups rally scenari was failed.
from rally.log: http://paste.openstack.org/show/331694/ root@node-76:~# awk '$11==500' /var/log/messages | grep "30 16:09:47" http://paste.openstack.org/show/331697/ from nova-api.log at the time: http://paste.openstack.org/show/331686/
from <email address hidden>: =INFO REPORT==== 30-Jun-2015::16:09:46 === Stopping RabbitMQ
=INFO REPORT==== 30-Jun-2015::16:09:46 === stopped TCP Listener on [::]:5673
root@node-76:~# less /var/log/pacemaker.log: Jun 30 16:09:45 [15257] node-76.domain.tld crmd: notice: process_lrm_event: Operation p_rabbitmq-server_monitor_30000: unknown error (node=node-76.domain.tld, call=171, rc=1, cib-update=267, confirmed=false) Jun 30 16:09:45 [15257] node-76.domain.tld crmd: notice: process_lrm_event: node-76.domain.tld-p_rabbitmq-server_monitor_30000:171 [ Killed\n ] ... Jun 30 16:10:00 [15254] node-76.domain.tld pacemaker_remoted: info: log_finished: finished - rsc:p_rabbitmq-server action:stop call_id:271 pid:27592 exit-code:0 exec-time:14222ms queue-time:0ms
atop from node-74 at 16:09:42: http://paste.openstack.org/show/331865/ atop from node-76 at 16:09:42: http://paste.openstack.org/show/331864/ atop from node-81 at 16:09:42: http://paste.openstack.org/show/331866/
Diagnostic snapshot is here: http://mos-scale-share.mirantis.com/fuel-snapshot-2015-07-01_09-31-23.tar.xz
reproduced again. have found that boot_and_ delete_ server_ with_secgroups rally scenari was failed.
from rally.log: http:// paste.openstack .org/show/ 331694/ paste.openstack .org/show/ 331697/ paste.openstack .org/show/ 331686/
root@node-76:~# awk '$11==500' /var/log/messages | grep "30 16:09:47"
http://
from nova-api.log at the time: http://
from <email address hidden>: 2015::16: 09:46 ===
=INFO REPORT==== 30-Jun-
Stopping RabbitMQ
=INFO REPORT==== 30-Jun- 2015::16: 09:46 ===
stopped TCP Listener on [::]:5673
root@node-76:~# less /var/log/ pacemaker. log: server_ monitor_ 30000: unknown error (node=node- 76.domain. tld, call=171, rc=1, cib-update=267, confirmed=false) domain. tld-p_rabbitmq- server_ monitor_ 30000:171 [ Killed\n ] server action:stop call_id:271 pid:27592 exit-code:0 exec-time:14222ms queue-time:0ms
Jun 30 16:09:45 [15257] node-76.domain.tld crmd: notice: process_lrm_event: Operation p_rabbitmq-
Jun 30 16:09:45 [15257] node-76.domain.tld crmd: notice: process_lrm_event: node-76.
...
Jun 30 16:10:00 [15254] node-76.domain.tld pacemaker_remoted: info: log_finished: finished - rsc:p_rabbitmq-
atop from node-74 at 16:09:42: http:// paste.openstack .org/show/ 331865/ paste.openstack .org/show/ 331864/ paste.openstack .org/show/ 331866/
atop from node-76 at 16:09:42: http://
atop from node-81 at 16:09:42: http://
Diagnostic snapshot is here: http:// mos-scale- share.mirantis. com/fuel- snapshot- 2015-07- 01_09-31- 23.tar. xz