Activity log for bug #1389308

Date Who What changed Old value New value Message
2014-11-04 16:29:05 Bogdan Dobrelya bug added bug
2014-11-04 16:29:16 Bogdan Dobrelya summary [systest] centos.bvt #61 failue [systests] centos.bvt #61 failue
2014-11-04 16:29:19 Bogdan Dobrelya fuel: importance Undecided Critical
2014-11-04 16:29:23 Bogdan Dobrelya fuel: milestone 6.0
2014-11-04 16:29:27 Bogdan Dobrelya fuel: assignee Bogdan Dobrelya (bogdando)
2014-11-04 16:29:30 Bogdan Dobrelya fuel: status New In Progress
2014-11-04 16:29:49 Bogdan Dobrelya attachment added anaconda error (node-3) https://bugs.launchpad.net/fuel/+bug/1389308/+attachment/4252922/+files/Screenshot%20from%202014-11-04%2015%3A13%3A40.png
2014-11-04 16:33:23 Bogdan Dobrelya attachment added fuel-snapshot-2014-11-04_16-26-08.tgz https://bugs.launchpad.net/fuel/+bug/1389308/+attachment/4252924/+files/fuel-snapshot-2014-11-04_16-26-08.tgz
2014-11-04 16:38:08 Bogdan Dobrelya description http://jenkins-product.srt.mirantis.net:8080/view/6.0/job/6.0.centos.bvt_1/61 Originally, the cause of failure was node-3 failed to provision due to anaconda error (see attachment) I reverted it to the last snapshot, re-triggered provision for node-3, run deployment and ostf tests. Deployment and ostf failed, see diag. log snapshot http://jenkins-product.srt.mirantis.net:8080/view/6.0/job/6.0.centos.bvt_1/61 Originally, the cause of failure was node-3 failed to provision due to anaconda error (see attachment) I reverted it to the last snapshot, re-triggered provision for node-3, run deployment and ostf tests. Deployment and ostf failed, see diag. log snapshot pcs status: vip__public (ocf::mirantis:ns_IPaddr2): Started node-1.test.domain.local Clone Set: clone_ping_vip__public [ping_vip__public] Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ] vip__management (ocf::mirantis:ns_IPaddr2): Started node-1.test.domain.local Clone Set: clone_p_neutron-openvswitch-agent [p_neutron-openvswitch-agent] Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ] p_neutron-dhcp-agent (ocf::mirantis:neutron-agent-dhcp): Started node-1.test.domain.local Clone Set: clone_p_neutron-metadata-agent [p_neutron-metadata-agent] Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ] Clone Set: clone_p_neutron-l3-agent [p_neutron-l3-agent] Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ] Clone Set: clone_p_mysql [p_mysql] Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ] Master/Slave Set: master_p_rabbitmq-server [p_rabbitmq-server] Masters: [ node-1.test.domain.local ] Slaves: [ node-3.test.domain.local node-5.test.domain.local ] Clone Set: clone_p_haproxy [p_haproxy] Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ] p_openstack-heat-engine (ocf::mirantis:openstack-heat-engine): Started node-1.test.domain.local
2014-11-04 17:15:43 Bogdan Dobrelya description http://jenkins-product.srt.mirantis.net:8080/view/6.0/job/6.0.centos.bvt_1/61 Originally, the cause of failure was node-3 failed to provision due to anaconda error (see attachment) I reverted it to the last snapshot, re-triggered provision for node-3, run deployment and ostf tests. Deployment and ostf failed, see diag. log snapshot pcs status: vip__public (ocf::mirantis:ns_IPaddr2): Started node-1.test.domain.local Clone Set: clone_ping_vip__public [ping_vip__public] Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ] vip__management (ocf::mirantis:ns_IPaddr2): Started node-1.test.domain.local Clone Set: clone_p_neutron-openvswitch-agent [p_neutron-openvswitch-agent] Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ] p_neutron-dhcp-agent (ocf::mirantis:neutron-agent-dhcp): Started node-1.test.domain.local Clone Set: clone_p_neutron-metadata-agent [p_neutron-metadata-agent] Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ] Clone Set: clone_p_neutron-l3-agent [p_neutron-l3-agent] Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ] Clone Set: clone_p_mysql [p_mysql] Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ] Master/Slave Set: master_p_rabbitmq-server [p_rabbitmq-server] Masters: [ node-1.test.domain.local ] Slaves: [ node-3.test.domain.local node-5.test.domain.local ] Clone Set: clone_p_haproxy [p_haproxy] Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ] p_openstack-heat-engine (ocf::mirantis:openstack-heat-engine): Started node-1.test.domain.local http://jenkins-product.srt.mirantis.net:8080/view/6.0/job/6.0.centos.bvt_1/61 Originally, the cause of failure was node-3 failed to provision due to anaconda error (see attachment) I reverted it to the last snapshot, re-triggered provision for node-3, run deployment and ostf tests. Deployment and ostf failed, see diag. log snapshot pcs status:  vip__public (ocf::mirantis:ns_IPaddr2): Started node-1.test.domain.local  Clone Set: clone_ping_vip__public [ping_vip__public]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  vip__management (ocf::mirantis:ns_IPaddr2): Started node-1.test.domain.local  Clone Set: clone_p_neutron-openvswitch-agent [p_neutron-openvswitch-agent]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  p_neutron-dhcp-agent (ocf::mirantis:neutron-agent-dhcp): Started node-1.test.domain.local  Clone Set: clone_p_neutron-metadata-agent [p_neutron-metadata-agent]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  Clone Set: clone_p_neutron-l3-agent [p_neutron-l3-agent]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  Clone Set: clone_p_mysql [p_mysql]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  Master/Slave Set: master_p_rabbitmq-server [p_rabbitmq-server]      Masters: [ node-1.test.domain.local ]      Slaves: [ node-3.test.domain.local node-5.test.domain.local ]  Clone Set: clone_p_haproxy [p_haproxy]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  p_openstack-heat-engine (ocf::mirantis:openstack-heat-engine): Started node-1.test.domain.local How to reproduce: * Deploy Ha neutron environment from latest 6.0 ISO * Login to primary controller node and issue: OCF_ROOT=/usr/lib/ocf OCF_RESKEY_plugin_config=/etc/neutron/plugin.ini /usr/lib/ocf/resource.d/mirantis/neutron-agent-ovs stop; OCF_ROOT=/usr/lib/ocf OCF_RESKEY_plugin_config=/etc/neutron/plugin.ini /usr/lib/ocf/resource.d/mirantis/neutron-agent-ovs start Expected: it should run neutron agent ovs process detached and put its pid to $OCF_RESKEY_pid destination Actual: it will run in foreground and will not create a pid file.
2014-11-04 17:16:00 Bogdan Dobrelya description http://jenkins-product.srt.mirantis.net:8080/view/6.0/job/6.0.centos.bvt_1/61 Originally, the cause of failure was node-3 failed to provision due to anaconda error (see attachment) I reverted it to the last snapshot, re-triggered provision for node-3, run deployment and ostf tests. Deployment and ostf failed, see diag. log snapshot pcs status:  vip__public (ocf::mirantis:ns_IPaddr2): Started node-1.test.domain.local  Clone Set: clone_ping_vip__public [ping_vip__public]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  vip__management (ocf::mirantis:ns_IPaddr2): Started node-1.test.domain.local  Clone Set: clone_p_neutron-openvswitch-agent [p_neutron-openvswitch-agent]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  p_neutron-dhcp-agent (ocf::mirantis:neutron-agent-dhcp): Started node-1.test.domain.local  Clone Set: clone_p_neutron-metadata-agent [p_neutron-metadata-agent]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  Clone Set: clone_p_neutron-l3-agent [p_neutron-l3-agent]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  Clone Set: clone_p_mysql [p_mysql]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  Master/Slave Set: master_p_rabbitmq-server [p_rabbitmq-server]      Masters: [ node-1.test.domain.local ]      Slaves: [ node-3.test.domain.local node-5.test.domain.local ]  Clone Set: clone_p_haproxy [p_haproxy]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  p_openstack-heat-engine (ocf::mirantis:openstack-heat-engine): Started node-1.test.domain.local How to reproduce: * Deploy Ha neutron environment from latest 6.0 ISO * Login to primary controller node and issue: OCF_ROOT=/usr/lib/ocf OCF_RESKEY_plugin_config=/etc/neutron/plugin.ini /usr/lib/ocf/resource.d/mirantis/neutron-agent-ovs stop; OCF_ROOT=/usr/lib/ocf OCF_RESKEY_plugin_config=/etc/neutron/plugin.ini /usr/lib/ocf/resource.d/mirantis/neutron-agent-ovs start Expected: it should run neutron agent ovs process detached and put its pid to $OCF_RESKEY_pid destination Actual: it will run in foreground and will not create a pid file. http://jenkins-product.srt.mirantis.net:8080/view/6.0/job/6.0.centos.bvt_1/61 Originally, the cause of failure was node-3 failed to provision due to anaconda error (see attachment) I reverted it to the last snapshot, re-triggered provision for node-3, run deployment and ostf tests. Deployment and ostf failed, see diag. log snapshot pcs status:  vip__public (ocf::mirantis:ns_IPaddr2): Started node-1.test.domain.local  Clone Set: clone_ping_vip__public [ping_vip__public]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  vip__management (ocf::mirantis:ns_IPaddr2): Started node-1.test.domain.local  Clone Set: clone_p_neutron-openvswitch-agent [p_neutron-openvswitch-agent]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  p_neutron-dhcp-agent (ocf::mirantis:neutron-agent-dhcp): Started node-1.test.domain.local  Clone Set: clone_p_neutron-metadata-agent [p_neutron-metadata-agent]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  Clone Set: clone_p_neutron-l3-agent [p_neutron-l3-agent]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  Clone Set: clone_p_mysql [p_mysql]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  Master/Slave Set: master_p_rabbitmq-server [p_rabbitmq-server]      Masters: [ node-1.test.domain.local ]      Slaves: [ node-3.test.domain.local node-5.test.domain.local ]  Clone Set: clone_p_haproxy [p_haproxy]      Started: [ node-1.test.domain.local node-3.test.domain.local node-5.test.domain.local ]  p_openstack-heat-engine (ocf::mirantis:openstack-heat-engine): Started node-1.test.domain.local
2014-11-12 13:55:22 Bogdan Dobrelya fuel: status In Progress Invalid