Build timed out during 'bvt_1' system test deploy_neutron_vlan_ha_with_public_network

[Dennis Dmitriev]

System test 'deploy_neutron_vlan_ha_with_public_network' of the 'bvt_1' group is failed due to build timeout:
http://jenkins-product.srt.mirantis.net:8080/job/fuel_master.centos.bvt_1/386/console

========
2014-09-29 22:59:50,176 - INFO fuel_web_client.py:581 -- Wait for task {u'status': u'running', u'name': u'deploy', u'cluster': 1, u'result': {}, u'progress': 0, u'message': None, u'id': 3, u'uuid': u'21382c2a-4c7b-4951-89fc-600553bb856a'} 7800 seconds
Build timed out (after 200 minutes). Marking the build as aborted.
Build was aborted
========

Actually, there is only 50 minutes of waiting timeout by default. According to sys_test.log the test was aborted on 38 percent of progress.

[Nastya Urlapova (aurlapova)]

Please, check puppet logs for errors. Looks like some operations were timeout.

[Dennis Dmitriev (ddmitriev)]

Confirmed with the following configuration:
CentOS/HA, Neutron/VLAN, no network tagging, 3 Controller, 2 Compute.

Deploy has failed on primary controller:

==== puppet.log from node-1 =======
Tue Sep 30 09:16:45 +0000 2014 Service[neutron-l3](provider=pacemaker) (debug): LSO: {"node-1.test.domain.local"=>"stop"}
Tue Sep 30 09:16:45 +0000 2014 Service[neutron-l3](provider=pacemaker) (debug): STATUS IS: stopped
Tue Sep 30 09:16:49 +0000 2014 /Stage[main]/Neutron::Agents::L3/Service[neutron-l3] (err): Could not evaluate: undefined method `attributes' for nil:NilClass
/etc/puppet/modules/corosync/lib/puppet/provider/service/pacemaker.rb:70:in `get_service_hash'
/etc/puppet/modules/corosync/lib/puppet/provider/service/pacemaker.rb:241:in `enabled?'
/usr/lib/ruby/site_ruby/1.8/puppet/type/service.rb:56:in `retrieve'
/usr/lib/ruby/site_ruby/1.8/puppet/type.rb:1045:in `retrieve'
/usr/lib/ruby/site_ruby/1.8/puppet/type.rb:1040:in `each'
/usr/lib/ruby/site_ruby/1.8/puppet/type.rb:1040:in `retrieve'
/usr/lib/ruby/site_ruby/1.8/puppet/type.rb:1063:in `retrieve_resource'
....
===============================

===== /etc/puppet/modules/corosync/lib/puppet/provider/service/pacemaker.rb:70 :
...
      default_start_timeout = XPath.match(metadata, "//actions/action[@name=\'start\']").first.attributes['timeout'].to_i
      default_stop_timeout = XPath.match(metadata, "//actions/action[@name=\'stop\']").first.attributes['timeout'].to_i
...
=====================================================================

[Matthew Mosesohn (raytrac3r)]

Is there an update on this bug?

[Dennis Dmitriev (ddmitriev)]

It is not reproducing anymore.