10.0-community.main.ubuntu.bvt_2 #1256 failed

[Timofey Durakov]

Job info: https://ci.fuel-infra.org/job/10.0-community.main.ubuntu.bvt_2/1256

Astute.log trace:

2017-03-02 00:49:04 DEBUG [16837] Node 2, task openstack-haproxy-heat, manifest /etc/puppet/modules/osnailyfacter/modular/openstack-haproxy/openstack-haproxy-heat.pp, status: running
2017-03-02 00:49:04 ERROR [16837] Puppet agent took too long to run puppet task. Mark task as failed. Node 2, task openstack-haproxy-heat, manifest /etc/puppet/modules/osnailyfacter/modular/openstack-hapr
oxy/openstack-haproxy-heat.pp
2017-03-02 00:49:04 INFO [16837] Node[2]: Finished task Task[openstack-haproxy-heat/2] with status: failed

Deployment failed with:
======================================================================
FAIL: Deploy ceph HA with RadosGW for objects
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/10.0-community.main.ubuntu.bvt_2/fuelweb_test/helpers/decorators.py", line 120, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/10.0-community.main.ubuntu.bvt_2/fuelweb_test/tests/test_ceph.py", line 511, in ceph_rados_gw
    self.fuel_web.deploy_cluster_wait(cluster_id)
  File "/home/jenkins/workspace/10.0-community.main.ubuntu.bvt_2/fuelweb_test/helpers/decorators.py", line 462, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/10.0-community.main.ubuntu.bvt_2/fuelweb_test/helpers/decorators.py", line 447, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/10.0-community.main.ubuntu.bvt_2/fuelweb_test/helpers/decorators.py", line 498, in wrapper
    return func(*args, **kwargs)
  File "/home/jenkins/workspace/10.0-community.main.ubuntu.bvt_2/fuelweb_test/helpers/decorators.py", line 505, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/10.0-community.main.ubuntu.bvt_2/fuelweb_test/helpers/decorators.py", line 389, in wrapper
    return func(*args, **kwargs)
  File "/home/jenkins/workspace/10.0-community.main.ubuntu.bvt_2/fuelweb_test/models/fuel_web_client.py", line 970, in deploy_cluster_wait
    self.assert_task_success(task, interval=interval, timeout=timeout)
  File "/home/jenkins/workspace/10.0-community.main.ubuntu.bvt_2/core/helpers/log_helpers.py", line 204, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/10.0-community.main.ubuntu.bvt_2/fuelweb_test/models/fuel_web_client.py", line 355, in assert_task_success
    task["name"], task['status'], 'ready', _message(task)
AssertionError: Task 'deploy' has incorrect status. error != ready, 'Deployment has failed. All nodes are finished. Failed tasks: Task[openstack-haproxy-heat/2] Stopping the deployment process!'

----------------------------------------------------------------------
Ran 3 tests in 4062.861s

[Oleksiy Molchanov (omolchanov)]

2017-03-02 00:44:14 +0000 Exec[haproxy-restart](provider=shell) (debug): Executing '["/bin/sh", "-c", "/usr/lib/ocf/resource.d/fuel/ns_haproxy reload"]'
2017-03-02 00:44:14 +0000 Puppet (debug): Executing '/bin/sh -c /usr/lib/ocf/resource.d/fuel/ns_haproxy reload'
2017-03-02 00:49:14 +0000 /Stage[main]/Openstack::Ha::Haproxy_restart/Exec[haproxy-restart] (err): Failed to call refresh: Command exceeded timeout
2017-03-02 00:49:14 +0000 /Stage[main]/Openstack::Ha::Haproxy_restart/Exec[haproxy-restart] (err): Command exceeded timeout

--------------------------------

2017-03-02T00:44:04.220736+00:00 info: INFO: Blocked all SYN for the Haproxy reload operation
2017-03-02T00:44:04.290804+00:00 info: INFO: mesg: ttyname failed: Inappropriate ioctl for device
2017-03-02T00:44:04.374721+00:00 info: INFO: Unblocked all SYN for the Haproxy reload operation
2017-03-02T00:44:04.393720+00:00 debug: DEBUG: Bringing up host interface: hapr-host
2017-03-02T00:44:04.399505+00:00 debug: DEBUG: Bringing up the namespace interface: hapr-ns
2017-03-02T00:44:04.461344+00:00 debug: DEBUG: Flushing global scope routes
2017-03-02T00:44:04.534927+00:00 debug: DEBUG: Creating default route inside the namespace to 240.0.0.1 with metric 10000
2017-03-02T00:44:04.578970+00:00 info: INFO: net.ipv4.conf.hapr-host.rp_filter = 2
2017-03-02T00:44:04.622479+00:00 info: INFO: net.ipv4.conf.all.rp_filter = 2
2017-03-02T00:44:31.558160+00:00 info: INFO: haproxy daemon running
2017-03-02T00:45:01.687560+00:00 info: INFO: haproxy daemon running

[Oleksiy Molchanov (omolchanov)]

Should be already fixed.