Detailed bug description:
Task "Deploy ceph HA with RadosGW for objects" failed with timeout:
2016-04-17 18:03:17,145 - ERROR decorators.py:126 -- Traceback (most recent call last):
File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/helpers/decorators.py", line 120, in wrapper
result = func(*args, **kwargs)
File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/tests/test_ceph.py", line 502, in ceph_rados_gw
self.fuel_web.deploy_cluster_wait(cluster_id)
File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/helpers/decorators.py", line 455, in wrapper
result = func(*args, **kwargs)
File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/helpers/decorators.py", line 440, in wrapper
result = func(*args, **kwargs)
File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/helpers/decorators.py", line 491, in wrapper
return func(*args, **kwargs)
File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/helpers/decorators.py", line 498, in wrapper
result = func(*args, **kwargs)
File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/helpers/decorators.py", line 382, in wrapper
return func(*args, **kwargs)
File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/models/fuel_web_client.py", line 817, in deploy_cluster_wait
self.assert_task_success(task, interval=interval, timeout=timeout)
File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/__init__.py", line 59, in wrapped
result = func(*args, **kwargs)
File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/models/fuel_web_client.py", line 315, in assert_task_success
task = self.task_wait(task, timeout, interval)
File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/__init__.py", line 59, in wrapped
result = func(*args, **kwargs)
File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/models/fuel_web_client.py", line 1182, in task_wait
"was exceeded: ".format(task=task["name"], timeout=timeout))
TimeoutError: Waiting task "deploy" timeout 7800 sec was exceeded:
https://product-ci.infra.mirantis.net/view/10.0/job/10.0.main.ubuntu.bvt_2/93/console
Puppet logs on node-1 show that task cgroups/cgroups.pp hanged:
2016-04-17 18:03:27 +0000 Scope(Class[Osnailyfacter::Cgroups::Cgroups]) (notice): MODULAR: cgroups/cgroups.pp
2016-04-17 18:03:35 +0000 Puppet (notice): Compiled catalog for node-1.test.domain.local in environment production in 8.26 seconds
2016-04-18 13:15:33 +0000 /Stage[main]/Cgroups/Package[cgroup-bin]/ensure (notice): ensure changed 'purged' to 'present'
Steps to reproduce:
N/A
Expected results:
Deployment is successful
Actual result:
Deployment failed
Reproducibility:
Build 90 and 93
https://product-ci.infra.mirantis.net/view/10.0/job/10.0.main.ubuntu.bvt_2/90/
https://product-ci.infra.mirantis.net/view/10.0/job/10.0.main.ubuntu.bvt_2/93/
Workaround:
N/A
Impact:
BVT deployment failures
Description of the environment:
Operation system: CentOS Linux release 7.2.1511 (Core)
Versions of components:
cat /etc/fuel_build_id:
115
cat /etc/fuel_build_number:
115
cat /etc/fuel_release:
10.0
cat /etc/fuel_openstack_version:
newton-10.0
rpm -qa | egrep 'fuel|astute|network-checker|nailgun|packetary|shotgun':
fuel-release-10.0.0-1.mos6339.noarch
fuel-misc-10.0.0-1.mos8326.noarch
fuel-openstack-metadata-10.0.0-1.mos8682.noarch
fuel-provisioning-scripts-10.0.0-1.mos8682.noarch
python-fuelclient-10.0.0-1.mos313.noarch
fuel-10.0.0-1.mos6339.noarch
fuel-nailgun-10.0.0-1.mos8682.noarch
rubygem-astute-10.0.0-1.mos739.noarch
fuel-library10.0-10.0.0-1.mos8326.noarch
fuelmenu-10.0.0-1.mos271.noarch
fuel-agent-10.0.0-1.mos276.noarch
fuel-ui-10.0.0-1.mos2662.noarch
fuel-setup-10.0.0-1.mos6339.noarch
nailgun-mcagents-10.0.0-1.mos739.noarch
shotgun-10.0.0-1.mos88.noarch
python-packetary-10.0.0-1.mos133.noarch
fuel-bootstrap-cli-10.0.0-1.mos276.noarch
fuel-migrate-10.0.0-1.mos8326.noarch
fuel-mirror-10.0.0-1.mos133.noarch
fuel-notify-10.0.0-1.mos8326.noarch
fuel-ostf-10.0.0-1.mos927.noarch
network-checker-10.0.0-1.mos73.x86_64
fuel-utils-10.0.0-1.mos8326.noarch
Reference architecture: N/A
Network model: N/A
Related projects installed: N/A
Additional information:
N/A
Raised to Critical since it was failed for two times.