openstack-ci-packtest-deb CI job broken

Bug #1430687 reported by Viktor Serhieiev
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Critical
Alexander Tsamutali
6.0.x
Won't Fix
Undecided
Alexander Tsamutali

Bug Description

openstack-ci-packtest-deb CI job failed with the following traceback:

======================================================================
FAIL: Deploy cluster in HA mode with flat nova-network
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/usr/lib/python2.7/dist-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/usr/lib/python2.7/dist-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/6.1.mos.deploy-deb/fuel-main/fuelweb_test/helpers/decorators.py", line 64, in wrapper
    return func(*args, **kwargs)
  File "/home/jenkins/workspace/6.1.mos.deploy-deb/fuel-main/fuelweb_test/tests/test_ha_one_controller.py", line 121, in deploy_ha_one_controller_flat
    self.fuel_web.deploy_cluster_wait(cluster_id)
  File "/home/jenkins/workspace/6.1.mos.deploy-deb/fuel-main/fuelweb_test/helpers/decorators.py", line 294, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/6.1.mos.deploy-deb/fuel-main/fuelweb_test/helpers/decorators.py", line 234, in wrapper
    return func(*args, **kwargs)
  File "/home/jenkins/workspace/6.1.mos.deploy-deb/fuel-main/fuelweb_test/models/fuel_web_client.py", line 440, in deploy_cluster_wait
    self.assert_task_success(task, interval=interval)
  File "/home/jenkins/workspace/6.1.mos.deploy-deb/fuel-main/fuelweb_test/__init__.py", line 48, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/6.1.mos.deploy-deb/fuel-main/fuelweb_test/models/fuel_web_client.py", line 239, in assert_task_success
    task['status'], 'ready', name=task["name"]
AssertionError: Task 'deploy' has incorrect status. error != ready

See full log at http://osci-jenkins.srt.mirantis.net:8080/job/6.1.mos.deploy-deb/9/console

Roman Vyalov (r0mikiam)
Changed in fuel:
assignee: nobody → Fuel OSCI Team (fuel-osci)
milestone: none → 6.1
importance: Undecided → High
status: New → Triaged
Revision history for this message
Dmitry Burmistrov (dburmistrov) wrote :

Ubuntu installer goes to interactive mode on disk partitioning

Revision history for this message
Vasyl Saienko (vsaienko) wrote :

./10.108.20.2/var/log/docker-logs/astute/astute.log:2015-03-10T18:56:01 info: [411] 7a922fe7-ade4-4c4f-9501-ee8b5a1d0862: stdout: stderr: Warning: Permanently added '10.108.20.2' (RSA) to the list of known hosts.
./10.108.20.2/var/log/docker-logs/astute/astute.log:2015-03-10T18:56:37 debug: [411] Retry result: success nodes: [], error nodes: [], inaccessible nodes: ["10.108.20.3", "10.108.20.4"]
./10.108.20.2/var/log/docker-logs/astute/astute.log:2015-03-10T18:57:07 warning: [411] 7a922fe7-ade4-4c4f-9501-ee8b5a1d0862: Running shell command on nodes ["1", "3"] finished with errors. Nodes [{"uid"=>"1"}, {"uid"=>"3"}] are inaccessible
./10.108.20.2/var/log/docker-logs/astute/astute.log:2015-03-10T20:27:17 err: [411] Timeout of provisioning is exceeded. Nodes not booted: ["1", "3"]
./10.108.20.2/var/log/docker-logs/astute/astute.log:2015-03-10T20:27:17 debug: [411] Data received by DeploymentProxyReporter to report it up: {"nodes"=>[{"uid"=>"1", "status"=>"error", "error_msg"=>"Timeout of provisioning is exceeded", "progress"=>100, "error_type"=>"p
rovision"}, {"uid"=>"3", "status"=>"error", "error_msg"=>"Timeout of provisioning is exceeded", "progress"=>100, "error_type"=>"provision"}], "status"=>"error", "error"=>"Timeout of provisioning is exceeded", "progress"=>100}
./10.108.20.2/var/log/docker-logs/astute/astute.log:2015-03-10T20:27:17 debug: [411] Data send by DeploymentProxyReporter to report it up: {"nodes"=>[{"uid"=>"1", "status"=>"error", "error_msg"=>"Timeout of provisioning is exceeded", "progress"=>100, "error_type"=>"provi
sion"}, {"uid"=>"3", "status"=>"error", "error_msg"=>"Timeout of provisioning is exceeded", "progress"=>100, "error_type"=>"provision"}], "status"=>"error", "error"=>"Timeout of provisioning is exceeded", "progress"=>100}
./10.108.20.2/var/log/docker-logs/astute/astute.log:2015-03-10T20:27:17 info: [411] Casting message to Nailgun: {"method"=>"provision_resp", "args"=>{"task_uuid"=>"7a922fe7-ade4-4c4f-9501-ee8b5a1d0862", "nodes"=>[{"uid"=>"1", "status"=>"error", "error_msg"=>"Timeout of p
rovisioning is exceeded", "progress"=>100, "error_type"=>"provision"}, {"uid"=>"3", "status"=>"error", "error_msg"=>"Timeout of provisioning is exceeded", "progress"=>100, "error_type"=>"provision"}], "status"=>"error", "error"=>"Timeout of provisioning is exceeded", "pr
ogress"=>100}}

It looks like some nodes not booted

Revision history for this message
Dmitry Burmistrov (dburmistrov) wrote :

Need to update fuel-devops modules on test servers

Changed in fuel:
assignee: Fuel OSCI Team (fuel-osci) → Fuel DevOps (fuel-devops)
Roman Vyalov (r0mikiam)
Changed in fuel:
importance: High → Critical
Changed in fuel:
assignee: Fuel DevOps (fuel-devops) → Fuel OSCI Team (fuel-osci)
Changed in fuel:
assignee: Fuel OSCI Team (fuel-osci) → Alexander Tsamutali (astsmtl)
Changed in fuel:
status: Triaged → In Progress
Roman Vyalov (r0mikiam)
Changed in fuel:
status: In Progress → Fix Committed
Changed in fuel:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Bug attachments

Remote bug watches

Bug watches keep track of this bug in other bug trackers.