Deployment of ironic cluster was failed with "Deployment has failed. Critical nodes failed: Node[1], Node[3], Node[2]. Stopping the deployment process!"

Bug #1550298 reported by Artem Hrechanychenko
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
In Progress
High
Kyrylo Galanov

Bug Description

repoduced on CI:

https://product-ci.infra.mirantis.net/job/9.0.system_test.ubuntu.ironic_deploy_swift/19/testReport/%28root%29/ironic_deploy_swift/ironic_deploy_swift/

Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 331, in run
    testMethod()
  File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
    self._testFunc()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/9.0.system_test.ubuntu.ironic_deploy_swift/fuelweb_test/helpers/decorators.py", line 113, in wrapper
    raise test_exception
AssertionError: Task 'deploy' has incorrect status. error != ready, 'Deployment has failed. Critical nodes failed: Node[1], Node[3], Node[2]. Stopping the deployment process!'

from astute logs:

[23750] Casting message to Nailgun: {"method"=>"deploy_resp", "args"=> {"task_uuid"=>"06dea0d2-12e9-4082-bc3a-87921c90e47f", "nodes"=> [{"uid"=>"1", "status"=>"deploying", "task"=>"primary-keystone", "task_status"=>"failed", "progress"=>88}]}}

[23750] Casting message to Nailgun: {"method"=>"deploy_resp", "args"=> {"task_uuid"=>"06dea0d2-12e9-4082-bc3a-87921c90e47f", "nodes"=> [{"uid"=>"1", "status"=>"error", "error_type"=>"deploy", "error_msg"=> "Critical nodes failed: Node[1], Node[3], Node[2]. Stopping the deployment process!", "task"=>"primary-keystone", "task_status"=>"failed", "progress"=>100}]}}

There another bug present:
No one ERROR or CRITICAL record in ASTUTE logs for deployment failing - only INFO and Debug.

Revision history for this message
Artem Hrechanychenko (agrechanichenko) wrote :
summary: - Deployment of ironic cluster was failed with
+ Deployment of ironic cluster was failed with "Deployment has failed.
+ Critical nodes failed: Node[1], Node[3], Node[2]. Stopping the
+ deployment process!"
Changed in fuel:
assignee: nobody → Fuel Library Team (fuel-library)
status: New → Confirmed
Changed in fuel:
assignee: Fuel Library Team (fuel-library) → Kyrylo Galanov (kgalanov)
tags: added: team-bugfix
Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
Kyrylo Galanov (kgalanov) wrote :

Deployment failed because of keystone error:
Table 'keystone.user' doesn't exist: http://paste.openstack.org/show/489107/

Revision history for this message
Kyrylo Galanov (kgalanov) wrote :
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.