CI reports wrong number of nodes and fails
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
tripleo |
Fix Released
|
Critical
|
John Trowbridge |
Bug Description
Seeing this intermittently:
2015-11-18 11:28:58.582 | Deployment failed: Not enough nodes - available: 0, requested: 2
2015-11-18 11:28:58.631 | #################
2015-11-18 11:28:58.631 | tripleo.sh -- Overcloud deployment started - DONE.
2015-11-18 11:28:58.631 | #################
2015-11-18 11:28:58.636 | + source /home/stack/stackrc
2015-11-18 11:28:58.636 | ++ export NOVA_VERSION=1.1
2015-11-18 11:28:58.637 | ++ NOVA_VERSION=1.1
2015-11-18 11:28:58.637 | +++ sudo hiera admin_password
2015-11-18 11:28:58.752 | ++ export OS_PASSWORD=
2015-11-18 11:28:58.752 | ++ OS_PASSWORD=
2015-11-18 11:28:58.752 | ++ export OS_AUTH_URL=http://
2015-11-18 11:28:58.752 | ++ OS_AUTH_URL=http://
2015-11-18 11:28:58.752 | ++ export OS_USERNAME=admin
2015-11-18 11:28:58.753 | ++ OS_USERNAME=admin
2015-11-18 11:28:58.753 | ++ export OS_TENANT_
2015-11-18 11:28:58.753 | ++ OS_TENANT_
2015-11-18 11:28:58.753 | ++ export COMPUTE_
2015-11-18 11:28:58.753 | ++ COMPUTE_
2015-11-18 11:28:58.753 | ++ export OS_NO_CACHE=True
2015-11-18 11:28:58.753 | ++ OS_NO_CACHE=True
2015-11-18 11:28:58.754 | ++ export OS_CLOUDNAME=
2015-11-18 11:28:58.754 | ++ OS_CLOUDNAME=
2015-11-18 11:28:58.754 | ++ export OS_IMAGE_
2015-11-18 11:28:58.754 | ++ OS_IMAGE_
2015-11-18 11:28:58.755 | ++ grep ACTIVE
2015-11-18 11:28:58.756 | ++ wc -l
2015-11-18 11:28:58.756 | ++ cut -f1 -d ' '
2015-11-18 11:28:58.757 | ++ nova list
2015-11-18 11:29:00.343 | Wrong number of nodes deployed
2015-11-18 11:29:00.343 | + '[' 2 '!=' 0 ']'
2015-11-18 11:29:00.343 | + echo 'Wrong number of nodes deployed'
2015-11-18 11:29:00.343 | + exit 1
tags: | added: ci |
Changed in tripleo: | |
importance: | Undecided → Critical |
Changed in tripleo: | |
status: | Fix Committed → Fix Released |
2015-11-18 13:22:57.580 | ################# d922-4baa- 875f-9738c59c2e 67 3a85-46ac- 98c9-ae7ea461b7 14 d922-4baa- 875f-9738c59c2e 67 finished successfully. 3a85-46ac- 98c9-ae7ea461b7 14 finished successfully. d922-4baa- 875f-9738c59c2e 67 3a85-46ac- 98c9-ae7ea461b7 14
2015-11-18 13:22:57.580 | tripleo.sh -- Introspect nodes
2015-11-18 13:22:57.580 | #################
2015-11-18 13:22:57.580 | You must source a stackrc file for the Undercloud.
2015-11-18 13:22:57.580 | Attempting to source stackrc at /home/stack/stackrc
2015-11-18 13:22:57.696 | Done.
2015-11-18 13:25:02.763 | Setting available nodes to manageable...
2015-11-18 13:25:02.763 | Starting introspection of node: a25e0ee7-
2015-11-18 13:25:02.764 | Starting introspection of node: cecdc1f7-
2015-11-18 13:25:02.764 | Waiting for introspection to finish...
2015-11-18 13:25:02.764 | Introspection for UUID a25e0ee7-
2015-11-18 13:25:02.764 | Introspection for UUID cecdc1f7-
2015-11-18 13:25:02.764 | Setting manageable nodes to available...
2015-11-18 13:25:02.764 | FAIL: State not updated for Node a25e0ee7-
2015-11-18 13:25:02.764 | FAIL: State not updated for Node cecdc1f7-
2015-11-18 13:25:02.764 | Introspection completed.
2015-11-18 13:25:02.834 | #################
Discussion with trown on IRC uncovers that the error is actually interaction between the introspection (which was recently re-enabled in CI) and the setting of the nodes to available.