Test HA scalability fails: 'Deployment has failed. Method deploy. Disabling the upload of disk image because glance was not installed properly'
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
In Progress
|
Critical
|
Dmitry Ilyin |
Bug Description
api: '1.0'
astute_sha: c72dac7b31646fb
auth_required: true
build_id: 2014-11-05_21-28-15
build_number: '79'
feature_groups:
- mirantis
fuellib_sha: 03c63d4233f6e1c
fuelmain_sha: 35eed79fd6dcfc8
nailgun_sha: 01579a53c2be841
ostf_sha: 9c6fadca272427b
production: docker
release: '6.0'
Adding of controller nodes fails - deployment finishes with error:
'Deployment has failed. Method deploy. Disabling the upload of disk image because glance was not installed properly.
Inspect Astute logs for the details'
This bug was reproduced on CI during system tests:
Steps to reproduce:
1. Create environment HA, Ubuntu, NovaFlat.
2. Add 1 controller node.
3. Deploy the cluster. Result - success.
4. Add 2 controller nodes
5. Deploy changes. Result - success.
6. Add 2 controller nodes.
7. Deploy changes.
Expected result:
- cluster is successfully deployed
Actual:
- deployment fails (see error above)
Here is the part of Astute's logs:
http://
and output of 'pcs status' command on controllers:
http://
As you can see after 3rd deployment (step 7) 2 controllers were marked as 'error' (nodes which were added on step 4), but new 2 controllers were successfully deployed. Puppet logs on failed nodes (node-2, node-3) contain the following errors:
http://
Also, I tried to execute 'glance image-list' command few times and it randomly returned errors:
http://
Diagnostic snapshot is attached.
Changed in fuel: | |
status: | New → Confirmed |
importance: | High → Critical |
Changed in fuel: | |
assignee: | Fuel Library Team (fuel-library) → Dmitry Ilyin (idv1985) |
summary: |
- Test HA scalability fails: 'Deployment has failed. Method deploy. + [crmTest HA scalability fails: 'Deployment has failed. Method deploy. Disabling the upload of disk image because glance was not installed properly' |
summary: |
- [crmTest HA scalability fails: 'Deployment has failed. Method deploy. + Test HA scalability fails: 'Deployment has failed. Method deploy. Disabling the upload of disk image because glance was not installed properly' |
Changed in fuel: | |
status: | Incomplete → In Progress |
It failed again at the same controllers (node-3, node-4) specified in desription with
2014-11-10 09:11:13 ERR
(/Stage[ corosync_ setup]/ Osnailyfacter: :Cluster_ ha::Virtual_ ips/Cluster: :Virtual_ ips[management] /Cluster: :Virtual_ ip[management] /Cs_resource[ vip__management ]) Could not evaluate: Execution of '/usr/sbin/cibadmin --patch --sync-call --xml-text <diff crm_feature_ set='3. 0.7'>
Logs are attached