6 upgrade jobs (cont. and non-cont.) stuck on UpgradeInitDeployment, SoftwareDeployment resources signals get response code 400
Bug #1699463 reported by
Jiří Stránský
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack Heat |
Fix Released
|
High
|
Zane Bitter | ||
tripleo |
Fix Released
|
Medium
|
James Slagle |
Bug Description
All our upgrade jobs (both containerized and non-containerized) get stuck on UpgradeInitDepl
tags: | added: alert |
summary: |
- 6 upgrade jobs (cont. and non-cont.) stuck on UpgradeInitDeployment + 6 upgrade jobs (cont. and non-cont.) stuck on UpgradeInitDeployment, + SoftwareDeployment resources signals get response code 400 |
Changed in heat: | |
importance: | Undecided → High |
status: | New → Triaged |
Changed in heat: | |
assignee: | nobody → Zane Bitter (zaneb) |
status: | Triaged → In Progress |
Changed in heat: | |
milestone: | none → pike-3 |
Changed in tripleo: | |
importance: | Critical → Medium |
milestone: | none → pike-3 |
To post a comment you must log in.
From containerized upgrade job:
http:// logs.openstack. org/52/ 475952/ 1/check/ gate-tripleo- ci-centos- 7-containers- multinode- upgrades- nv/32c9192/ logs/subnode- 2/var/log/ messages. txt.gz# _Jun_21_ 00_39_25
Jun 21 00:39:25 centos- 7-2-node- osic-cloud1- s3500-9417693- 648176 os-collect-config: [2017-06-21 00:39:25,589] (heat-config) [INFO] 7-2-node- osic-cloud1- s3500-9417693- 648176 os-collect-config: [2017-06-21 00:39:25,589] (heat-config) [DEBUG] [2017-06-21 00:39:25,068] (heat-config- notify) [DEBUG] Signaling to http:// 192.168. 24.1:8000/ v1/signal/ arn%3Aopenstack %3Aheat% 3A%3A868043c70b c64d8bb6cb3b189 b169583% 3Astacks% 2Fovercloud- Controller- 3qt54xb32c7d- 0-yifjre2binay% 2Fcc9edd2a- 990d-4620- b030-f0e3a897cc 7c%2Fresources% 2FControllerUpg radeInitDeploym ent?Timestamp= 2017-06- 20T23%3A58% 3A12Z&Signature Method= HmacSHA256& AWSAccessKeyId= 24e7fe4e5297497 ca11100b27736f3 f3&SignatureVer sion=2& Signature= %2FtPvTWy9711dB ODRB2RbLkLCgMT8 NWzpDj4W4% 2B1tB1E% 3D via POST 7-2-node- osic-cloud1- s3500-9417693- 648176 os-collect-config: [2017-06-21 00:39:25,556] (heat-config- notify) [DEBUG] Response <Response [400]>
Jun 21 00:39:25 centos-
Jun 21 00:39:25 centos-
======= ======= ======= ======= ======= =======
http:// logs.openstack. org/52/ 475952/ 1/check/ gate-tripleo- ci-centos- 7-containers- multinode- upgrades- nv/32c9192/ logs/undercloud /home/jenkins/ overcloud_ upgrade_ console. log.txt. gz#_2017- 06-21_01_ 55_41
2017-06-21 00:39:20 | 2017-06-21 00:39:14Z [overcloud- Controller- 3qt54xb32c7d- 0-yifjre2binay. StorageMgmtPort ]: UPDATE_COMPLETE state changed Controller- 3qt54xb32c7d- 0-yifjre2binay. TenantPort] : UPDATE_COMPLETE state changed Controller- 3qt54xb32c7d- 0-Heat Stack update failed. InternalApiPort ]: UPDATE_COMPLETE state changed Controller- 3qt54xb32c7d- 0-yifjre2binay. NetIpMap] : UPDATE_IN_PROGRESS state changed Controller- 3qt54xb32c7d- 0-yifjre2binay. NetworkConfig] : UPDATE_IN_PROGRESS state changed Controller- 3qt54xb32c7d- 0-yifjre2binay. NetworkConfig] : UPDATE_COMPLETE state changed Controller- 3qt54xb32c7d- 0-yifjre2binay. NetIpMap] : UPDATE_COMPLETE state changed Controller- 3qt54xb32c7d- 0-yifjre2binay. UpdateDeploymen t]: UPDATE_IN_PROGRESS state changed Controller- 3qt54xb32c7d- 0-yifjre2binay. ControllerUpgra deInitDeploymen t]: UPDATE_IN_PROGRESS state changed Controller- 3qt54xb32c7d- 0-yifjre2binay. ControllerConfi g]: UPDATE_IN_PROGRESS state changed Controller- 3qt54xb32c7d- 0-yifjre2binay. ControllerConfi g]: UPDATE_COMPLETE The Resource ControllerConfig requires replacement. Controller- 3qt54xb32c7d- 0-yifjre2binay. ControllerConfi g]: CR...
2017-06-21 00:39:20 | 2017-06-21 00:39:14Z [overcloud-
2017-06-21 01:55:41 | 2017-06-21 00:39:14Z [overcloud-
2017-06-21 01:55:41 | Heat Stack update failed.
2017-06-21 01:55:41 | yifjre2binay.
2017-06-21 01:55:41 | 2017-06-21 00:39:14Z [overcloud-
2017-06-21 01:55:41 | 2017-06-21 00:39:15Z [overcloud-
2017-06-21 01:55:41 | 2017-06-21 00:39:17Z [overcloud-
2017-06-21 01:55:41 | 2017-06-21 00:39:17Z [overcloud-
2017-06-21 01:55:41 | 2017-06-21 00:39:17Z [overcloud-
2017-06-21 01:55:41 | 2017-06-21 00:39:17Z [overcloud-
2017-06-21 01:55:41 | 2017-06-21 00:39:17Z [overcloud-
2017-06-21 01:55:41 | 2017-06-21 00:39:17Z [overcloud-
2017-06-21 01:55:41 | 2017-06-21 00:39:18Z [overcloud-