ocata/stable jobs are broken (httpd restart failures)
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
tripleo |
Fix Released
|
Critical
|
Michele Baldessari |
Bug Description
Seen multiple times in a row when backporting something unrelated to upgrades in stable/ocata (https:/
http://
For example in http://
017-03-15 09:31:27.000 | [1;31mError: /Stage[
2017-03-15 09:31:27.000 | journalctl log for httpd:
The problem is that we are moving heat under httpd in the upgade process but this should never even happen in ocata. The reason for this is that on the overcloud we seem to upgrade to pike packages and not ocata ones:
From http://
Mar 15 13:23:28 Updated: puppet-
If you look at commit c9acf8a in puppet-tripleo you will see that it is from master which has the wsgi migration stuff in heat, whereas the ocata branch would not have that. Compare:
https:/
and
https:/
for example
summary: |
- N-O upgrades get httpd restart failures + ocata/stable upgrade jobs are broken (httpd restart failures) |
description: | updated |
Changed in tripleo: | |
importance: | High → Critical |
description: | updated |
tags: | added: alert |
Mar 15 13:46:52.550010 centos- 7-2-node- rax-ord- 7889550- 474007 python[206653]: Found 'compress' tags in: 7-2-node- rax-ord- 7889550- 474007 python[206653]: /usr/share/ openstack- dashboard/ openstack_ dashboard/ templates/ horizon/ _conf.html 7-2-node- rax-ord- 7889550- 474007 python[206653]: /usr/share/ openstack- dashboard/ openstack_ dashboard/ templates/ _stylesheets. html 7-2-node- rax-ord- 7889550- 474007 python[206653]: /usr/share/ openstack- dashboard/ openstack_ dashboard/ templates/ horizon/ _scripts. html 7-2-node- rax-ord- 7889550- 474007 python[206653]: Compressing... done 7-2-node- rax-ord- 7889550- 474007 python[206653]: Compressed 6 block(s) from 3 template(s) for 2 context(s). 7-2-node- rax-ord- 7889550- 474007 httpd[206837]: (98)Address already in use: AH00072: make_sock: could not bind to address [::]:8000 7-2-node- rax-ord- 7889550- 474007 httpd[206837]: (98)Address already in use: AH00072: make_sock: could not bind to address 0.0.0.0:8000 7-2-node- rax-ord- 7889550- 474007 httpd[206837]: no listening sockets available, shutting down 7-2-node- rax-ord- 7889550- 474007 httpd[206837]: AH00015: Unable to open logs 7-2-node- rax-ord- 7889550- 474007 systemd[1]: httpd.service: main process exited, code=exited, status=1/FAILURE 7-2-node- rax-ord- 7889550- 474007 kill[206840]: kill: cannot find process "" 7-2-node- rax-ord- 7889550- 474007 systemd[1]: httpd.service: control process exited, code=exited status=1 7-2-node- rax-ord- 7889550- 474007 systemd[1]: Failed to start The Apache HTTP Server. 7-2-node- rax-ord- 7889550- 474007 systemd[1]: Unit httpd.service entered failed state. 7-2-node- rax-ord- 7889550- 474007 systemd[1]: httpd.service failed.
Mar 15 13:46:52.550370 centos-
Mar 15 13:46:52.550629 centos-
Mar 15 13:46:52.551032 centos-
Mar 15 13:46:52.551287 centos-
Mar 15 13:46:52.551603 centos-
Mar 15 13:46:52.669540 centos-
Mar 15 13:46:52.670055 centos-
Mar 15 13:46:52.670275 centos-
Mar 15 13:46:52.670498 centos-
Mar 15 13:46:52.686015 centos-
Mar 15 13:46:52.715206 centos-
Mar 15 13:46:52.720167 centos-
Mar 15 13:46:52.720977 centos-
Mar 15 13:46:52.721219 centos-
Mar 15 13:46:52.721292 centos-