services no longer reliably stop in stable/liberty / master
Bug #1446583 reported by
Sean Dague
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Cinder |
Fix Released
|
Critical
|
Brant Knudson | ||
Kilo |
Fix Released
|
Critical
|
Unassigned | ||
OpenStack Compute (nova) |
Fix Released
|
High
|
Sean Dague | ||
Kilo |
Fix Released
|
Undecided
|
Unassigned | ||
OpenStack Identity (keystone) |
Fix Released
|
Critical
|
Brant Knudson | ||
Kilo |
Fix Released
|
Critical
|
Brant Knudson | ||
oslo-incubator |
Fix Released
|
Critical
|
Julien Danjou | ||
oslo.service |
Fix Released
|
Critical
|
Marian Horban |
Bug Description
In attempting to upgrade the upgrade branch structure to support stable/kilo -> master in devstack gate, we found the project could no longer pass Grenade testing. The reason is because pkill -g is no longer reliably killing off the services:
It has been seen with keystone-all and cinder-api on this patch series:
There were a number of changes to the oslo-incubator service.py code during kilo, it's unclear at this point which is the issue.
Note: this has returned in stable/liberty / master and oslo.service, see comment #50 for where this reemerges.
Changed in oslo-incubator: | |
importance: | Undecided → Critical |
tags: | added: kilo-rc-potential |
summary: |
- services no long reliably stop in stable/kilo + services no longer reliably stop in stable/kilo |
Changed in oslo-incubator: | |
status: | Triaged → Fix Released |
milestone: | none → ongoing |
milestone: | ongoing → liberty-1 |
Changed in keystone: | |
milestone: | kilo-rc2 → none |
Changed in oslo-incubator: | |
status: | Fix Released → Fix Committed |
Changed in nova: | |
importance: | Undecided → High |
no longer affects: | nova/kilo |
tags: | removed: kilo-rc-potential |
Changed in oslo-incubator: | |
status: | Fix Committed → Fix Released |
milestone: | liberty-1 → 2015.1.0 |
Changed in keystone: | |
milestone: | none → liberty-1 |
Changed in cinder: | |
milestone: | none → liberty-1 |
status: | Fix Committed → Fix Released |
Changed in keystone: | |
status: | Fix Committed → Fix Released |
Changed in nova: | |
milestone: | none → liberty-1 |
status: | Fix Committed → Fix Released |
Changed in nova: | |
milestone: | liberty-1 → 12.0.0 |
Changed in keystone: | |
milestone: | liberty-1 → 8.0.0 |
Changed in cinder: | |
milestone: | liberty-1 → 7.0.0 |
Changed in oslo.service: | |
assignee: | nobody → Marian Horban (mhorban) |
Changed in oslo.service: | |
status: | New → In Progress |
To post a comment you must log in.
Here's what a working shutdown for keystone looks like:
http:// logs.openstack. org/33/ 175533/ 1/check/ check-grenade- dsvm/51e9a99/ logs/old/ screen- key.txt. gz#_2015- 04-20_20_ 08_24_354
2015-04-20 20:08:24.354 9448 INFO keystone. openstack. common. service [-] Child caught SIGTERM, exiting openstack. common. service [-] Child caught SIGTERM, exiting openstack. common. service [-] Caught SIGTERM, stopping children openstack. common. service [-] Child caught SIGTERM, exiting openstack. common. service [-] Child caught SIGTERM, exiting openstack. common. service [-] Child caught SIGTERM, exiting openstack. common. service [-] Child caught SIGTERM, exiting openstack. common. service [-] Child caught SIGTERM, exiting openstack. common. service [-] Child caught SIGTERM, exiting openstack. common. service [-] Waiting on 12 children to exit openstack. common. service [-] Child 9447 exited with status 1 openstack. common. service [-] Child 9448 exited with status 1 openstack. common. service [-] Child 9449 exited with status 1 openstack. common. service [-] Child 9450 exited with status 1 openstack. common. service [-] Child 9452 exited with status 1 openstack. common. service [-] Child 9457 exited with status 1 openstack. common. service [-] Child caught SIGTERM, exiting openstack. common. service [-] Child 9451 exited with status 1 openstack. common. service [-] Child 9453 exited with status 1 openstack. common. service [-] Child 9446 exited with status 1 openstack. common. service [-] Child 9455 exited with status 1 openstack. common. service [-] Child 9454 exited with status 1 openstack. common. service [-] Child 9456 exited with status 1 openstack. common. service [-] Full set of CONF: wait /opt/stack/ old/keystone/ keystone/ openstack/ common/ service. py:387 openstack. common. service [-] ******* ******* ******* ******* ******* ******* ******* ******* ******* ******* ******* *** log_opt_values /usr/local/ lib/python2. 7/dist- packages/ oslo_config/ cfg.py: 2052 openstack. common. service [-] Configuration options gathered from: log_opt_values /usr/local/ lib/python2. 7/dist- packages/ oslo_config/ cfg.py: 2053 openstack. common. se...
2015-04-20 20:08:24.358 9450 INFO keystone.
2015-04-20 20:08:24.359 9442 INFO keystone.
2015-04-20 20:08:24.360 9457 INFO keystone.
2015-04-20 20:08:24.361 9451 INFO keystone.
2015-04-20 20:08:24.361 9452 INFO keystone.
2015-04-20 20:08:24.363 9453 INFO keystone.
2015-04-20 20:08:24.367 9455 INFO keystone.
2015-04-20 20:08:24.369 9456 INFO keystone.
2015-04-20 20:08:24.369 9442 INFO keystone.
2015-04-20 20:08:24.369 9442 INFO keystone.
2015-04-20 20:08:24.370 9442 INFO keystone.
2015-04-20 20:08:24.370 9442 INFO keystone.
2015-04-20 20:08:24.370 9442 INFO keystone.
2015-04-20 20:08:24.371 9442 INFO keystone.
2015-04-20 20:08:24.371 9442 INFO keystone.
2015-04-20 20:08:24.371 9454 INFO keystone.
2015-04-20 20:08:24.371 9442 INFO keystone.
2015-04-20 20:08:24.372 9442 INFO keystone.
2015-04-20 20:08:24.372 9442 INFO keystone.
2015-04-20 20:08:24.373 9442 INFO keystone.
2015-04-20 20:08:24.378 9442 INFO keystone.
2015-04-20 20:08:24.378 9442 INFO keystone.
2015-04-20 20:08:24.379 9442 DEBUG keystone.
2015-04-20 20:08:24.379 9442 DEBUG keystone.
2015-04-20 20:08:24.379 9442 DEBUG keystone.
2015-04-20 20:08:24.379 9442 DEBUG keystone.