Containers: openstack pods failed after force rebooting active controller
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
StarlingX |
Fix Released
|
Medium
|
Chris Friesen |
Bug Description
Brief Description
-----------------
Openstack pods in bad states affer force rebooting active controller
Severity
--------
Major
Steps to Reproduce
------------------
- Install and configure system, apply stx-openstack application
- 'sudo reboot -f' from active controller
Expected Behavior
------------------
- system swacted to the other controller, pods are in good states. i.e., Running or Completed.
Actual Behavior
----------------
- After force rebooting the controller, a number of openstack pods stuck in Pending/Init state.
[wrsroot@
NAMESPACE NAME READY STATUS RESTARTS AGE
openstack aodh-api-
openstack aodh-evaluator-
openstack aodh-listener-
openstack aodh-notifier-
openstack ceilometer-
openstack cinder-
openstack cinder-
openstack cinder-
openstack cinder-
openstack cinder-
openstack glance-
openstack gnocchi-
openstack gnocchi-
openstack gnocchi-
openstack heat-api-
openstack heat-cfn-
openstack heat-engine-
openstack heat-engine-
openstack horizon-
openstack keystone-
openstack keystone-
openstack neutron-
openstack nova-api-
openstack nova-api-
openstack nova-api-
openstack nova-api-
openstack nova-cell-
openstack nova-compute-
openstack nova-compute-
openstack nova-conductor-
openstack nova-conductor-
openstack nova-consoleaut
openstack nova-consoleaut
openstack nova-db-init-m7jvd 0/3 Init:0/1 0 16h
openstack nova-db-sync-g75rz 0/1 Init:0/1 0 16h
openstack nova-ks-
openstack nova-ks-user-6rsd5 0/1 Init:0/1 0 16h
openstack nova-novncproxy
openstack nova-placement-
openstack nova-placement-
openstack nova-scheduler-
openstack nova-scheduler-
openstack panko-api-
openstack panko-events-
openstack placement-
openstack placement-
openstack placement-
openstack prometheus-
Reproducibility
---------------
Intermittent
System Configuration
-------
Multi-node system
Branch/Pull Time/Commit
-------
master as of 2019-02-15
Timestamp/Logs
--------------
[2019-02-20 01:40:28,952] 139 INFO MainThread host_helper.
[2019-02-20 01:40:28,952] 262 DEBUG MainThread ssh.send :: Send 'sudo reboot -f'
tags: |
added: stx.2.0 removed: stx.2019.05 |
tags: | added: stx.retestneeded |
tags: | added: stx.regression |
Changed in starlingx: | |
status: | Fix Committed → Fix Released |
description: | updated |
Marking as release gating; issue impacts container env. Medium priority as issue is intermittent