Pike upgrade CI jobs failing due to "openstack-cinder-volume is not running anywhere and so cannot be restarted"
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
tripleo |
Won't Fix
|
Medium
|
Unassigned |
Bug Description
Verifying the CI status page, it can be seen that the CI job gate-tripleo-
When checking the job logs, the error seem to be on the upgrade step:
In the detailed failure log: https:/
Failed Actions:
* rabbitmq_stop_0 on upstream-
Daemon Status:
corosync: active/enabled
pacemaker: active/enabled
+ grep openstack-
pcsd: active/enabled'
+ for service in '$SERVICES_
+ echo 'Restarting openstack-
+ pcs resource restart --wait=600 openstack-
Error: Error performing operation: No such device or address
openstack-
Changed in tripleo: | |
milestone: | none → queens-3 |
importance: | Undecided → Medium |
tags: | added: upgrade |
Changed in tripleo: | |
status: | New → Triaged |
Changed in tripleo: | |
milestone: | queens-3 → queens-rc1 |
Changed in tripleo: | |
milestone: | queens-rc1 → rocky-1 |
Changed in tripleo: | |
milestone: | rocky-1 → rocky-2 |
Journal logs:
Nov 22 01:56:40 upstream- centos- 7-2-node- rdo-cloud- tripleo- 48185-20744 rabbitmq- cluster( rabbitmq) [155874] : ERROR: Unexpected return code from '/usr/sbin/ rabbitmqctl cluster_status' exit code: 1 centos- 7-2-node- rdo-cloud- tripleo- 48185-20744 crmd[110807]: error: Failed to receive meta-data for ocf:heartbeat: galera centos- 7-2-node- rdo-cloud- tripleo- 48185-20744 crmd[110807]: error: No metadata for ocf::heartbeat: galera
Nov 22 01:56:40 upstream-
Nov 22 01:56:40 upstream-
https:/ /logs.rdoprojec t.org/43/ 522043/ 2/openstack- check/gate- tripleo- ci-centos- 7-containers- multinode- upgrades- pike/Z081f531e6 93a49d6a99eab9e 64660a70/ subnode- 2/var/log/ journal. txt.gz# _Nov_22_ 01_56_41