Unable to re-execute the SPG migrate command for the failed subclouds even after fixing the issue

[TaoWang]

Brief Description

Unable to re-execute the SPG migrate command for the failed subclouds even after fixing the issue.

Severity

Major

Steps to Reproduce

[sysadmin@controller-0 ~(keystone_admin)]$ dcmanager subcloud-peer-group list-subclouds 1
+----+-----------+-------------+----------+------------------+------------+--------------+---------------+--------------------------+------------------------+---------------------------+------------------------+-----------------------------+----------+---------------+----------------------------+----------------------------+---------------+-----------------+
| id | name | description | location | software_version | management | availability | deploy_status | management_subnet | management_start_ip | management_end_ip | management_gateway_ip | systemcontroller_gateway_ip | group_id | peer_group_id | created_at | updated_at | backup_status | backup_datetime |
+----+-----------+-------------+----------+------------------+------------+--------------+---------------+--------------------------+------------------------+---------------------------+------------------------+-----------------------------+----------+---------------+----------------------------+----------------------------+---------------+-----------------+
| 2 | subcloud3 | | | 23.09 | managed | online | complete | fdff:719a:bf60:1099::/64 | fdff:719a:bf60:1099::2 | fdff:719a:bf60:1099::ffff | fdff:719a:bf60:1099::1 | fdff:719a:bf60:1103::1 | 1 | 1 | 2023-12-19 06:34:14.381649 | 2023-12-19 08:31:41.707693 | None | None |
| 3 | subcloud4 | | | 23.09 | managed | online | complete | fdff:719a:bf60:1109::/64 | fdff:719a:bf60:1109::2 | fdff:719a:bf60:1109::ffff | fdff:719a:bf60:1109::1 | fdff:719a:bf60:1103::1 | 1 | 1 | 2023-12-19 06:40:04.050940 | 2023-12-19 08:24:36.351476 | None | None |
| 4 | subcloud5 | | | 23.09 | unmanaged | offline | rehome-failed | fdff:719a:bf60:1106::/64 | fdff:719a:bf60:1106::2 | fdff:719a:bf60:1106::ffff | fdff:719a:bf60:1106::1 | fdff:719a:bf60:1103::1 | 1 | 1 | 2023-12-19 06:40:04.108424 | 2023-12-19 08:07:26.836077 | None | None |
| 5 | subcloud2 | | | 23.09 | managed | online | complete | fdff:719a:bf60:1098::/64 | fdff:719a:bf60:1098::2 | fdff:719a:bf60:1098::ffff | fdff:719a:bf60:1098::1 | fdff:719a:bf60:1103::1 | 1 | 1 | 2023-12-19 06:40:04.537998 | 2023-12-19 08:31:22.221726 | None | None |
+----+-----------+-------------+----------+------------------+------------+--------------+---------------+--------------------------+------------------------+---------------------------+------------------------+-----------------------------+----------+---------------+----------------------------+----------------------------+---------------+-----------------+
[sysadmin@controller-0 ~(keystone_admin)]$

[sysadmin@controller-0 ~(keystone_admin)]$ dcmanager subcloud-peer-group migrate 1
Enter the sysadmin password for the subcloud:
Re-enter sysadmin password to confirm:
The server could not comply with the request since it is either malformed or otherwise incorrect. Nothing to migrate, no unmanaged and secondary subcloud in SiteA-subcloud-peer-group,
ERROR (app) Unable to migrate subcloud peer group 1

Note: If we have multiple subclouds failed during SPG batch migrate and SPG supports upto 50 subclouds then running individual migrate command for the failed subcloud will be tedious job

Expected Behavior

User should able to re-execute SPG migration in the batch

Actual Behavior

Unable to re-execute SPG migration

Reproducibility

Yes

Load info (eg: 2022-03-10_20-00-07)

[sysadmin@controller-0 ~(keystone_admin)]$ cat /etc/build.info
SW_VERSION="23.09"
BUILD_TARGET="Host Installer"
BUILD_TYPE="Formal"
BUILD_ID="2023-11-30_19-27-37"
SRC_BUILD_ID="1559"

JOB="wrcp-master-debian"
BUILD_BY="jenkins"
BUILD_NUMBER="574"
BUILD_HOST="yow-wrcp-lx.wrs.com"
BUILD_DATE="2023-12-01 00:27:37 +0000"

Last Pass

Timestamp/Logs

Alarms

Test Activity

Feature Testing

Workaround

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/starlingx/distcloud/+/903419

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/starlingx/distcloud/+/903419
Committed: https://opendev.org/starlingx/distcloud/commit/537157c7be3672876663545c1449d61b0ff61d3a
Submitter: "Zuul (22348)"
Branch: master

commit 537157c7be3672876663545c1449d61b0ff61d3a
Author: twang4 <email address hidden>
Date: Thu Dec 21 07:53:01 2023 +0800

    Add support for re-execution of subcloud-peer-group migration

    Add support for the re-execution of the batch migration after user
    fixes the rehome-failed/rehome-prep-failed subcloud(s).

    Test plan:
    - PASS: subcloud-peer-group migrate successfully with secondary
            subclouds.
    - PASS: subcloud-peer-group migrate successfully with
            rehome-failed/rehome-prep-failed subclouds.

    Closes-Bug: 2047018

    Signed-off-by: Wang Tao <email address hidden>
    Change-Id: I869a22476784d1da4b5e2151bbf91f1bd82bd387