subcloud3 and subcloud4 kept out-of-sync after "dcmanager fw-update-strategy apply"
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
StarlingX |
Triaged
|
Low
|
Ghada Khalil |
Bug Description
Brief Description
-----------------
subcloud3 and subcloud4 kept out-of-sync after "dcmanager fw-update-strategy apply" (more than 2 hours)
subcloud1 and subcloud2 became in-sync as expected.
Severity
--------
Major
Steps to Reproduce
------------------
system --os-region-name SystemController device-image-apply 63d85a33-
dcmanager fw-update-strategy create --subcloud-
dcmanager fw-update-strategy apply
Expected Behavior
------------------
all 4 subclouds update complete and in-sync
Actual Behavior
----------------
all 4 subclouds update complete, but subcloud3 and subcloud4 keeps out-of-sync
Reproducibility
---------------
not sure
System Configuration
-------
Lab-name: DC-3
Branch/Pull Time/Commit
-------
2020-07-31_20-00-00
Last Pass
---------
N/A
Timestamp/Logs
--------------
[sysadmin@
+------
| Property | Value |
+------
| uuid | 63d85a33-
| bitstream_type | functional |
| pci_vendor | 8086 |
| pci_device | 0b30 |
| bitstream_id | 11 |
| key_signature | None |
| revoke_key_id | None |
| name | None |
| description | None |
| image_version | None |
| applied | True |
| applied_labels | [{u'subcloud': u'abc'}, {u'subcloud3': u'3'}, {u'subcloud4': u'4'}] |
+------
[sysadmin@
+------
| Field | Value |
+------
| strategy type | firmware |
| subcloud apply type | serial |
| max parallel subclouds | None |
| stop on failure | False |
| state | initial |
| created_at | 2020-08-
| updated_at | None |
+------
[sysadmin@
+------
| Field | Value |
+------
| strategy type | firmware |
| subcloud apply type | serial |
| max parallel subclouds | None |
| stop on failure | False |
| state | applying |
| created_at | 2020-08-
| updated_at | 2020-08-
+------
[sysadmin@
+------
| cloud | stage | state | details | started_at | finished_at |
+------
| subcloud1 | 2 | complete | | 2020-08-03 20:26:56.114160 | 2020-08-03 21:12:30.289524 |
| subcloud2 | 3 | complete | | 2020-08-03 21:12:38.813454 | 2020-08-03 21:58:02.459198 |
| subcloud3 | 4 | applying fw update strategy | apply phase is 16% complete | 2020-08-03 21:58:11.055072 | None |
| subcloud4 | 5 | initial | | None | None |
+------
[sysadmin@
+------
| cloud | stage | state | details | started_at | finished_at |
+------
| subcloud1 | 2 | complete | | 2020-08-03 20:26:56.114160 | 2020-08-03 21:12:30.289524 |
| subcloud2 | 3 | complete | | 2020-08-03 21:12:38.813454 | 2020-08-03 21:58:02.459198 |
| subcloud3 | 4 | complete | | 2020-08-03 21:58:11.055072 | 2020-08-03 22:42:44.662378 |
| subcloud4 | 5 | complete | | 2020-08-03 22:42:53.327048 | 2020-08-03 23:28:47.047164 |
+------
[sysadmin@
+----+-
| id | name | management | availability | deploy status | sync |
+----+-
| 1 | subcloud1 | managed | online | complete | in-sync |
| 2 | subcloud2 | managed | online | complete | in-sync |
| 3 | subcloud3 | managed | online | complete | out-of-sync |
| 4 | subcloud4 | managed | online | complete | out-of-sync |
+----+-
[sysadmin@
Tue Aug 4 01:24:50 UTC 2020
[sysadmin@
+------
| Field | Value |
+------
| id | 3 |
| name | subcloud3 |
| description | None |
| location | None |
| software_version | 20.06 |
| management | managed |
| availability | online |
| deploy_status | complete |
| management_subnet | fd01:303::0/64 |
| management_start_ip | fd01:303::2 |
| management_end_ip | fd01:303::11 |
| management_
| systemcontrolle
| group_id | 1 |
| created_at | 2020-08-02 03:06:47.540678 |
| updated_at | 2020-08-03 22:40:04.965372 |
| dc-cert_sync_status | in-sync |
| firmware_
| identity_
| load_sync_status | in-sync |
| patching_
| platform_
+------
[sysadmin@
+------
| Field | Value |
+------
| id | 4 |
| name | subcloud4 |
| description | None |
| location | None |
| software_version | 20.06 |
| management | managed |
| availability | online |
| deploy_status | complete |
| management_subnet | fd01:304::0/64 |
| management_start_ip | fd01:304::2 |
| management_end_ip | fd01:304::11 |
| management_
| systemcontrolle
| group_id | 1 |
| created_at | 2020-08-02 03:07:00.766138 |
| updated_at | 2020-08-03 23:26:09.679729 |
| dc-cert_sync_status | in-sync |
| firmware_
| identity_
| load_sync_status | in-sync |
| patching_
| platform_
+------
Test Activity
-------------
Functional Testing
Changed in starlingx: | |
assignee: | nobody → Jessica Castelino (jcasteli) |
Changed in starlingx: | |
importance: | Undecided → High |
status: | New → Triaged |
log: https:/ /files. starlingx. kube.cengn. ca/launchpad/ 1890295