alarm 900.006 "Device image update operation in progress" raises and keeps on SystemController

[Difu Hu]

Brief Description
-----------------
alarm 900.006 "Device image update operation in progress" raises and keeps on SystemController
(delete image on SystemController can remove the alarm)

Severity
--------
Minor

Steps to Reproduce
------------------
apply label to image: system --os-region-name SystemController device-image-apply 4868ef33-bbe3-44a0-8d8b-a0454a726bfa subcloud=abc

Expected Behavior
------------------
alarm 900.006 "Device image update operation in progress" should NOT be raised on SystemController

Actual Behavior
----------------
alarm 900.006 "Device image update operation in progress" appears and keeps on SystemController

Reproducibility
---------------
permanent

System Configuration
--------------------
Lab-name: DC-3

Branch/Pull Time/Commit
-----------------------
2020-07-31_20-00-00

Last Pass
---------
N/A

Timestamp/Logs
--------------
after apply label to image:
[sysadmin@controller-0 ~(keystone_admin)]$ system --os-region-name SystemController device-image-apply 4868ef33-bbe3-44a0-8d8b-a0454a726bfa subcloud=abc
+----------------+--------------------------------------+
| Property | Value |
+----------------+--------------------------------------+
| uuid | 4868ef33-bbe3-44a0-8d8b-a0454a726bfa |
| bitstream_type | functional |
| pci_vendor | 8086 |
| pci_device | 0b30 |
| bitstream_id | 1 |
| key_signature | None |
| revoke_key_id | None |
| name | None |
| description | None |
| image_version | None |
| applied | True |
| applied_labels | [{u'subcloud': u'abc'}] |
+----------------+--------------------------------------+
[sysadmin@controller-0 ~(keystone_admin)]$ system device-image-list
+--------------------------------------+-------------+---------+---------+------------+------------+---------+------+-------------+----------+---------+-------------------------+
| uuid | bitstream_t | pci_ven | pci_dev | bitstream_ | key_signat | revoke_ | name | description | image_ve | applied | applied_labels |
| | ype | dor | ice | id | ure | key_id | | | rsion | | |
+--------------------------------------+-------------+---------+---------+------------+------------+---------+------+-------------+----------+---------+-------------------------+
| 4868ef33-bbe3-44a0-8d8b-a0454a726bfa | functional | 8086 | 0b30 | 1 | None | None | None | None | None | True | [{u'subcloud': u'abc'}] |
+--------------------------------------+-------------+---------+---------+------------+------------+---------+------+-------------+----------+---------+-------------------------+

[sysadmin@controller-0 ~(keystone_admin)]$ fm alarm-list
+----------+---------------------------------------------------------------------------------------------------+--------------------------------------+----------+-------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+---------------------------------------------------------------------------------------------------+--------------------------------------+----------+-------------------+
| 280.002 | subcloud2 firmware sync_status is out-of-sync | subcloud=subcloud2.resource=firmware | major | 2020-08-03T16:27: |
| | | | | 22.322551 |
| | | | | |
| 280.002 | subcloud4 firmware sync_status is out-of-sync | subcloud=subcloud4.resource=firmware | major | 2020-08-03T16:27: |
| | | | | 22.162206 |
| | | | | |
| 280.002 | subcloud1 firmware sync_status is out-of-sync | subcloud=subcloud1.resource=firmware | major | 2020-08-03T16:27: |
| | | | | 21.921476 |
| | | | | |
| 280.002 | subcloud3 firmware sync_status is out-of-sync | subcloud=subcloud3.resource=firmware | major | 2020-08-03T16:27: |
| | | | | 21.721117 |
| | | | | |
| 900.006 | Device image update operation in progress | system= | minor | 2020-08-03T16:27: |
| | | bc5e4940-1a10-41a7-a5d8-cf6ae1def9f2 | | 16.714525 |

after "dcmanager fw-update-strategy apply" complete"
[sysadmin@controller-0 ~(keystone_admin)]$ dcmanager fw-update-strategy show
+------------------------+----------------------------+
| Field | Value |
+------------------------+----------------------------+
| strategy type | firmware |
| subcloud apply type | None |
| max parallel subclouds | None |
| stop on failure | False |
| state | complete |
| created_at | 2020-08-03 16:33:26.039897 |
| updated_at | 2020-08-03 18:09:21.092916 |
+------------------------+----------------------------+

[sysadmin@controller-0 ~(keystone_admin)]$ fm alarm-list
+----------+---------------------------------------------------------------------------------------------------+--------------------------------------+----------+-------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+---------------------------------------------------------------------------------------------------+--------------------------------------+----------+-------------------+
| 900.006 | Device image update operation in progress | system= | minor | 2020-08-03T16:27: |
| | | bc5e4940-1a10-41a7-a5d8-cf6ae1def9f2 | | 16.714525 |

Test Activity
-------------
Functional Testing

[Ghada Khalil (gkhalil)]

As per Teresa Ho, this is fixed by https://review.opendev.org/#/c/744051/
which was merged in stx master on 2020-07-31. This just missed the load used by the tester.

[Ghada Khalil (gkhalil)]

Marking as stx.5.0 - issue related to DC FPGA Orchestration feature

[Difu Hu (difuhu)]

Verified on build 2020-08-06_20-00-00.