| 2020-08-25 19:04:39 |
Anujeyan Manokeran |
bug |
|
|
added bug |
| 2020-08-25 19:06:26 |
Anujeyan Manokeran |
tags |
|
stx.retestneeded |
|
| 2020-08-25 19:08:08 |
Anujeyan Manokeran |
attachment added |
|
collect logs https://bugs.launchpad.net/starlingx/+bug/1892907/+attachment/5404515/+files/ALL_NODES_20200824.044508.tar |
|
| 2020-08-26 17:55:21 |
Ghada Khalil |
summary |
Ceph starrage condition alarm was not cleared after lock and unlock controller and swact |
Ceph storage condition alarm was not cleared after lock and unlock controller and swact |
|
| 2020-08-26 17:58:17 |
Ghada Khalil |
tags |
stx.retestneeded |
stx.5.0 stx.retestneeded stx.storage |
|
| 2020-08-26 17:58:47 |
Ghada Khalil |
starlingx: importance |
Undecided |
Medium |
|
| 2020-08-26 17:58:49 |
Ghada Khalil |
starlingx: status |
New |
Triaged |
|
| 2020-08-26 17:58:59 |
Ghada Khalil |
starlingx: assignee |
|
Elena Taivan (etaivan) |
|
| 2020-09-22 13:45:20 |
Anujeyan Manokeran |
description |
Brief Description
---------------------------------
During the automation run on while configuring PTP interface over dedicated interface below alarms are displayed. These alarms are generated during the controller-0 lock and unlock then swact controller-0. Later “Ceph Storage Alarm Condition: health warn” was not cleared.
fm --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne alarm-list --nowrap'
[2020-08-24 05:27:18,788] 436 DEBUG MainThread ssh.expect :: Output:
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| 700.016 | Multi-Node Recovery Mode | subsystem=vim | major | 2020-08-24T05:26:13.657625 |
| 800.001 | Storage Alarm Condition: HEALTH_WARN. Please check 'ceph -s' for more details. | cluster=5df66a40-7bf8-46a7-8e2b-d5e0cda289b2 | warning | 2020-08-24T05:16:07.536024 |
| 750.006 | A configuration change requires a reapply of the cert-manager application. | k8s_application=cert-manager | warning | 2020-08-24T05:15:03.793042 |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+--------------------------
[2020-08-24 05:35:56,206] 314 DEBUG MainThread ssh.send :: Send 'fm --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne alarm-list --nowrap'
[2020-08-24 05:35:58,214] 436 DEBUG MainThread ssh.expect :: Output:
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| 800.001 | Storage Alarm Condition: HEALTH_WARN. Please check 'ceph -s' for more details. | cluster=5df66a40-7bf8-46a7-8e2b-d5e0cda289b2 | warning | 2020-08-24T05:33:27.691966 |
Steps to Reproduce
------------------
1. Initial health condition no alarm.
2. Configure PTP on system
3. Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne ptp-show'
[2020-08-24 05:08:47,810] 436 DEBUG MainThread ssh.expect :: Output:
+--------------+--------------------------------------+
| Property | Value |
+--------------+--------------------------------------+
| uuid | 42dd70b4-facf-4e3b-8c6b-5b58f4289f5e |
| mode | hardware |
| transport | l2 |
| mechanism | p2p |
| isystem_uuid | c88683bf-42fc-4907-8658-50e2084c5f11 |
| created_at | 2020-08-23T19:27:24.954757+00:00 |
| updated_at | 2020-08-24T03:50:41.607423+00:00 |
+--------------+--------------------------------------+
'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne service-parameter-add ptp global delay_mechanism=p2p'
[2020-08-24 05:09:04,802] 436 DEBUG MainThread ssh.expect :: Output:
+-------------+--------------------------------------+
| Property | Value |
+-------------+--------------------------------------+
| uuid | 25696c3b-4e72-495a-9375-f63ccb736ea0 |
| service | ptp |
| section | global |
| name | delay_mechanism |
| value | p2p |
| personality | None |
| resource | None |
+-------------+--------------------------------------+
system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne service-parameter-add ptp global domainNumber=24'
[2020-08-24 05:09:12,100] 436 DEBUG MainThread ssh.expect :: Output:
+-------------+--------------------------------------+
| Property | Value |
+-------------+--------------------------------------+
| uuid | bc44edaf-8ca0-4e46-a01c-675ff444c57a |
| service | ptp |
| section | global |
| name | domainNumber |
| value | 24 |
| personality | None |
| resource | None |
+-------------+--------------------------------------+
4. Locking and unlocking controller-0
'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-lock controller-0'
system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne storage-backend-list'
[2020-08-24 05:10:49,749] 436 DEBUG MainThread ssh.expect :: Output:
+--------------------------------------+------------+---------+------------+-------------------+----------+----------------------------------------------------------------------+
| uuid | name | backend | state | task | services | capabilities |
+--------------------------------------+------------+---------+------------+-------------------+----------+----------------------------------------------------------------------+
| f30c1cc8-356a-4d9f-81a9-45690c36b177 | ceph-store | ceph | configured | provision-storage | None | min_replication: 1 replication: 2 |
| | | | | | | |
+--------------------------------------+------------+---------+------------+-------------------+----------+----------------------------------------------------------------------+
5. system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-if-modify controller-0 mgmt0 --ptp-role none'
6. 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-if-modify controller-0 ptp0 --ptp-role slave'
7. lock compute-1 and unlock
'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-lock compute-1'
8. system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-swact controller-1'
[2020-08-24 05:25:59,871] 436 DEBUG MainThread ssh.expect :: Output:
System Configuration
--------------------
regular system WCP7-10
Expected Behavior
------------------
alarm should be cleared after lock and unlock .
Actual Behavior
----------------
As description says alarms are not cleared.
Reproducibility
---------------
Seen only once
Load
----
2020-08-22_20-00-00
Last Pass
---------
2020-07-31_20-00-00 in WCP-7-10
Timestamp/Logs
--------------
fm --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne alarm-list --nowrap'
[2020-08-24 05:27:18,788] 436 DEBUG MainThread ssh.expect :: Output:
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| 700.016 | Multi-Node Recovery Mode | subsystem=vim | major | 2020-08-24T05:26:13.657625 |
| 800.001 | Storage Alarm Condition: HEALTH_WARN. Please check 'ceph -s' for more details. | cluster=5df66a40-7bf8-46a7-8e2b-d5e0cda289b2 | warning | 2020-08-24T05:16:07.536024 |
| 750.006 | A configuration change requires a reapply of the cert-manager application. | k8s_application=cert-manager | warning | 2020-08-24T05:15:03.793042 |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+--------------------------
Test Activity
-------------
Automated regression |
Brief Description
---------------------------------
During the automation run on while configuring PTP interface over dedicated interface below alarms are displayed. These alarms are generated during the controller-0 lock and unlock then swact controller-0. Later “Ceph Storage Alarm Condition: health warn” was not cleared.
fm --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne alarm-list --nowrap'
[2020-08-24 05:27:18,788] 436 DEBUG MainThread ssh.expect :: Output:
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| 700.016 | Multi-Node Recovery Mode | subsystem=vim | major | 2020-08-24T05:26:13.657625 |
| 800.001 | Storage Alarm Condition: HEALTH_WARN. Please check 'ceph -s' for more details. | cluster=5df66a40-7bf8-46a7-8e2b-d5e0cda289b2 | warning | 2020-08-24T05:16:07.536024 |
| 750.006 | A configuration change requires a reapply of the cert-manager application. | k8s_application=cert-manager | warning | 2020-08-24T05:15:03.793042 |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+--------------------------
[2020-08-24 05:35:56,206] 314 DEBUG MainThread ssh.send :: Send 'fm --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne alarm-list --nowrap'
[2020-08-24 05:35:58,214] 436 DEBUG MainThread ssh.expect :: Output:
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| 800.001 | Storage Alarm Condition: HEALTH_WARN. Please check 'ceph -s' for more details. | cluster=5df66a40-7bf8-46a7-8e2b-d5e0cda289b2 | warning | 2020-08-24T05:33:27.691966 |
Steps to Reproduce
------------------
1. Initial health condition no alarm.
2. Configure PTP on system
3. Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne ptp-show'
[2020-08-24 05:08:47,810] 436 DEBUG MainThread ssh.expect :: Output:
+--------------+--------------------------------------+
| Property | Value |
+--------------+--------------------------------------+
| uuid | 42dd70b4-facf-4e3b-8c6b-5b58f4289f5e |
| mode | hardware |
| transport | l2 |
| mechanism | p2p |
| isystem_uuid | c88683bf-42fc-4907-8658-50e2084c5f11 |
| created_at | 2020-08-23T19:27:24.954757+00:00 |
| updated_at | 2020-08-24T03:50:41.607423+00:00 |
+--------------+--------------------------------------+
'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne service-parameter-add ptp global delay_mechanism=p2p'
[2020-08-24 05:09:04,802] 436 DEBUG MainThread ssh.expect :: Output:
+-------------+--------------------------------------+
| Property | Value |
+-------------+--------------------------------------+
| uuid | 25696c3b-4e72-495a-9375-f63ccb736ea0 |
| service | ptp |
| section | global |
| name | delay_mechanism |
| value | p2p |
| personality | None |
| resource | None |
+-------------+--------------------------------------+
system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne service-parameter-add ptp global domainNumber=24'
[2020-08-24 05:09:12,100] 436 DEBUG MainThread ssh.expect :: Output:
+-------------+--------------------------------------+
| Property | Value |
+-------------+--------------------------------------+
| uuid | bc44edaf-8ca0-4e46-a01c-675ff444c57a |
| service | ptp |
| section | global |
| name | domainNumber |
| value | 24 |
| personality | None |
| resource | None |
+-------------+--------------------------------------+
4. Locking and unlocking controller-0
'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-lock controller-0'
system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne storage-backend-list'
[2020-08-24 05:10:49,749] 436 DEBUG MainThread ssh.expect :: Output:
+--------------------------------------+------------+---------+------------+-------------------+----------+----------------------------------------------------------------------+
| uuid | name | backend | state | task | services | capabilities |
+--------------------------------------+------------+---------+------------+-------------------+----------+----------------------------------------------------------------------+
| f30c1cc8-356a-4d9f-81a9-45690c36b177 | ceph-store | ceph | configured | provision-storage | None | min_replication: 1 replication: 2 |
| | | | | | | |
+--------------------------------------+------------+---------+------------+-------------------+----------+----------------------------------------------------------------------+
5. system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-if-modify controller-0 mgmt0 --ptp-role none'
6. 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-if-modify controller-0 ptp0 --ptp-role slave'
7. lock compute-1 and unlock
'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-lock compute-1'
8. system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-swact controller-1'
[2020-08-24 05:25:59,871] 436 DEBUG MainThread ssh.expect :: Output:
System Configuration
--------------------
regular system WCP7-10
Expected Behavior
------------------
alarm should be cleared after lock and unlock .
Actual Behavior
----------------
As description says alarms are not cleared.
Reproducibility
---------------
100% replaceable in WCP_7_10.
Load
----
2020-08-22_20-00-00
Last Pass
---------
2020-07-31_20-00-00 in WCP-7-10
Timestamp/Logs
--------------
fm --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne alarm-list --nowrap'
[2020-08-24 05:27:18,788] 436 DEBUG MainThread ssh.expect :: Output:
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| 700.016 | Multi-Node Recovery Mode | subsystem=vim | major | 2020-08-24T05:26:13.657625 |
| 800.001 | Storage Alarm Condition: HEALTH_WARN. Please check 'ceph -s' for more details. | cluster=5df66a40-7bf8-46a7-8e2b-d5e0cda289b2 | warning | 2020-08-24T05:16:07.536024 |
| 750.006 | A configuration change requires a reapply of the cert-manager application. | k8s_application=cert-manager | warning | 2020-08-24T05:15:03.793042 |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+--------------------------
Test Activity
-------------
Automated regression |
|
| 2020-09-22 13:46:08 |
Anujeyan Manokeran |
description |
Brief Description
---------------------------------
During the automation run on while configuring PTP interface over dedicated interface below alarms are displayed. These alarms are generated during the controller-0 lock and unlock then swact controller-0. Later “Ceph Storage Alarm Condition: health warn” was not cleared.
fm --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne alarm-list --nowrap'
[2020-08-24 05:27:18,788] 436 DEBUG MainThread ssh.expect :: Output:
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| 700.016 | Multi-Node Recovery Mode | subsystem=vim | major | 2020-08-24T05:26:13.657625 |
| 800.001 | Storage Alarm Condition: HEALTH_WARN. Please check 'ceph -s' for more details. | cluster=5df66a40-7bf8-46a7-8e2b-d5e0cda289b2 | warning | 2020-08-24T05:16:07.536024 |
| 750.006 | A configuration change requires a reapply of the cert-manager application. | k8s_application=cert-manager | warning | 2020-08-24T05:15:03.793042 |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+--------------------------
[2020-08-24 05:35:56,206] 314 DEBUG MainThread ssh.send :: Send 'fm --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne alarm-list --nowrap'
[2020-08-24 05:35:58,214] 436 DEBUG MainThread ssh.expect :: Output:
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| 800.001 | Storage Alarm Condition: HEALTH_WARN. Please check 'ceph -s' for more details. | cluster=5df66a40-7bf8-46a7-8e2b-d5e0cda289b2 | warning | 2020-08-24T05:33:27.691966 |
Steps to Reproduce
------------------
1. Initial health condition no alarm.
2. Configure PTP on system
3. Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne ptp-show'
[2020-08-24 05:08:47,810] 436 DEBUG MainThread ssh.expect :: Output:
+--------------+--------------------------------------+
| Property | Value |
+--------------+--------------------------------------+
| uuid | 42dd70b4-facf-4e3b-8c6b-5b58f4289f5e |
| mode | hardware |
| transport | l2 |
| mechanism | p2p |
| isystem_uuid | c88683bf-42fc-4907-8658-50e2084c5f11 |
| created_at | 2020-08-23T19:27:24.954757+00:00 |
| updated_at | 2020-08-24T03:50:41.607423+00:00 |
+--------------+--------------------------------------+
'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne service-parameter-add ptp global delay_mechanism=p2p'
[2020-08-24 05:09:04,802] 436 DEBUG MainThread ssh.expect :: Output:
+-------------+--------------------------------------+
| Property | Value |
+-------------+--------------------------------------+
| uuid | 25696c3b-4e72-495a-9375-f63ccb736ea0 |
| service | ptp |
| section | global |
| name | delay_mechanism |
| value | p2p |
| personality | None |
| resource | None |
+-------------+--------------------------------------+
system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne service-parameter-add ptp global domainNumber=24'
[2020-08-24 05:09:12,100] 436 DEBUG MainThread ssh.expect :: Output:
+-------------+--------------------------------------+
| Property | Value |
+-------------+--------------------------------------+
| uuid | bc44edaf-8ca0-4e46-a01c-675ff444c57a |
| service | ptp |
| section | global |
| name | domainNumber |
| value | 24 |
| personality | None |
| resource | None |
+-------------+--------------------------------------+
4. Locking and unlocking controller-0
'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-lock controller-0'
system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne storage-backend-list'
[2020-08-24 05:10:49,749] 436 DEBUG MainThread ssh.expect :: Output:
+--------------------------------------+------------+---------+------------+-------------------+----------+----------------------------------------------------------------------+
| uuid | name | backend | state | task | services | capabilities |
+--------------------------------------+------------+---------+------------+-------------------+----------+----------------------------------------------------------------------+
| f30c1cc8-356a-4d9f-81a9-45690c36b177 | ceph-store | ceph | configured | provision-storage | None | min_replication: 1 replication: 2 |
| | | | | | | |
+--------------------------------------+------------+---------+------------+-------------------+----------+----------------------------------------------------------------------+
5. system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-if-modify controller-0 mgmt0 --ptp-role none'
6. 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-if-modify controller-0 ptp0 --ptp-role slave'
7. lock compute-1 and unlock
'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-lock compute-1'
8. system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-swact controller-1'
[2020-08-24 05:25:59,871] 436 DEBUG MainThread ssh.expect :: Output:
System Configuration
--------------------
regular system WCP7-10
Expected Behavior
------------------
alarm should be cleared after lock and unlock .
Actual Behavior
----------------
As description says alarms are not cleared.
Reproducibility
---------------
100% replaceable in WCP_7_10.
Load
----
2020-08-22_20-00-00
Last Pass
---------
2020-07-31_20-00-00 in WCP-7-10
Timestamp/Logs
--------------
fm --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne alarm-list --nowrap'
[2020-08-24 05:27:18,788] 436 DEBUG MainThread ssh.expect :: Output:
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| 700.016 | Multi-Node Recovery Mode | subsystem=vim | major | 2020-08-24T05:26:13.657625 |
| 800.001 | Storage Alarm Condition: HEALTH_WARN. Please check 'ceph -s' for more details. | cluster=5df66a40-7bf8-46a7-8e2b-d5e0cda289b2 | warning | 2020-08-24T05:16:07.536024 |
| 750.006 | A configuration change requires a reapply of the cert-manager application. | k8s_application=cert-manager | warning | 2020-08-24T05:15:03.793042 |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+--------------------------
Test Activity
-------------
Automated regression |
Brief Description
---------------------------------
During the automation run on while configuring PTP interface over dedicated interface below alarms are displayed. These alarms are generated during the controller-0 lock and unlock then swact controller-0. Later “Ceph Storage Alarm Condition: health warn” was not cleared.
fm --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne alarm-list --nowrap'
[2020-08-24 05:27:18,788] 436 DEBUG MainThread ssh.expect :: Output:
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| 700.016 | Multi-Node Recovery Mode | subsystem=vim | major | 2020-08-24T05:26:13.657625 |
| 800.001 | Storage Alarm Condition: HEALTH_WARN. Please check 'ceph -s' for more details. | cluster=5df66a40-7bf8-46a7-8e2b-d5e0cda289b2 | warning | 2020-08-24T05:16:07.536024 |
| 750.006 | A configuration change requires a reapply of the cert-manager application. | k8s_application=cert-manager | warning | 2020-08-24T05:15:03.793042 |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+--------------------------
[2020-08-24 05:35:56,206] 314 DEBUG MainThread ssh.send :: Send 'fm --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne alarm-list --nowrap'
[2020-08-24 05:35:58,214] 436 DEBUG MainThread ssh.expect :: Output:
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| 800.001 | Storage Alarm Condition: HEALTH_WARN. Please check 'ceph -s' for more details. | cluster=5df66a40-7bf8-46a7-8e2b-d5e0cda289b2 | warning | 2020-08-24T05:33:27.691966 |
Steps to Reproduce
------------------
1. Initial health condition no alarm.
2. Configure PTP on system
3. Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne ptp-show'
[2020-08-24 05:08:47,810] 436 DEBUG MainThread ssh.expect :: Output:
+--------------+--------------------------------------+
| Property | Value |
+--------------+--------------------------------------+
| uuid | 42dd70b4-facf-4e3b-8c6b-5b58f4289f5e |
| mode | hardware |
| transport | l2 |
| mechanism | p2p |
| isystem_uuid | c88683bf-42fc-4907-8658-50e2084c5f11 |
| created_at | 2020-08-23T19:27:24.954757+00:00 |
| updated_at | 2020-08-24T03:50:41.607423+00:00 |
+--------------+--------------------------------------+
'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne service-parameter-add ptp global delay_mechanism=p2p'
[2020-08-24 05:09:04,802] 436 DEBUG MainThread ssh.expect :: Output:
+-------------+--------------------------------------+
| Property | Value |
+-------------+--------------------------------------+
| uuid | 25696c3b-4e72-495a-9375-f63ccb736ea0 |
| service | ptp |
| section | global |
| name | delay_mechanism |
| value | p2p |
| personality | None |
| resource | None |
+-------------+--------------------------------------+
system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne service-parameter-add ptp global domainNumber=24'
[2020-08-24 05:09:12,100] 436 DEBUG MainThread ssh.expect :: Output:
+-------------+--------------------------------------+
| Property | Value |
+-------------+--------------------------------------+
| uuid | bc44edaf-8ca0-4e46-a01c-675ff444c57a |
| service | ptp |
| section | global |
| name | domainNumber |
| value | 24 |
| personality | None |
| resource | None |
+-------------+--------------------------------------+
4. Locking and unlocking controller-0
'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-lock controller-0'
system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne storage-backend-list'
[2020-08-24 05:10:49,749] 436 DEBUG MainThread ssh.expect :: Output:
+--------------------------------------+------------+---------+------------+-------------------+----------+----------------------------------------------------------------------+
| uuid | name | backend | state | task | services | capabilities |
+--------------------------------------+------------+---------+------------+-------------------+----------+----------------------------------------------------------------------+
| f30c1cc8-356a-4d9f-81a9-45690c36b177 | ceph-store | ceph | configured | provision-storage | None | min_replication: 1 replication: 2 |
| | | | | | | |
+--------------------------------------+------------+---------+------------+-------------------+----------+----------------------------------------------------------------------+
5. system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-if-modify controller-0 mgmt0 --ptp-role none'
6. 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-if-modify controller-0 ptp0 --ptp-role slave'
7. lock compute-1 and unlock
'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-lock compute-1'
8. system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-swact controller-1'
[2020-08-24 05:25:59,871] 436 DEBUG MainThread ssh.expect :: Output:
System Configuration
--------------------
regular system WCP7-10
Expected Behavior
------------------
alarm should be cleared after lock and unlock .
Actual Behavior
----------------
As description says alarms are not cleared.
Reproducibility
---------------
100% reproducible in WCP_7_10.
Load
----
2020-08-22_20-00-00
Last Pass
---------
2020-07-31_20-00-00 in WCP-7-10
Timestamp/Logs
--------------
fm --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.144.1:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne alarm-list --nowrap'
[2020-08-24 05:27:18,788] 436 DEBUG MainThread ssh.expect :: Output:
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+----------------------------+
| 700.016 | Multi-Node Recovery Mode | subsystem=vim | major | 2020-08-24T05:26:13.657625 |
| 800.001 | Storage Alarm Condition: HEALTH_WARN. Please check 'ceph -s' for more details. | cluster=5df66a40-7bf8-46a7-8e2b-d5e0cda289b2 | warning | 2020-08-24T05:16:07.536024 |
| 750.006 | A configuration change requires a reapply of the cert-manager application. | k8s_application=cert-manager | warning | 2020-08-24T05:15:03.793042 |
+----------+--------------------------------------------------------------------------------+----------------------------------------------+----------+--------------------------
Test Activity
-------------
Automated regression |
|
| 2021-01-04 16:15:58 |
Bob Church |
starlingx: assignee |
Elena Taivan (etaivan) |
Bob Church (rchurch) |
|
| 2021-04-16 14:45:36 |
Frank Miller |
starlingx: status |
Triaged |
Won't Fix |
|
| 2021-10-27 14:09:09 |
Ghada Khalil |
tags |
stx.5.0 stx.retestneeded stx.storage |
stx.5.0 stx.storage |
|
