Storage-services loss of redundancy after lock/unlock of standby controller
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
StarlingX |
Fix Released
|
Medium
|
Mihnea Saracin |
Bug Description
Brief Description
-----------------
After performing a lock/unlock on standby controller, Service group storage-services loss of redundancy; expected 2 active members but only 1 active member available.
Severity
--------
Major
Steps to Reproduce
------------------
testcases/
Expected Behavior
------------------
no storage-services loss of redundancy after lock/unlock standby controller
Actual Behavior
----------------
storage-services loss of redundancy after lock/unlock standby controller
Reproducibility
---------------
Seen once
testcases/
System Configuration
-------
AIO-DX
Branch/Pull Time/Commit
-------
stx master built on 2021-04-28_00-00-08
Last Pass
---------
stx master built on 2021-04-24_00-00-09
Timestamp/Logs
--------------
[2021-04-29 07:24:36,633] 479 DEBUG MainThread ssh.exec_cmd:: Executing command...
[2021-04-29 07:24:36,633] 314 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://
[2021-04-29 07:25:00,842] 436 DEBUG MainThread ssh.expect :: Output:
-------
Property Value
-------
action none
administrative locked
availability online
bm_ip 128.224.64.71
bm_type dynamic
bm_username root
boot_device /dev/disk/
capabilities {u'stor_function': u'monitor'}
clock_synchroni
config_applied 24aada95-
config_status None
config_target 24aada95-
console ttyS0,115200n8
created_at 2021-04-
device_image_update None
hostname controller-1
id 2
install_output text
install_state completed
install_state_info None
inv_state inventoried
invprovision provisioned
location {}
mgmt_ip 192.168.204.3
mgmt_mac 90:e2:ba:b8:90:65
operational disabled
personality controller
reboot_needed False
reserved False
rootfs_device /dev/disk/
serialid None
software_load 21.05
subfunction_avail online
subfunction_oper disabled
subfunctions controller,worker
task Unlocking
tboot false
ttys_dcd None
updated_at 2021-04-
uptime 5021
uuid d37b52b5-
vim_progress_status services-disabled
-------
[2021-04-29 07:35:13,586] 479 DEBUG MainThread ssh.exec_cmd:: Executing command...
[2021-04-29 07:35:13,587] 314 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://
[2021-04-29 07:35:15,506] 436 DEBUG MainThread ssh.expect :: Output:
-------
id hostname personality administrative operational availability
-------
1 controller-0 controller unlocked enabled available
2 controller-1 controller unlocked enabled available
-------
[sysadmin@
[2021-04-29 07:35:15,506] 314 DEBUG MainThread ssh.send :: Send 'echo $?'
[2021-04-29 07:35:15,567] 436 DEBUG MainThread ssh.expect :: Output:
0
[sysadmin@
[2021-04-29 07:35:15,568] 344 DEBUG MainThread system_
[2021-04-29 07:35:16,569] 3939 INFO MainThread system_
[2021-04-29 07:35:16,570] 578 INFO MainThread host_helper.
[2021-04-29 07:35:16,571] 1657 DEBUG MainThread ssh.get_
[2021-04-29 07:35:16,571] 479 DEBUG MainThread ssh.exec_cmd:: Executing command...
[2021-04-29 07:35:16,571] 314 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://
[2021-04-29 07:35:18,466] 436 DEBUG MainThread ssh.expect :: Output:
-------
Property Value
-------
action none
administrative unlocked
availability available
bm_ip 128.224.64.71
bm_type dynamic
bm_username root
boot_device /dev/disk/
capabilities {u'stor_function': u'monitor', u'Personality': u'Controller-
clock_synchroni
config_applied 24aada95-
config_status None
config_target 24aada95-
console ttyS0,115200n8
created_at 2021-04-
device_image_update None
hostname controller-1
id 2
install_output text
install_state completed
install_state_info None
inv_state inventoried
invprovision provisioned
location {}
mgmt_ip 192.168.204.3
mgmt_mac 90:e2:ba:b8:90:65
operational enabled
personality controller
reboot_needed False
reserved False
rootfs_device /dev/disk/
serialid None
software_load 21.05
subfunction_avail available
subfunction_oper enabled
subfunctions controller,worker
task
tboot false
ttys_dcd None
updated_at 2021-04-
uptime 449
uuid d37b52b5-
vim_progress_status services-enabled
-------
[sysadmin@
[2021-04-29 07:35:18,467] 314 DEBUG MainThread ssh.send :: Send 'echo $?'
[2021-04-29 07:35:18,525] 436 DEBUG MainThread ssh.expect :: Output:
0
[sysadmin@
[2021-04-29 07:35:18,526] 592 INFO MainThread host_helper.
[2021-04-29 07:35:18,527] 535 INFO MainThread host_helper.
[2021-04-29 07:35:18,527] 1914 INFO MainThread host_helper.
[2021-04-29 07:35:18,528] 1657 DEBUG MainThread ssh.get_
[2021-04-29 07:35:18,528] 479 DEBUG MainThread ssh.exec_cmd:: Executing command...
[2021-04-29 07:35:18,528] 314 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://
[2021-04-29 07:35:20,992] 436 DEBUG MainThread ssh.expect :: Output:
-------
uuid service_group_name hostname state
-------
7cf5c2df-
41e0922b-
0da0d27a-
5b10f6cb-
eb3b6103-
c73c4acc-
2852293e-
7b257031-
41171fcf-
739c5cc0-
14f476f5-
eaaa21d7-
9f3003ab-
cefc3b74-
21d04677-
60063eb6-
d4c641cb-
9daa600f-
-------
[2021-04-29 07:35:27,134] 1657 DEBUG MainThread ssh.get_
[2021-04-29 07:35:27,134] 479 DEBUG MainThread ssh.exec_cmd:: Executing command...
[2021-04-29 07:35:27,135] 314 DEBUG MainThread ssh.send :: Send 'fm --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://
[2021-04-29 07:35:28,995] 436 DEBUG MainThread ssh.expect :: Output:
-------
UUID Alarm ID Reason Text Entity ID Severity Time Stamp
-------
e54195fd-
550a64b4-
082c3b90-
-------
Test Activity
-------------
Sanity
CVE References
Changed in starlingx: | |
assignee: | nobody → Mihnea Saracin (msaracin) |
Fix proposed to branch: master /review. opendev. org/c/starlingx /stx-puppet/ +/792143
Review: https:/