| 2019-05-16 15:28:26 |
Peng Peng |
bug |
|
|
added bug |
| 2019-05-16 15:35:18 |
Peng Peng |
attachment added |
|
ALL_NODES_20190516.151251.tar https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5264298/+files/ALL_NODES_20190516.151251.tar |
|
| 2019-05-16 15:41:13 |
Peng Peng |
attachment added |
|
compute-3_console.txt https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5264307/+files/compute-3_console.txt |
|
| 2019-05-16 15:59:32 |
Numan Waheed |
tags |
|
stx.retestneeded |
|
| 2019-05-16 20:59:40 |
Ghada Khalil |
tags |
stx.retestneeded |
stx.networking stx.retestneeded |
|
| 2019-05-16 21:00:04 |
Ghada Khalil |
starlingx: assignee |
|
Forrest Zhao (forrest.zhao) |
|
| 2019-05-16 21:00:59 |
Ghada Khalil |
description |
Brief Description
-----------------
During lab initial period, after unlock compute nodes, one of the compute node keep "offline"
Severity
--------
Major
Steps to Reproduce
------------------
TC-name:
Expected Behavior
------------------
Actual Behavior
----------------
Reproducibility
---------------
Reproducible
System Configuration
--------------------
Multi-node system
Lab-name: WCP_113-121
Branch/Pull Time/Commit
-----------------------
stx master as of 20190515T220331Z
Last Pass
---------
TC_19.05_Build/2019-05-09_16-05-20
Timestamp/Logs
--------------
[2019-05-16 08:01:40,938] 262 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne host-list --nowrap'
[2019-05-16 08:01:42,478] 387 DEBUG MainThread ssh.expect :: Output:
+----+--------------+-------------+----------------+-------------+--------------+
| id | hostname | personality | administrative | operational | availability |
+----+--------------+-------------+----------------+-------------+--------------+
| 1 | controller-0 | controller | unlocked | enabled | available |
| 2 | controller-1 | controller | unlocked | enabled | available |
| 3 | storage-0 | storage | unlocked | enabled | available |
| 4 | storage-1 | storage | unlocked | enabled | degraded |
| 5 | compute-0 | worker | locked | disabled | online |
| 6 | compute-1 | worker | locked | disabled | online |
| 7 | compute-2 | worker | locked | disabled | online |
| 8 | compute-3 | worker | locked | disabled | online |
| 9 | compute-4 | worker | locked | disabled | online |
+----+--------------+-------------+----------------+-------------+--------------+
[2019-05-16 08:02:30,918] 262 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne host-unlock compute-3'
[2019-05-16 08:25:49,329] 262 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne host-list --nowrap'
[2019-05-16 08:25:50,848] 387 DEBUG MainThread ssh.expect :: Output:
+----+--------------+-------------+----------------+-------------+--------------+
| id | hostname | personality | administrative | operational | availability |
+----+--------------+-------------+----------------+-------------+--------------+
| 1 | controller-0 | controller | unlocked | enabled | available |
| 2 | controller-1 | controller | unlocked | enabled | available |
| 3 | storage-0 | storage | unlocked | enabled | available |
| 4 | storage-1 | storage | unlocked | enabled | available |
| 5 | compute-0 | worker | unlocked | enabled | available |
| 6 | compute-1 | worker | unlocked | enabled | available |
| 7 | compute-2 | worker | unlocked | enabled | available |
| 8 | compute-3 | worker | unlocked | disabled | offline |
| 9 | compute-4 | worker | unlocked | enabled | available |
+----+--------------+-------------+----------------+-------------+--------------+
Test Activity
-------------
lab setup |
Brief Description
-----------------
During lab initial period, after unlock compute nodes, one of the compute node keep "offline"
Severity
--------
Major
Steps to Reproduce
------------------
- Commission lab
- unlock worker/compute nodes
Expected Behavior
------------------
- All compute nodes are enabled without issues
Actual Behavior
----------------
- one compute node remains offline
Reproducibility
---------------
Reproducible
System Configuration
--------------------
Multi-node system
Lab-name: WCP_113-121
Branch/Pull Time/Commit
-----------------------
stx master as of 20190515T220331Z
Last Pass
---------
2019-05-09_16-05-20
Timestamp/Logs
--------------
[2019-05-16 08:01:40,938] 262 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne host-list --nowrap'
[2019-05-16 08:01:42,478] 387 DEBUG MainThread ssh.expect :: Output:
+----+--------------+-------------+----------------+-------------+--------------+
| id | hostname | personality | administrative | operational | availability |
+----+--------------+-------------+----------------+-------------+--------------+
| 1 | controller-0 | controller | unlocked | enabled | available |
| 2 | controller-1 | controller | unlocked | enabled | available |
| 3 | storage-0 | storage | unlocked | enabled | available |
| 4 | storage-1 | storage | unlocked | enabled | degraded |
| 5 | compute-0 | worker | locked | disabled | online |
| 6 | compute-1 | worker | locked | disabled | online |
| 7 | compute-2 | worker | locked | disabled | online |
| 8 | compute-3 | worker | locked | disabled | online |
| 9 | compute-4 | worker | locked | disabled | online |
+----+--------------+-------------+----------------+-------------+--------------+
[2019-05-16 08:02:30,918] 262 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne host-unlock compute-3'
[2019-05-16 08:25:49,329] 262 DEBUG MainThread ssh.send :: Send 'system --os-endpoint-type internalURL --os-region-name RegionOne host-list --nowrap'
[2019-05-16 08:25:50,848] 387 DEBUG MainThread ssh.expect :: Output:
+----+--------------+-------------+----------------+-------------+--------------+
| id | hostname | personality | administrative | operational | availability |
+----+--------------+-------------+----------------+-------------+--------------+
| 1 | controller-0 | controller | unlocked | enabled | available |
| 2 | controller-1 | controller | unlocked | enabled | available |
| 3 | storage-0 | storage | unlocked | enabled | available |
| 4 | storage-1 | storage | unlocked | enabled | available |
| 5 | compute-0 | worker | unlocked | enabled | available |
| 6 | compute-1 | worker | unlocked | enabled | available |
| 7 | compute-2 | worker | unlocked | enabled | available |
| 8 | compute-3 | worker | unlocked | disabled | offline |
| 9 | compute-4 | worker | unlocked | enabled | available |
+----+--------------+-------------+----------------+-------------+--------------+
Test Activity
-------------
lab setup |
|
| 2019-05-16 21:20:39 |
Ghada Khalil |
summary |
compute node keeps offline after unlock |
compute node keeps offline after unlock due to vswitch error |
|
| 2019-05-16 21:38:52 |
Forrest Zhao |
starlingx: assignee |
Forrest Zhao (forrest.zhao) |
ChenjieXu (midone) |
|
| 2019-05-17 12:03:43 |
Forrest Zhao |
starlingx: status |
New |
Incomplete |
|
| 2019-05-21 02:59:53 |
ChenjieXu |
bug |
|
|
added subscriber ChenjieXu |
| 2019-05-21 14:37:39 |
Peng Peng |
attachment added |
|
ovsdb-server.log https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5265298/+files/ovsdb-server.log |
|
| 2019-05-21 14:37:55 |
Peng Peng |
attachment added |
|
ovs-vswitchd.log https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5265299/+files/ovs-vswitchd.log |
|
| 2019-05-22 19:33:19 |
Ghada Khalil |
starlingx: importance |
Undecided |
High |
|
| 2019-05-22 19:33:58 |
Ghada Khalil |
bug |
|
|
added subscriber Ghada Khalil |
| 2019-05-22 19:34:09 |
Ghada Khalil |
tags |
stx.networking stx.retestneeded |
stx.2.0 stx.networking stx.retestneeded |
|
| 2019-05-27 17:46:39 |
Peng Peng |
attachment added |
|
ovs-vswitchd.log https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5266961/+files/ovs-vswitchd.log |
|
| 2019-05-27 17:47:05 |
Peng Peng |
attachment added |
|
ovsdb-server.log https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5266962/+files/ovsdb-server.log |
|
| 2019-05-28 13:11:16 |
Ghada Khalil |
bug |
|
|
added subscriber Allain Legacy |
| 2019-05-29 02:49:25 |
Peng Peng |
attachment added |
|
ovsdb-server.log https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5267263/+files/ovsdb-server.log |
|
| 2019-05-29 02:49:45 |
Peng Peng |
attachment added |
|
ovs-vswitchd.log https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5267264/+files/ovs-vswitchd.log |
|
| 2019-06-06 13:59:49 |
Peng Peng |
attachment added |
|
ovs-vswitchd.log https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5269155/+files/ovs-vswitchd.log |
|
| 2019-06-06 14:00:14 |
Peng Peng |
attachment added |
|
ovsdb-server.log https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5269156/+files/ovsdb-server.log |
|
| 2019-06-10 21:38:54 |
Ghada Khalil |
bug |
|
|
added subscriber Tao Liu |
| 2019-06-10 21:39:18 |
Ghada Khalil |
bug |
|
|
added subscriber Austin Sun |
| 2019-06-12 14:09:12 |
Ghada Khalil |
starlingx: status |
Incomplete |
Triaged |
|
| 2019-06-12 14:09:26 |
Ghada Khalil |
starlingx: assignee |
ChenjieXu (midone) |
Austin Sun (sunausti) |
|
| 2019-06-17 00:48:38 |
Austin Sun |
starlingx: status |
Triaged |
Incomplete |
|
| 2019-07-10 21:35:28 |
Ghada Khalil |
bug |
|
|
added subscriber Cindy Xie |
| 2019-07-10 21:35:58 |
Ghada Khalil |
summary |
compute node keeps offline after unlock due to vswitch error |
compute node keeps offline after unlock due to vswitch error, caused by a hugepage allocation failure |
|
| 2019-07-10 21:42:41 |
Ghada Khalil |
tags |
stx.2.0 stx.networking stx.retestneeded |
stx.2.0 stx.config stx.retestneeded |
|
| 2019-07-23 17:45:23 |
Chris Winnicki |
attachment added |
|
yow-cgcs-wildcat-99-103_ALL_NODES_20190723.141943.tar https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5278735/+files/yow-cgcs-wildcat-99-103_ALL_NODES_20190723.141943.tar |
|
| 2019-07-23 17:46:26 |
Chris Winnicki |
attachment added |
|
yow-cgcs-wildcat-99-103_opt_platform_puppet_19.01_hieradata.tar.gz https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5278736/+files/yow-cgcs-wildcat-99-103_opt_platform_puppet_19.01_hieradata.tar.gz |
|
| 2019-07-23 17:49:19 |
Ghada Khalil |
starlingx: status |
Incomplete |
Confirmed |
|
| 2019-07-25 06:45:39 |
OpenStack Infra |
starlingx: status |
Confirmed |
In Progress |
|
| 2019-07-26 13:58:34 |
Peng Peng |
attachment added |
|
compute-1_20190726.135158.tar https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5279417/+files/compute-1_20190726.135158.tar |
|
| 2019-07-26 13:59:04 |
Peng Peng |
attachment added |
|
ALL_NODES_20190726.134345.tar https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5279418/+files/ALL_NODES_20190726.134345.tar |
|
| 2019-07-26 13:59:22 |
Peng Peng |
attachment added |
|
meminfo_node0 https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5279419/+files/meminfo_node0 |
|
| 2019-07-26 13:59:37 |
Peng Peng |
attachment added |
|
meminfo_node1 https://bugs.launchpad.net/starlingx/+bug/1829403/+attachment/5279420/+files/meminfo_node1 |
|
| 2019-07-29 15:19:33 |
OpenStack Infra |
starlingx: status |
In Progress |
Fix Released |
|
| 2019-08-12 18:06:57 |
Peng Peng |
tags |
stx.2.0 stx.config stx.retestneeded |
stx.2.0 stx.config |
|
