Activity log for bug #1849688

Date Who What changed Old value New value Message
2019-10-24 14:54:37 Yang Liu bug added bug
2019-10-24 14:56:37 Yang Liu attachment added controller-0_20191024.144401.tar https://bugs.launchpad.net/starlingx/+bug/1849688/+attachment/5299779/+files/controller-0_20191024.144401.tar
2019-10-24 15:28:45 Yang Liu summary platform-integ-apps apply-failed after lock/unlock controller - tiller pod stuck at MatchNodeSelector platform-integ-apps apply-failed after lock/unlock controller
2019-10-24 16:36:36 Yang Liu description Brief Description ----------------- platform-integ-apps in apply-failed state after lock unlock controller-0 on a simplex system. tiller pod stuck at MatchNodeSelector. Severity -------- Major Steps to Reproduce ------------------ 1. Install and configure a simplex system --> Initial apply was successful 2. lock/unlock controller TC-name: test_lock_unlock_host[controller] Expected Behavior ------------------ 2. lock/unlock succeeded, system is still healthy after that Actual Behavior ---------------- 2. lock/unlock succeeded, but platform-integ-apps failed, tiller pod stuck at MatchNodeSelector. Reproducibility --------------- Not sure. Only tried once. System Configuration -------------------- One node system Lab-name: wcp122 Branch/Pull Time/Commit ----------------------- 2019-10-23_20-00-00 Last Pass --------- 2019-10-21_20-00-00 on same system Timestamp/Logs -------------- [2019-10-24 07:04:45,331] 311 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.204.2:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-lock controller-0' [2019-10-24 07:05:24,844] 311 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.204.2:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-unlock controller-0' [2019-10-24 07:14:26,862] 433 DEBUG MainThread ssh.expect :: Output: NAMESPACE NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES kube-system tiller-deploy-d6b59fcb-z4jzg 0/1 MatchNodeSelector 0 34m <none> controller-0 <none> <none> [2019-10-24 07:14:48,208] 311 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.204.2:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne application-list' +---------------------+---------+-------------------------------+---------------+--------------+------------------------------------------+ | application | version | manifest name | manifest file | status | progress | +---------------------+---------+-------------------------------+---------------+--------------+------------------------------------------+ | platform-integ-apps | 1.0-8 | platform-integration-manifest | manifest.yaml | apply-failed | operation aborted, check logs for detail | +---------------------+---------+-------------------------------+---------------+--------------+------------------------------------------+ Test Activity ------------- Sanity Brief Description ----------------- platform-integ-apps in apply-failed state after lock unlock controller-0 on a simplex system. tiller pod stuck at MatchNodeSelector. Severity -------- Major Steps to Reproduce ------------------ 1. Install and configure a simplex system --> Initial apply was successful 2. lock/unlock controller TC-name: test_lock_unlock_host[controller] Expected Behavior ------------------ 2. lock/unlock succeeded, system is still healthy after that Actual Behavior ---------------- 2. lock/unlock succeeded, but platform-integ-apps failed, tiller pod stuck at MatchNodeSelector. Reproducibility --------------- Happened 2/3 times on simplex systems. System Configuration -------------------- One node system Lab-name: wcp122 Branch/Pull Time/Commit ----------------------- 2019-10-23_20-00-00 Last Pass --------- 2019-10-21_20-00-00 on same system Timestamp/Logs -------------- [2019-10-24 07:04:45,331] 311 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.204.2:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-lock controller-0' [2019-10-24 07:05:24,844] 311 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.204.2:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-unlock controller-0' [2019-10-24 07:14:26,862] 433 DEBUG MainThread ssh.expect :: Output: NAMESPACE NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES kube-system tiller-deploy-d6b59fcb-z4jzg 0/1 MatchNodeSelector 0 34m <none> controller-0 <none> <none> [2019-10-24 07:14:48,208] 311 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.204.2:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne application-list' +---------------------+---------+-------------------------------+---------------+--------------+------------------------------------------+ | application | version | manifest name | manifest file | status | progress | +---------------------+---------+-------------------------------+---------------+--------------+------------------------------------------+ | platform-integ-apps | 1.0-8 | platform-integration-manifest | manifest.yaml | apply-failed | operation aborted, check logs for detail | +---------------------+---------+-------------------------------+---------------+--------------+------------------------------------------+ Test Activity ------------- Sanity
2019-10-24 19:13:29 Kristine Bujold bug added subscriber Kristine Bujold
2019-10-25 12:43:48 Stefan Dinescu bug added subscriber Stefan Dinescu
2019-10-25 18:45:13 Frank Miller starlingx: assignee Bob Church (rchurch)
2019-10-25 19:13:06 Ghada Khalil starlingx: importance Undecided High
2019-10-25 19:13:27 Ghada Khalil tags stx.containers
2019-10-25 19:14:23 Frank Miller bug added subscriber Bart Wensley
2019-10-25 19:14:35 Frank Miller bug added subscriber Al Bailey
2019-10-25 19:14:52 Ghada Khalil bug added subscriber Bill Zvonar
2019-10-25 19:14:54 Ghada Khalil starlingx: status New Triaged
2019-10-25 19:15:03 Frank Miller bug added subscriber Frank Miller
2019-10-25 19:15:05 Ghada Khalil tags stx.containers stx.3.0 stx.containers
2019-10-31 16:35:59 Yang Liu tags stx.3.0 stx.containers stx.3.0 stx.containers stx.retestneeded
2019-10-31 16:57:15 Bill Zvonar removed subscriber Bill Zvonar
2019-11-04 05:49:44 Venkata Veldanda bug added subscriber Venkata Veldanda
2019-11-13 17:14:01 Frank Miller bug added subscriber Bill Zvonar
2019-11-21 21:59:17 Frank Miller tags stx.3.0 stx.containers stx.retestneeded stx.4.0 stx.containers stx.retestneeded
2019-11-21 21:59:24 Frank Miller starlingx: importance High Medium
2019-12-09 15:26:23 Frank Miller removed subscriber Bill Zvonar
2020-02-13 06:50:43 OpenStack Infra starlingx: status Triaged In Progress
2020-02-14 17:27:28 OpenStack Infra starlingx: status In Progress Fix Released
2020-02-14 17:27:30 OpenStack Infra bug watch added https://github.com/kubernetes/kubernetes/issues/80745
2020-02-14 17:27:30 OpenStack Infra bug watch added https://github.com/kubernetes/kubernetes/issues/85334
2020-02-14 18:14:05 Ghada Khalil bug added subscriber Bill Zvonar
2020-02-26 16:51:12 Yang Liu tags stx.4.0 stx.containers stx.retestneeded stx.4.0 stx.containers
2020-03-31 14:36:11 OpenStack Infra tags stx.4.0 stx.containers in-f-centos8 stx.4.0 stx.containers