Comment 0 for bug 1849688

Revision history for this message
Yang Liu (yliu12) wrote : platform-integ-apps apply-failed after lock/unlock controller - tiller pod stuck at MatchNodeSelector

Brief Description
-----------------
platform-integ-apps in apply-failed state after lock unlock controller-0 on a simplex system.
tiller pod stuck at MatchNodeSelector.

Severity
--------
Major

Steps to Reproduce
------------------
1. Install and configure a simplex system --> Initial apply was successful
2. lock/unlock controller

TC-name: test_lock_unlock_host[controller]

Expected Behavior
------------------
2. lock/unlock succeeded, system is still healthy after that

Actual Behavior
----------------
2. lock/unlock succeeded, but platform-integ-apps failed, tiller pod stuck at MatchNodeSelector.

Reproducibility
---------------
Not sure. Only tried once.

System Configuration
--------------------
One node system
Lab-name: wcp122

Branch/Pull Time/Commit
-----------------------
2019-10-23_20-00-00

Last Pass
---------
2019-10-21_20-00-00 on same system

Timestamp/Logs
--------------
[2019-10-24 07:04:45,331] 311 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.204.2:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-lock controller-0'

[2019-10-24 07:05:24,844] 311 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.204.2:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-unlock controller-0'

[2019-10-24 07:14:26,862] 433 DEBUG MainThread ssh.expect :: Output:
NAMESPACE NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
kube-system tiller-deploy-d6b59fcb-z4jzg 0/1 MatchNodeSelector 0 34m <none> controller-0 <none> <none>

[2019-10-24 07:14:48,208] 311 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.204.2:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne application-list'
+---------------------+---------+-------------------------------+---------------+--------------+------------------------------------------+
| application | version | manifest name | manifest file | status | progress |
+---------------------+---------+-------------------------------+---------------+--------------+------------------------------------------+
| platform-integ-apps | 1.0-8 | platform-integration-manifest | manifest.yaml | apply-failed | operation aborted, check logs for detail |
+---------------------+---------+-------------------------------+---------------+--------------+------------------------------------------+

Test Activity
-------------
Sanity