rbd-provisioner pod in ERROR status for a short period

[Peng Peng]

Brief Description
-----------------
On Platform only system, rbd-provisioner pod in ERROR status for just few seconds. Couple of minutes before, it has host-swact, not sure whether it is related.

Severity
--------
Minor

Steps to Reproduce
------------------
check pod status

TC-name:

Expected Behavior
------------------
pod status should not be error

Actual Behavior
----------------
pod status is error

Reproducibility
---------------
Intermittent

System Configuration
--------------------
Multi-node system

Lab-name:

Branch/Pull Time/Commit
-----------------------
stx master as of 20190604T144018Z

Last Pass
---------
20190604T144018Z

Timestamp/Logs
--------------
[2019-06-07 08:27:56,157] 262 DEBUG MainThread ssh.send :: Send 'system --os-username 'admin' --os-password 'Li69nux*' --os-project-name admin --os-auth-url http://192.168.204.2:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne host-swact controller-1

[2019-06-07 08:29:55,809] 262 DEBUG MainThread ssh.send :: Send 'kubectl get pod --all-namespaces -o wide'
kube-system rbd-provisioner-557fcf8c7d-t48x7 1/1 Running 0 17m 172.16.166.132 controller-1 <none> <none>
kube-system rbd-provisioner-557fcf8c7d-wnlq7 1/1 Running 1 53m 172.16.192.69 controller-0 <none> <none>

[2019-06-07 08:30:01,076] 262 DEBUG MainThread ssh.send :: Send 'kubectl get pod,service,deployment.apps --namespace kube-system -o wide'
pod/rbd-provisioner-557fcf8c7d-t48x7 1/1 Running 0 16m 172.16.166.132 controller-1 <none> <none>
pod/rbd-provisioner-557fcf8c7d-wnlq7 0/1 Error 0 53m 172.16.192.69 controller-0 <none> <none>

[2019-06-07 08:30:11,107] 262 DEBUG MainThread ssh.send :: Send 'kubectl get pod --all-namespaces -o wide'
kube-system rbd-provisioner-557fcf8c7d-t48x7 1/1 Running 0 17m 172.16.166.132 controller-1 <none> <none>
kube-system rbd-provisioner-557fcf8c7d-wnlq7 1/1 Running 1 53m 172.16.192.69 controller-0 <none> <none>

Test Activity
-------------
Sanity

[Ghada Khalil (gkhalil)]

Low priority as there is no system impact and the pod recovered in a few seconds as noted in the description. Doesn't gate any starlingx release.