StarlingX

  1. Bug #1847607
  2. Comment #4

Comment 4 for bug 1847607

Revision history for this message
Yang Liu (yliu12) wrote : Re: IPv6 regular, 5 mins after swact calico-kube-controllers pod not getting ready

Pod logs when this happens:

Events:
  Type Reason Age From Message
  ---- ------ ---- ---- -------
  Warning Unhealthy 21m (x2 over 22m) kubelet, controller-0 Readiness probe failed: Error reaching apiserver: Get https://10.96.0.1:443/apis/crd.projectcalico.org/v1/clusterinformations/default: context deadline exceeded with http status code: 0; Error verifying datastore: Get https://10.96.0.1:443/apis/crd.projectcalico.org/v1/clusterinformations/default: context deadline exceeded
  Warning Unhealthy 20m (x2 over 23m) kubelet, controller-0 Readiness probe failed: Error reaching apiserver: taking a long time to check apiserver; Error verifying datastore: Get https://10.96.0.1:443/apis/crd.projectcalico.org/v1/clusterinformations/default: context deadline exceeded
  Warning Unhealthy 19m (x15 over 24m) kubelet, controller-0 Readiness probe failed: Error verifying datastore: Get https://10.96.0.1:443/apis/crd.projectcalico.org/v1/clusterinformations/default: context deadline exceeded; Error reaching apiserver: taking a long time to check apiserver
  Warning Unhealthy 9m3s (x36 over 23m) kubelet, controller-0 Readiness probe failed: Error verifying datastore: Get https://10.96.0.1:443/apis/crd.projectcalico.org/v1/clusterinformations/default: context deadline exceeded; Error reaching apiserver: Get https://10.96.0.1:443/apis/crd.projectcalico.org/v1/clusterinformations/default: context deadline exceeded with http status code: 0

2019-10-11 19:47:56.516 [ERROR][1] main.go 178: Failed to verify datastore error=Get https://10.96.0.1:443/apis/crd.projectcalico.org/v1/clusterinformations/default: context deadline exceeded
2019-10-11 19:48:28.516 [ERROR][1] main.go 209: Failed to reach apiserver error=Get https://10.96.0.1:443/apis/crd.projectcalico.org/v1/clusterinformations/default: context deadline exceeded
2019-10-11 19:48:48.517 [ERROR][1] client.go 232: Error getting cluster information config ClusterInformation="default" error=Get https://10.96.0.1:443/apis/crd.projectcalico.org/v1/clusterinformations/default: context deadline exceeded
2019-10-11 19:48:48.517 [ERROR][1] main.go 178: Failed to verify datastore error=Get https://10.96.0.1:443/apis/crd.projectcalico.org/v1/clusterinformations/default: context deadline exceeded
2019-10-11 19:49:20.517 [ERROR][1] main.go 209: Failed to reach apiserver error=Get https://10.96.0.1:443/apis/crd.projectcalico.org/v1/clusterinformations/default: context deadline exceeded
E1011 19:49:35.818826 1 streamwatcher.go:109] Unable to decode an event from the watch stream: read tcp 172.16.192.68:47170->10.96.0.1:443: read: connection timed out
2019-10-11 19:49:35.818 [ERROR][1] client.go 232: Error getting cluster information config ClusterInformation="default" error=Get https://10.96.0.1:443/apis/crd.projectcalico.org/v1/clusterinformations/default: read tcp 172.16.192.68:47170->10.96.0.1:443: read: connection timed out
2019-10-11 19:49:35.818 [ERROR][1] main.go 178: Failed to verify datastore error=Get https://10.96.0.1:443/apis/crd.projectcalico.org/v1/clusterinformations/default: read tcp 172.16.192.68:47170->10.96.0.1:443: read: connection timed out