kubernetes HPA can't work:
---
Warning FailedGetResourceMetric 3m (x226 over 16h) horizontal-pod-autoscaler unable to get metrics for resource cpu: failed to get pod resource metrics: an error on the server ("Error: 'dial tcp 10.100.93.2:8082: connect: connection timed out'\nTrying to reach: 'http://10.100.93.2:8082/apis/metrics/v1alpha1/namespaces/default/pods?labelSelector=run%3Dphp-apache'") has prevented the request from succeeding (get services http:heapster:)
---
the log mean that kube-apiserver can't access heapster, but I cant access heapster on minion node.
---
[root@cl-ptct2aceh-0-lrtdb33taapq-kube-master-uxythaeaxs7e dashboard]# curl 10.100.93.6:8082
^C
[root@cl-ptct2aceh-0-lrtdb33taapq-kube-master-uxythaeaxs7e dashboard]# ping 10.100.93.9
PING 10.100.93.9 (10.100.93.9) 56(84) bytes of data.
^C
--- 10.100.93.9 ping statistics ---
7 packets transmitted, 0 received, 100% packet loss, time 6132ms
[root@cl-gj6xa5wxt-0-qjzkktc2bwdx-kube-minion-lnpu6xqe5qp2 ~]# curl http://10.100.93.6:8082/apis/metrics/v1alpha1/namespaces/default/pods?labelSelector=run%3Dphp-apache
{
"metadata": {},
"items": [
{
"metadata": {
"name": "php-apache-757c76488d-cmrmj",
"namespace": "default",
"creationTimestamp": "2018-03-22T04:22:21Z"
},
"timestamp": "2018-03-22T04:22:00Z",
"window": "1m0s",
"containers": [
{
"name": "php-apache",
"usage": {
"cpu": "0",
"memory": "14720Ki"
}
}
]
}
]
}
---
So I think the network of cluster has issuse:
If there is no flannel or calico service on master, how kube-apiserver access heapster?
cc @Spyros Trigazis
I think we should specify hostnetwork=true for heapster.
I have test it:
[root@cl-
NAME REFERENCE TARGETS MINPODS MAXPODS REPLICAS AGE
php-apache Deployment/
php-apache2 Deployment/
do you agree?