| 2022-12-23 20:13:33 |
Ghada Khalil |
description |
Brief Description
-----------------
During optimized restore, while attempting to bring up kubernetes calico cni fails to come up.
kubectl describe -n armada pod armada-api-75f46c4bcf-fh5zt
...
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 6m16s default-scheduler Successfully assigned armada/armada-api-75f46c4bcf-fh5zt to controller-0
Warning FailedCreatePodSandBox 6m15s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b382b76bc742405457075f0b31c6eef65270fe8d427cd8cba3579cf000fd3c6d": plugin type="multus" name="multus-cni-network" failed (add): Multus: [armada/armada-api-75f46c4bcf-fh5zt]: error getting pod: Get "https://[fd04::1]:443/api/v1/namespaces/armada/pods/armada-api-75f46c4bcf-fh5zt?timeout=1m0s": dial tcp [fd04::1]:443: connect: network is unreachable
...
Warning FailedCreatePodSandBox 52s (x17 over 4m19s) kubelet (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9ecf5e809ed3bacfc1e3907d6b0cac2d92626cc6ac56ecf177f2df70c858c336": plugin type="multus" name="multus-cni-network" failed (add): Multus: [armada/armada-api-75f46c4bcf-fh5zt]: error getting pod: Get "https://[fd04::1]:443/api/v1/namespaces/armada/pods/armada-api-75f46c4bcf-fh5zt?timeout=1m0s": dial tcp [fd04::1]:443: connect: network is unreachable
Severity
--------
Critical
Steps to Reproduce
------------------
Run optimized restore
Expected Behavior
------------------
Pass
Actual Behavior
----------------
Fail
Reproducibility
---------------
100% on certain system configurations
System Configuration
--------------------
AIO-SX
Branch/Pull Time/Commit
-----------------------
SW_VERSION="22.12"
BUILD_TARGET="Host Installer"
BUILD_TYPE="Formal"
BUILD_ID="2022-12-19_02-22-00"
SRC_BUILD_ID="38"JOB="wrcp-22.12-debian"
BUILD_BY="jenkins"
BUILD_NUMBER="50"
BUILD_HOST="yow-wrcp-lx.wrs.com"
BUILD_DATE="2022-12-19 07:22:00 +0000"
Last Pass
---------
Yes, it still passes except on certain systems.
Timestamp/Logs
--------------
See above.
Test Activity
-------------
Developer Testing
Workaround
----------
Run:
sudo systemctl restart networking kubelet
Do this after networking is restore but before kubernetes is brought up. |
Brief Description
-----------------
During optimized restore, while attempting to bring up kubernetes calico cni fails to come up.
kubectl describe -n armada pod armada-api-75f46c4bcf-fh5zt
...
Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 6m16s default-scheduler Successfully assigned armada/armada-api-75f46c4bcf-fh5zt to controller-0
Warning FailedCreatePodSandBox 6m15s kubelet Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "b382b76bc742405457075f0b31c6eef65270fe8d427cd8cba3579cf000fd3c6d": plugin type="multus" name="multus-cni-network" failed (add): Multus: [armada/armada-api-75f46c4bcf-fh5zt]: error getting pod: Get "https://[fd04::1]:443/api/v1/namespaces/armada/pods/armada-api-75f46c4bcf-fh5zt?timeout=1m0s": dial tcp [fd04::1]:443: connect: network is unreachable
...
Warning FailedCreatePodSandBox 52s (x17 over 4m19s) kubelet (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to setup network for sandbox "9ecf5e809ed3bacfc1e3907d6b0cac2d92626cc6ac56ecf177f2df70c858c336": plugin type="multus" name="multus-cni-network" failed (add): Multus: [armada/armada-api-75f46c4bcf-fh5zt]: error getting pod: Get "https://[fd04::1]:443/api/v1/namespaces/armada/pods/armada-api-75f46c4bcf-fh5zt?timeout=1m0s": dial tcp [fd04::1]:443: connect: network is unreachable
Severity
--------
Critical
Steps to Reproduce
------------------
Run optimized restore
Expected Behavior
------------------
Pass
Actual Behavior
----------------
Fail
Reproducibility
---------------
100% on certain system configurations
System Configuration
--------------------
AIO-SX
Branch/Pull Time/Commit
-----------------------
master branch. BUILD_ID="2022-12-19_02-22-00"
Last Pass
---------
Yes, it still passes except on certain systems.
Timestamp/Logs
--------------
See above.
Test Activity
-------------
Developer Testing
Workaround
----------
Run:
sudo systemctl restart networking kubelet
Do this after networking is restore but before kubernetes is brought up. |
|
