Failed to pull calico/node:v3.6.1 image through proxy
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Calico Charm |
Fix Released
|
Medium
|
Joseph Borg | ||
Containerd Subordinate Charm |
Fix Released
|
Medium
|
Joseph Borg |
Bug Description
When trying to deploy CDK with Calico in an environment with proxy, the calico units are in error with the following status:
Unit Workload Agent Machine Public address Ports Message
kubernetes-worker/0 waiting idle 11 10.40.69.147 Waiting for cluster DNS.
calico/0* error idle 10.40.69.147 hook failed: "install"
When running debug-log on that unit:
unit-calico-0: 12:23:42 ERROR unit.calico/
Traceback (most recent call last):
File "/var/lib/
bus.
File "/var/lib/
_invoke(
File "/var/lib/
handler.
File "/var/lib/
self.
File "/var/lib/
CTL.pull(image)
File "/var/lib/
return self._exec(*args)
File "/var/lib/
return super()
File "/var/lib/
return sub_run(args, stdout=PIPE, stderr=PIPE, check=True)
File "/usr/lib/
output=stdout, stderr=stderr)
subprocess.
unit-calico-0: 12:23:42 DEBUG unit.calico/
unit-calico-0: 12:23:42 DEBUG unit.calico/
unit-calico-0: 12:23:42 DEBUG unit.calico/
unit-calico-0: 12:23:42 DEBUG unit.calico/
unit-calico-0: 12:23:42 DEBUG unit.calico/
unit-calico-0: 12:23:42 DEBUG unit.calico/
unit-calico-0: 12:23:42 DEBUG unit.calico/
unit-calico-0: 12:23:42 DEBUG unit.calico/
unit-calico-0: 12:23:42 DEBUG unit.calico/
unit-calico-0: 12:23:42 DEBUG unit.calico/
unit-calico-0: 12:23:42 DEBUG unit.calico/
unit-calico-0: 12:23:42 DEBUG unit.calico/
unit-calico-0: 12:23:42 DEBUG unit.calico/
The bundle contains, as a config for the containerd charm, the necessary proxy options:
containerd:
charm: cs:~containers/
options:
http_proxy: 'http://
https_proxy: 'http://
no_proxy: '.customerdomain'
When ssh'ing into the unit, I can see that the proxy.conf file for the containerd service is properly configured:
cat /etc/systemd/
[Service]
Environment=
If I try to use ctr to pull the image, it fails with:
sudo ctr --debug image pull rocks.canonical
DEBU[0000] fetching image="
DEBU[0000] resolving
DEBU[0000] do request request.
ctr: failed to resolve reference "rocks.
When I set the environment variables as root, pulling the images with ctr succeeds:
sudo -i root@juju-
root@juju-
DEBU[0000] fetch response received response.
...
Changed in charm-containerd: | |
assignee: | nobody → Joseph Borg (joeborg) |
importance: | Undecided → Critical |
status: | New → In Progress |
Changed in charm-containerd: | |
status: | In Progress → Fix Released |
Changed in charm-calico: | |
status: | New → Fix Released |
Changed in charm-containerd: | |
status: | Fix Released → Fix Committed |
Changed in charm-calico: | |
status: | Fix Released → Fix Committed |
importance: | Undecided → Medium |
assignee: | nobody → Joseph Borg (joeborg) |
Changed in charm-calico: | |
milestone: | none → 1.17 |
Changed in charm-containerd: | |
milestone: | none → 1.17 |
Changed in charm-calico: | |
status: | Fix Committed → Fix Released |
Changed in charm-containerd: | |
status: | Fix Committed → Fix Released |
juju-crashdump: https:/ /drive. google. com/open? id=10Vd06s5WSLg wSXEutbgQC3tb7P c4v21x /drive. google. com/open? id=1YzWEGCVdYjv mdlsG121XzPhWto jcSRWs
export-bundle: https:/