br_netfilter module is missing due to conflict

[Andrey Grebennikov]

Fresh deployment of k8s on 18.04.
One unit out of 3 gets into error state with:
unit-containerd-4: 20:07:51 DEBUG unit.containerd/4.install subprocess.CalledProcessError: Command '['modprobe', 'br_netfilter']' returned non-zero exit status 1.
unit-containerd-4: 20:07:51 ERROR juju.worker.uniter.operation hook "install" failed: exit status 1
unit-containerd-4: 20:07:57 INFO unit.containerd/4.juju-log Reactive main running for hook install

Trying to manually execute same command on the node:

root@juju-78db20-2-lxd-2:~# modprobe br_netfilter
modprobe: ERROR: ../libkmod/libkmod.c:586 kmod_search_moddep() could not open moddep file '/lib/modules/4.15.0-54-generic/modules.dep.bin'
modprobe: FATAL: Module br_netfilter not found in directory /lib/modules/4.15.0-54-generic

Looks similar to
https://github.com/moby/moby/issues/38185

[Andrey Grebennikov (agrebennikov)]

Update: all 3 units out of 3 failed with the same error.

[Andrey Grebennikov (agrebennikov)]

one more update - containerd-runtime is related to both and master and worker, only those units that are related to master failed (running in the lxd container)

[George Kraft (cynerva)]

Thanks for the report. This is a known issue with the containerd charm on LXD. See https://bugs.launchpad.net/charm-containerd/+bug/1834524 - I've marked this as a duplicate.

[Andrey Grebennikov (agrebennikov)]

yep, I see it being the same problem. Any eta on the new release of the charm? or I can maybe used proposed/edge?

[George Kraft (cynerva)]

This fix is currently available in the edge channel with cs:~containers/containerd-6. No ETA on release to stable at the moment. Further updates will be posted in https://bugs.launchpad.net/charm-containerd/+bug/1834524.