When CK 1.24 is deployed with k-c-p inside of a LXD container the csi-rbdplugin pod gets stuck in a CrashLoopBackOff.
kubectl logs csi-rbdplugin-qvztj csi-rbdplugin
W1129 19:28:38.706385 26140 rbd_attach.go:209] rbd-nbd: nbd modprobe failed with error an error (exit status 1) occurred while running modprobe args: [nbd]
I1129 19:28:38.741112 26140 cephcsi.go:171] Driver version: v3.5.1 and Git version: 00f88e58a0b08be3d7ea009a0cfde8dca23021bf
I1129 19:28:38.741193 26140 cephcsi.go:220] Starting driver type: rbd with name: rbd.csi.ceph.com
I1129 19:28:38.741678 26140 server.go:114] listening for CSI-Addons requests on address: &net.UnixAddr{Name:"/csi/csi-addons.sock", Net:"unix"}
I1129 19:28:38.751582 26140 mount_linux.go:218] Cannot run systemd-run, assuming non-systemd OS
I1129 19:28:38.751599 26140 mount_linux.go:219] systemd-run output: System has not been booted with systemd as init system (PID 1). Can't operate.
Failed to create bus connection: Host is down
, failed with: exit status 1
E1129 19:28:38.756864 26140 rbd_util.go:241] modprobe failed: an error (exit status 1) occurred while running modprobe args: [rbd]
F1129 19:28:38.756892 26140 driver.go:148] an error (exit status 1) occurred while running modprobe args: [rbd]
goroutine 1 [running]:
k8s.io/klog/v2.stacks(0x1)
/go/src/github.com/ceph/ceph-csi/vendor/k8s.io/klog/v2/klog.go:1038 +0x8a
k8s.io/klog/v2.(*loggingT).output(0x322f0c0, 0x3, 0x0, 0xc00021e150, 0x1, {0x25ad879, 0x10}, 0x322fd40, 0x0)
/go/src/github.com/ceph/ceph-csi/vendor/k8s.io/klog/v2/klog.go:987 +0x5fd
k8s.io/klog/v2.(*loggingT).printDepth(0xc0000405f0, 0x44, 0x0, {0x0, 0x0}, 0x3, {0xc0003b6bd0, 0x1, 0x1})
/go/src/github.com/ceph/ceph-csi/vendor/k8s.io/klog/v2/klog.go:735 +0x1ae
k8s.io/klog/v2.FatalDepth(...)
/go/src/github.com/ceph/ceph-csi/vendor/k8s.io/klog/v2/klog.go:1518
github.com/ceph/ceph-csi/internal/util/log.FatalLogMsg({0xc0000405a0, 0x7ffe361a65bc}, {0x0, 0x0, 0x7ffe361a6637})
/go/src/github.com/ceph/ceph-csi/internal/util/log/log.go:59 +0x9e
github.com/ceph/ceph-csi/internal/rbd/driver.(*Driver).Run(0xc00025f050, 0x322f2e0)
/go/src/github.com/ceph/ceph-csi/internal/rbd/driver/driver.go:148 +0xa25
main.main()
/go/src/github.com/ceph/ceph-csi/cmd/cephcsi.go:226 +0x991
goroutine 19 [chan receive]:
k8s.io/klog/v2.(*loggingT).flushDaemon(0x0)
/go/src/github.com/ceph/ceph-csi/vendor/k8s.io/klog/v2/klog.go:1181 +0x6a
created by k8s.io/klog/v2.init.0
/go/src/github.com/ceph/ceph-csi/vendor/k8s.io/klog/v2/klog.go:420 +0xfb
goroutine 57 [sleep]:
time.Sleep(0x6fc23ac00)
/usr/local/go/src/runtime/time.go:193 +0x12e
sigs.k8s.io/controller-runtime/pkg/log.init.0.func1()
/go/src/github.com/ceph/ceph-csi/vendor/sigs.k8s.io/controller-runtime/pkg/log/log.go:63 +0x38
created by sigs.k8s.io/controller-runtime/pkg/log.init.0
/go/src/github.com/ceph/ceph-csi/vendor/sigs.k8s.io/controller-runtime/pkg/log/log.go:62 +0x25
goroutine 70 [IO wait]:
internal/poll.runtime_pollWait(0x7fe83000fcc8, 0x72)
/usr/local/go/src/runtime/netpoll.go:234 +0x89
internal/poll.(*pollDesc).wait(0xc000095e00, 0xec, 0x0)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:84 +0x32
internal/poll.(*pollDesc).waitRead(...)
/usr/local/go/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000095e00)
/usr/local/go/src/internal/poll/fd_unix.go:402 +0x22c
net.(*netFD).accept(0xc000095e00)
/usr/local/go/src/net/fd_unix.go:173 +0x35
net.(*UnixListener).accept(0xc0005381c8)
/usr/local/go/src/net/unixsock_posix.go:167 +0x1c
net.(*UnixListener).Accept(0xc00025f290)
/usr/local/go/src/net/unixsock.go:260 +0x3d
google.golang.org/grpc.(*Server).Serve(0xc00063b340, {0x20b7cf0, 0xc00025f290})
/go/src/github.com/ceph/ceph-csi/vendor/google.golang.org/grpc/server.go:779 +0x362
github.com/ceph/ceph-csi/internal/csi-addons/server.(*CSIAddonsServer).serve(0xc0005c8300, {0x20b7cf0, 0xc00025f290})
/go/src/github.com/ceph/ceph-csi/internal/csi-addons/server/server.go:117 +0x7f
created by github.com/ceph/ceph-csi/internal/csi-addons/server.(*CSIAddonsServer).Start
/go/src/github.com/ceph/ceph-csi/internal/csi-addons/server/server.go:106 +0x2ef
On the physical host, running `sudo modprobe rbd` resolves the issue until a reboot.
https:/