We run a bunch of instances both on AWS and GCP, and we run a significant number of containers on both. We've only ever seen this problem on GCP and never on AWS (it's baffling!). The kernels are as-close-as-possible and the rest (Ubuntu version / Docker version / etc) are identical. To answer your questions:
-what release are you using (trusty/xenial/zesty)?
Xenial
-what kernel version are you using?
4.13.0-1008-gcp
-do you have specific steps to reproduce the problem?
Unfortunately we don't. It just happens on its own after 1/2 weeks. The following shows in dmesg:
[1015401.681728] unregister_netdevice: waiting for veth251ecfe to become free. Usage count = 1
[1015411.761772] unregister_netdevice: waiting for veth251ecfe to become free. Usage count = 1
[1015421.841740] unregister_netdevice: waiting for veth251ecfe to become free. Usage count = 1
[1015431.953729] unregister_netdevice: waiting for veth251ecfe to become free. Usage count = 1
etc etc
We've tried a few things including upgrading kernel and disabling IPv6 to no avail.
Hi Dan,
We run a bunch of instances both on AWS and GCP, and we run a significant number of containers on both. We've only ever seen this problem on GCP and never on AWS (it's baffling!). The kernels are as-close- as-possible and the rest (Ubuntu version / Docker version / etc) are identical. To answer your questions:
-what release are you using (trusty/ xenial/ zesty)?
Xenial
-what kernel version are you using?
4.13.0-1008-gcp
-do you have specific steps to reproduce the problem?
Unfortunately we don't. It just happens on its own after 1/2 weeks. The following shows in dmesg:
[1015401.681728] unregister_ netdevice: waiting for veth251ecfe to become free. Usage count = 1 netdevice: waiting for veth251ecfe to become free. Usage count = 1 netdevice: waiting for veth251ecfe to become free. Usage count = 1 netdevice: waiting for veth251ecfe to become free. Usage count = 1
[1015411.761772] unregister_
[1015421.841740] unregister_
[1015431.953729] unregister_
etc etc
We've tried a few things including upgrading kernel and disabling IPv6 to no avail.