Activity log for bug #1879690

Date Who What changed Old value New value Message
2020-05-20 12:04:33 Juerg Haefliger bug added bug
2020-05-20 12:04:43 Juerg Haefliger nominated for series Ubuntu Focal
2020-05-20 12:04:43 Juerg Haefliger bug task added linux (Ubuntu Focal)
2020-05-20 12:04:43 Juerg Haefliger nominated for series Ubuntu Eoan
2020-05-20 12:04:43 Juerg Haefliger bug task added linux (Ubuntu Eoan)
2020-05-20 12:05:07 Juerg Haefliger description Affected kernels: Focal 5.4.0-31.35 Eoan 5.3.0-53.47 To reproduce: 1) Spin up a cloud image 2) snap install docker 3) auth_folder=/var/snap/docker/common/auth 4) mkdir -p $auth_folder 5) docker run --entrypoint htpasswd registry:2 -Bbn user passwd > $auth_folder/htpasswd 6) docker run -d -p 5000:5000 --restart=always --name registry \ -v $auth_folder:/auth \ -e "REGISTRY_AUTH=htpasswd" \ -e "REGISTRY_AUTH_HTPASSWD_REALM=Registry Realm" \ -e REGISTRY_AUTH_HTPASSWD_PATH=/auth/htpasswd \ registry:2 On a good kernel 'docker ps' shows something like: # docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES a346b65b4509 registry:2 "/entrypoint.sh /etc…" 14 seconds ago Up 12 seconds 0.0.0.0:5000->5000/tcp registry On a bad kernel: docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 0322374f1b1d registry:2 "/entrypoint.sh /etc…" 5 seconds ago Restarting (2) 1 second ago registry Note status 'Restarting' on the bad kernel. This seems to be introduce by any of the following commits: b3bdda24f1bc UBUNTU: SAUCE: overlayfs: fix shitfs special-casing 6f18a8434050 UBUNTU: SAUCE: overlayfs: use shiftfs hacks only with shiftfs as underlay 629edd70891c UBUNTU: SAUCE: shiftfs: record correct creator credentials cfaa482afb97 UBUNTU: SAUCE: shiftfs: fix dentry revalidation Kernels that don't have these commits seem fine. Tested kernels: Focal 5.4.0-31.35 Eoan 5.3.0-53.47 To reproduce: 1) Spin up a cloud image 2) snap install docker 3) auth_folder=/var/snap/docker/common/auth 4) mkdir -p $auth_folder 5) docker run --entrypoint htpasswd registry:2 -Bbn user passwd > $auth_folder/htpasswd 6) docker run -d -p 5000:5000 --restart=always --name registry \   -v $auth_folder:/auth \   -e "REGISTRY_AUTH=htpasswd" \   -e "REGISTRY_AUTH_HTPASSWD_REALM=Registry Realm" \   -e REGISTRY_AUTH_HTPASSWD_PATH=/auth/htpasswd \    registry:2 On a good kernel 'docker ps' shows something like: # docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES a346b65b4509 registry:2 "/entrypoint.sh /etc…" 14 seconds ago Up 12 seconds 0.0.0.0:5000->5000/tcp registry On a bad kernel:  docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 0322374f1b1d registry:2 "/entrypoint.sh /etc…" 5 seconds ago Restarting (2) 1 second ago registry Note status 'Restarting' on the bad kernel. This seems to be introduce by any of the following commits: b3bdda24f1bc UBUNTU: SAUCE: overlayfs: fix shitfs special-casing 6f18a8434050 UBUNTU: SAUCE: overlayfs: use shiftfs hacks only with shiftfs as underlay 629edd70891c UBUNTU: SAUCE: shiftfs: record correct creator credentials cfaa482afb97 UBUNTU: SAUCE: shiftfs: fix dentry revalidation Kernels that don't have these commits seem fine.
2020-05-20 12:30:11 Ubuntu Kernel Bot linux (Ubuntu): status New Incomplete
2020-05-20 12:30:14 Ubuntu Kernel Bot linux (Ubuntu Eoan): status New Incomplete
2020-05-20 12:30:17 Ubuntu Kernel Bot linux (Ubuntu Focal): status New Incomplete
2020-05-20 13:27:09 Kleber Sacilotto de Souza linux (Ubuntu Eoan): status Incomplete Confirmed
2020-05-20 13:27:11 Kleber Sacilotto de Souza linux (Ubuntu Focal): status Incomplete Confirmed
2020-05-20 14:15:32 Juerg Haefliger attachment added dmesg https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1879690/+attachment/5374739/+files/dmesg
2020-05-20 14:23:54 Juerg Haefliger attachment added dmesg.good https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1879690/+attachment/5374740/+files/dmesg.good
2020-05-20 14:24:19 Juerg Haefliger attachment added dmesg.bad https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1879690/+attachment/5374741/+files/dmesg.bad
2020-05-21 10:38:29 Kleber Sacilotto de Souza linux (Ubuntu Eoan): status Confirmed In Progress
2020-05-21 10:38:30 Kleber Sacilotto de Souza linux (Ubuntu Focal): status Confirmed In Progress
2020-05-21 11:09:05 Kleber Sacilotto de Souza description Tested kernels: Focal 5.4.0-31.35 Eoan 5.3.0-53.47 To reproduce: 1) Spin up a cloud image 2) snap install docker 3) auth_folder=/var/snap/docker/common/auth 4) mkdir -p $auth_folder 5) docker run --entrypoint htpasswd registry:2 -Bbn user passwd > $auth_folder/htpasswd 6) docker run -d -p 5000:5000 --restart=always --name registry \   -v $auth_folder:/auth \   -e "REGISTRY_AUTH=htpasswd" \   -e "REGISTRY_AUTH_HTPASSWD_REALM=Registry Realm" \   -e REGISTRY_AUTH_HTPASSWD_PATH=/auth/htpasswd \    registry:2 On a good kernel 'docker ps' shows something like: # docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES a346b65b4509 registry:2 "/entrypoint.sh /etc…" 14 seconds ago Up 12 seconds 0.0.0.0:5000->5000/tcp registry On a bad kernel:  docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 0322374f1b1d registry:2 "/entrypoint.sh /etc…" 5 seconds ago Restarting (2) 1 second ago registry Note status 'Restarting' on the bad kernel. This seems to be introduce by any of the following commits: b3bdda24f1bc UBUNTU: SAUCE: overlayfs: fix shitfs special-casing 6f18a8434050 UBUNTU: SAUCE: overlayfs: use shiftfs hacks only with shiftfs as underlay 629edd70891c UBUNTU: SAUCE: shiftfs: record correct creator credentials cfaa482afb97 UBUNTU: SAUCE: shiftfs: fix dentry revalidation Kernels that don't have these commits seem fine. [Impact] The change applied for bug 1857257 and its followup fix bug 1876645, which were released on focal and eoan -updates, introduced a regression on overlayfs, breaking docker snap. [Test case] See original bug report. [Fix] While we don't have a final fix the solution for now is to revert the following commits: UBUNTU: SAUCE: overlayfs: fix shitfs special-casing UBUNTU: SAUCE: overlayfs: use shiftfs hacks only with shiftfs as underlay [Regression potential] Low. Reverting these two commits will introduce back the issue reported on bug 1857257, but will fix the other use cases which was broken by the latest release. Original bug report. ----------------------------------- Tested kernels: Focal 5.4.0-31.35 Eoan 5.3.0-53.47 To reproduce: 1) Spin up a cloud image 2) snap install docker 3) auth_folder=/var/snap/docker/common/auth 4) mkdir -p $auth_folder 5) docker run --entrypoint htpasswd registry:2 -Bbn user passwd > $auth_folder/htpasswd 6) docker run -d -p 5000:5000 --restart=always --name registry \   -v $auth_folder:/auth \   -e "REGISTRY_AUTH=htpasswd" \   -e "REGISTRY_AUTH_HTPASSWD_REALM=Registry Realm" \   -e REGISTRY_AUTH_HTPASSWD_PATH=/auth/htpasswd \    registry:2 On a good kernel 'docker ps' shows something like: # docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES a346b65b4509 registry:2 "/entrypoint.sh /etc…" 14 seconds ago Up 12 seconds 0.0.0.0:5000->5000/tcp registry On a bad kernel:  docker ps CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 0322374f1b1d registry:2 "/entrypoint.sh /etc…" 5 seconds ago Restarting (2) 1 second ago registry Note status 'Restarting' on the bad kernel. This seems to be introduce by any of the following commits: b3bdda24f1bc UBUNTU: SAUCE: overlayfs: fix shitfs special-casing 6f18a8434050 UBUNTU: SAUCE: overlayfs: use shiftfs hacks only with shiftfs as underlay 629edd70891c UBUNTU: SAUCE: shiftfs: record correct creator credentials cfaa482afb97 UBUNTU: SAUCE: shiftfs: fix dentry revalidation Kernels that don't have these commits seem fine.
2020-05-21 12:45:31 Kleber Sacilotto de Souza linux (Ubuntu Eoan): status In Progress Fix Committed
2020-05-21 13:33:22 Kleber Sacilotto de Souza linux (Ubuntu Focal): status In Progress Fix Committed
2020-05-22 12:51:56 Ubuntu Kernel Bot tags verification-needed-eoan
2020-05-22 15:25:43 Nathan Bryant bug added subscriber Nathan Bryant
2020-05-22 15:42:51 Ubuntu Kernel Bot tags verification-needed-eoan verification-needed-eoan verification-needed-focal
2020-05-25 11:17:13 Kleber Sacilotto de Souza tags verification-needed-eoan verification-needed-focal verification-done-eoan verification-needed-focal
2020-05-25 11:23:09 Kleber Sacilotto de Souza tags verification-done-eoan verification-needed-focal verification-done-eoan verification-done-focal
2020-05-26 15:36:41 Vladimir Kantos bug added subscriber Vladimir Kantos
2020-05-26 20:31:54 Launchpad Janitor linux (Ubuntu Eoan): status Fix Committed Fix Released
2020-05-27 21:00:50 Launchpad Janitor linux (Ubuntu Focal): status Fix Committed Fix Released
2020-07-28 00:57:39 Launchpad Janitor linux (Ubuntu): status Incomplete Fix Released
2020-07-28 00:57:39 Launchpad Janitor cve linked 2019-16089
2020-07-28 00:57:39 Launchpad Janitor cve linked 2019-19642
2020-07-28 00:57:39 Launchpad Janitor cve linked 2020-11935