Activity log for bug #1875884

Date Who What changed Old value New value Message
2020-04-29 12:58:44 Michael Robertson bug added bug
2020-04-30 19:33:43 Terry Rudd bug added subscriber Terry Rudd
2020-04-30 20:10:14 Marcelo Cerri bug task added linux-azure-4.15 (Ubuntu)
2020-04-30 20:10:24 Marcelo Cerri bug task deleted linux-meta-azure (Ubuntu)
2020-04-30 20:10:32 Marcelo Cerri nominated for series Ubuntu Bionic
2020-04-30 20:10:32 Marcelo Cerri bug task added linux-azure-4.15 (Ubuntu Bionic)
2020-05-13 08:32:43 Flemming Frandsen bug task added linux (Ubuntu)
2020-05-13 09:00:09 Ubuntu Kernel Bot linux (Ubuntu): status New Incomplete
2020-05-13 09:00:11 Ubuntu Kernel Bot linux (Ubuntu Bionic): status New Incomplete
2020-05-13 09:43:21 Michael Robertson tags amd64 apport-bug uec-images xenial amd64 apport-bug apport-collected uec-images xenial
2020-05-13 09:43:22 Michael Robertson description OS provided by AKS is currently Ubuntu 16.04.6 LTS, kernel 4.15.0-1077-azure. Every block written by a k8s pod to a ceph CSI volume generates 2 warning lines in the node's system logs (kern.log, syslog, messages, warn): "Apr 24 09:37:46 aks-<nodename> kernel: [242123.654538] ceph: Failed to find inode for 1" Under production load, eventually the node succumbs to DiskPressure as the drive fills up. Also performance is noticeably degraded. Background here: https://tracker.ceph.com/issues/45283 Luis Hernandez indicates 4 commits relating to this issue, just 2 of which have been backported to Ubuntu 16. d557c48db730 ("ceph: quota: add counter for snaprealms with quota") <== e3161f17d926 ("ceph: quota: cache inode pointer in ceph_snap_realm") 0eb6bbe4d9cf ("ceph: fix root quota realm check") <== 2596366907f8 ("ceph: don't check quota for snap inode") Quoth Luis: "I've done a quick test and, after compiling the bionic kernel 4.15.0-96.97 (the latest released), I can reproduce the issue. Cherry-picking the 2 missing commits (2596366907f8 and e3161f17d926) fixes it." In my testing Ubuntu 18 does not exhibit the bug, but Azure support tells me it will be months before they make it GA in AKS. Can we get those commits backported to Ubuntu 16? ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-azure (not installed) ProcVersionSignature: Ubuntu 4.15.0-1077.82-azure 4.15.18 Uname: Linux 4.15.0-1077-azure x86_64 ApportVersion: 2.20.1-0ubuntu2.23 Architecture: amd64 Date: Wed Apr 29 12:45:12 2020 ProcEnviron: TERM=xterm-256color PATH=(custom, no user) LANG=en_US.UTF-8 SHELL=/bin/bash SourcePackage: linux-meta-azure UpgradeStatus: No upgrade log present (probably fresh install) OS provided by AKS is currently Ubuntu 16.04.6 LTS, kernel 4.15.0-1077-azure. Every block written by a k8s pod to a ceph CSI volume generates 2 warning lines in the node's system logs (kern.log, syslog, messages, warn): "Apr 24 09:37:46 aks-<nodename> kernel: [242123.654538] ceph: Failed to find inode for 1" Under production load, eventually the node succumbs to DiskPressure as the drive fills up. Also performance is noticeably degraded. Background here: https://tracker.ceph.com/issues/45283 Luis Hernandez indicates 4 commits relating to this issue, just 2 of which have been backported to Ubuntu 16. d557c48db730 ("ceph: quota: add counter for snaprealms with quota") <== e3161f17d926 ("ceph: quota: cache inode pointer in ceph_snap_realm") 0eb6bbe4d9cf ("ceph: fix root quota realm check") <== 2596366907f8 ("ceph: don't check quota for snap inode") Quoth Luis: "I've done a quick test and, after compiling the bionic kernel 4.15.0-96.97 (the latest released), I can reproduce the issue. Cherry-picking the 2 missing commits (2596366907f8 and e3161f17d926) fixes it." In my testing Ubuntu 18 does not exhibit the bug, but Azure support tells me it will be months before they make it GA in AKS. Can we get those commits backported to Ubuntu 16? ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: linux-azure (not installed) ProcVersionSignature: Ubuntu 4.15.0-1077.82-azure 4.15.18 Uname: Linux 4.15.0-1077-azure x86_64 ApportVersion: 2.20.1-0ubuntu2.23 Architecture: amd64 Date: Wed Apr 29 12:45:12 2020 ProcEnviron: TERM=xterm-256color PATH=(custom, no user) LANG=en_US.UTF-8 SHELL=/bin/bash SourcePackage: linux-meta-azure UpgradeStatus: No upgrade log present (probably fresh install) --- AlsaDevices: Error: command ['ls', '-l', '/dev/snd/'] failed with exit code 2: ls: cannot access '/dev/snd/': No such file or directory AplayDevices: Error: [Errno 2] No such file or directory ApportVersion: 2.20.1-0ubuntu2.23 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory CRDA: N/A DistroRelease: Ubuntu 16.04 IwConfig: Error: [Errno 2] No such file or directory Lsusb: Error: command ['lsusb'] failed with exit code 1: MachineType: Microsoft Corporation Virtual Machine Package: linux-azure-4.15 PciMultimedia: ProcEnviron: TERM=xterm-256color PATH=(custom, no user) LANG=en_US.UTF-8 SHELL=/bin/bash ProcFB: 0 hyperv_fb ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.15.0-1082-azure root=UUID=026eedeb-bd55-4fe3-9e65-0f5f76c13202 ro console=tty1 console=ttyS0 earlyprintk=ttyS0 rootdelay=300 ProcVersionSignature: Ubuntu 4.15.0-1082.92~16.04.1-azure 4.15.18 RelatedPackageVersions: linux-restricted-modules-4.15.0-1082-azure N/A linux-backports-modules-4.15.0-1082-azure N/A linux-firmware N/A RfKill: Error: [Errno 2] No such file or directory Tags: xenial uec-images xenial uec-images Uname: Linux 4.15.0-1082-azure x86_64 UpgradeStatus: No upgrade log present (probably fresh install) UserGroups: _MarkForUpload: True dmi.bios.date: 06/02/2017 dmi.bios.vendor: American Megatrends Inc. dmi.bios.version: 090007 dmi.board.name: Virtual Machine dmi.board.vendor: Microsoft Corporation dmi.board.version: 7.0 dmi.chassis.asset.tag: 7783-7084-3265-9085-8269-3286-77 dmi.chassis.type: 3 dmi.chassis.vendor: Microsoft Corporation dmi.chassis.version: 7.0 dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvr090007:bd06/02/2017:svnMicrosoftCorporation:pnVirtualMachine:pvr7.0:rvnMicrosoftCorporation:rnVirtualMachine:rvr7.0:cvnMicrosoftCorporation:ct3:cvr7.0: dmi.product.name: Virtual Machine dmi.product.uuid: 2B0B428F-CF5B-3142-8500-028AFD70E74B dmi.product.version: 7.0 dmi.sys.vendor: Microsoft Corporation
2020-05-13 09:43:23 Michael Robertson attachment added AudioDevicesInUse.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370855/+files/AudioDevicesInUse.txt
2020-05-13 09:43:24 Michael Robertson attachment added CurrentDmesg.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370856/+files/CurrentDmesg.txt
2020-05-13 09:43:25 Michael Robertson attachment added Lspci.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370857/+files/Lspci.txt
2020-05-13 09:43:26 Michael Robertson attachment added ProcCpuinfo.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370858/+files/ProcCpuinfo.txt
2020-05-13 09:43:27 Michael Robertson attachment added ProcCpuinfoMinimal.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370859/+files/ProcCpuinfoMinimal.txt
2020-05-13 09:43:29 Michael Robertson attachment added ProcInterrupts.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370860/+files/ProcInterrupts.txt
2020-05-13 09:43:30 Michael Robertson attachment added ProcModules.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370861/+files/ProcModules.txt
2020-05-13 09:43:31 Michael Robertson attachment added UdevDb.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370862/+files/UdevDb.txt
2020-05-13 09:43:33 Michael Robertson attachment added WifiSyslog.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370863/+files/WifiSyslog.txt
2020-05-13 13:17:43 Marcelo Cerri linux (Ubuntu Bionic): status Incomplete In Progress
2020-05-13 16:25:41 Marcelo Cerri bug task deleted linux-azure-4.15 (Ubuntu)
2020-05-14 08:12:15 Stefan Bader linux (Ubuntu Bionic): importance Undecided Medium
2020-05-15 04:32:10 Khaled El Mously linux (Ubuntu Bionic): status In Progress Fix Committed
2020-05-19 18:06:22 Ubuntu Kernel Bot tags amd64 apport-bug apport-collected uec-images xenial amd64 apport-bug apport-collected uec-images verification-needed-bionic xenial
2020-06-09 21:09:10 Launchpad Janitor linux (Ubuntu Bionic): status Fix Committed Fix Released
2020-06-09 21:09:10 Launchpad Janitor cve linked 2020-0543
2020-06-09 21:10:47 Launchpad Janitor linux-azure-4.15 (Ubuntu Bionic): status New Fix Released
2020-07-03 09:01:19 Po-Hsu Lin linux (Ubuntu): status Incomplete Invalid