2020-04-29 12:58:44 |
Michael Robertson |
bug |
|
|
added bug |
2020-04-30 19:33:43 |
Terry Rudd |
bug |
|
|
added subscriber Terry Rudd |
2020-04-30 20:10:14 |
Marcelo Cerri |
bug task added |
|
linux-azure-4.15 (Ubuntu) |
|
2020-04-30 20:10:24 |
Marcelo Cerri |
bug task deleted |
linux-meta-azure (Ubuntu) |
|
|
2020-04-30 20:10:32 |
Marcelo Cerri |
nominated for series |
|
Ubuntu Bionic |
|
2020-04-30 20:10:32 |
Marcelo Cerri |
bug task added |
|
linux-azure-4.15 (Ubuntu Bionic) |
|
2020-05-13 08:32:43 |
Flemming Frandsen |
bug task added |
|
linux (Ubuntu) |
|
2020-05-13 09:00:09 |
Ubuntu Kernel Bot |
linux (Ubuntu): status |
New |
Incomplete |
|
2020-05-13 09:00:11 |
Ubuntu Kernel Bot |
linux (Ubuntu Bionic): status |
New |
Incomplete |
|
2020-05-13 09:43:21 |
Michael Robertson |
tags |
amd64 apport-bug uec-images xenial |
amd64 apport-bug apport-collected uec-images xenial |
|
2020-05-13 09:43:22 |
Michael Robertson |
description |
OS provided by AKS is currently Ubuntu 16.04.6 LTS, kernel 4.15.0-1077-azure.
Every block written by a k8s pod to a ceph CSI volume generates 2 warning lines in the node's system logs (kern.log, syslog, messages, warn):
"Apr 24 09:37:46 aks-<nodename> kernel: [242123.654538] ceph: Failed to find inode for 1"
Under production load, eventually the node succumbs to DiskPressure as the drive fills up. Also performance is noticeably degraded.
Background here: https://tracker.ceph.com/issues/45283
Luis Hernandez indicates 4 commits relating to this issue, just 2 of which have been backported to Ubuntu 16.
d557c48db730 ("ceph: quota: add counter for snaprealms with quota") <==
e3161f17d926 ("ceph: quota: cache inode pointer in ceph_snap_realm")
0eb6bbe4d9cf ("ceph: fix root quota realm check") <==
2596366907f8 ("ceph: don't check quota for snap inode")
Quoth Luis:
"I've done a quick test and, after compiling the bionic kernel 4.15.0-96.97 (the latest released), I can reproduce the issue. Cherry-picking the 2 missing commits (2596366907f8 and e3161f17d926) fixes it."
In my testing Ubuntu 18 does not exhibit the bug, but Azure support tells me it will be months before they make it GA in AKS.
Can we get those commits backported to Ubuntu 16?
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: linux-azure (not installed)
ProcVersionSignature: Ubuntu 4.15.0-1077.82-azure 4.15.18
Uname: Linux 4.15.0-1077-azure x86_64
ApportVersion: 2.20.1-0ubuntu2.23
Architecture: amd64
Date: Wed Apr 29 12:45:12 2020
ProcEnviron:
TERM=xterm-256color
PATH=(custom, no user)
LANG=en_US.UTF-8
SHELL=/bin/bash
SourcePackage: linux-meta-azure
UpgradeStatus: No upgrade log present (probably fresh install) |
OS provided by AKS is currently Ubuntu 16.04.6 LTS, kernel 4.15.0-1077-azure.
Every block written by a k8s pod to a ceph CSI volume generates 2 warning lines in the node's system logs (kern.log, syslog, messages, warn):
"Apr 24 09:37:46 aks-<nodename> kernel: [242123.654538] ceph: Failed to find inode for 1"
Under production load, eventually the node succumbs to DiskPressure as the drive fills up. Also performance is noticeably degraded.
Background here: https://tracker.ceph.com/issues/45283
Luis Hernandez indicates 4 commits relating to this issue, just 2 of which have been backported to Ubuntu 16.
d557c48db730 ("ceph: quota: add counter for snaprealms with quota") <==
e3161f17d926 ("ceph: quota: cache inode pointer in ceph_snap_realm")
0eb6bbe4d9cf ("ceph: fix root quota realm check") <==
2596366907f8 ("ceph: don't check quota for snap inode")
Quoth Luis:
"I've done a quick test and, after compiling the bionic kernel 4.15.0-96.97 (the latest released), I can reproduce the issue. Cherry-picking the 2 missing commits (2596366907f8 and e3161f17d926) fixes it."
In my testing Ubuntu 18 does not exhibit the bug, but Azure support tells me it will be months before they make it GA in AKS.
Can we get those commits backported to Ubuntu 16?
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: linux-azure (not installed)
ProcVersionSignature: Ubuntu 4.15.0-1077.82-azure 4.15.18
Uname: Linux 4.15.0-1077-azure x86_64
ApportVersion: 2.20.1-0ubuntu2.23
Architecture: amd64
Date: Wed Apr 29 12:45:12 2020
ProcEnviron:
TERM=xterm-256color
PATH=(custom, no user)
LANG=en_US.UTF-8
SHELL=/bin/bash
SourcePackage: linux-meta-azure
UpgradeStatus: No upgrade log present (probably fresh install)
---
AlsaDevices: Error: command ['ls', '-l', '/dev/snd/'] failed with exit code 2: ls: cannot access '/dev/snd/': No such file or directory
AplayDevices: Error: [Errno 2] No such file or directory
ApportVersion: 2.20.1-0ubuntu2.23
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory
CRDA: N/A
DistroRelease: Ubuntu 16.04
IwConfig: Error: [Errno 2] No such file or directory
Lsusb: Error: command ['lsusb'] failed with exit code 1:
MachineType: Microsoft Corporation Virtual Machine
Package: linux-azure-4.15
PciMultimedia:
ProcEnviron:
TERM=xterm-256color
PATH=(custom, no user)
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcFB: 0 hyperv_fb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.15.0-1082-azure root=UUID=026eedeb-bd55-4fe3-9e65-0f5f76c13202 ro console=tty1 console=ttyS0 earlyprintk=ttyS0 rootdelay=300
ProcVersionSignature: Ubuntu 4.15.0-1082.92~16.04.1-azure 4.15.18
RelatedPackageVersions:
linux-restricted-modules-4.15.0-1082-azure N/A
linux-backports-modules-4.15.0-1082-azure N/A
linux-firmware N/A
RfKill: Error: [Errno 2] No such file or directory
Tags: xenial uec-images xenial uec-images
Uname: Linux 4.15.0-1082-azure x86_64
UpgradeStatus: No upgrade log present (probably fresh install)
UserGroups:
_MarkForUpload: True
dmi.bios.date: 06/02/2017
dmi.bios.vendor: American Megatrends Inc.
dmi.bios.version: 090007
dmi.board.name: Virtual Machine
dmi.board.vendor: Microsoft Corporation
dmi.board.version: 7.0
dmi.chassis.asset.tag: 7783-7084-3265-9085-8269-3286-77
dmi.chassis.type: 3
dmi.chassis.vendor: Microsoft Corporation
dmi.chassis.version: 7.0
dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvr090007:bd06/02/2017:svnMicrosoftCorporation:pnVirtualMachine:pvr7.0:rvnMicrosoftCorporation:rnVirtualMachine:rvr7.0:cvnMicrosoftCorporation:ct3:cvr7.0:
dmi.product.name: Virtual Machine
dmi.product.uuid: 2B0B428F-CF5B-3142-8500-028AFD70E74B
dmi.product.version: 7.0
dmi.sys.vendor: Microsoft Corporation |
|
2020-05-13 09:43:23 |
Michael Robertson |
attachment added |
|
AudioDevicesInUse.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370855/+files/AudioDevicesInUse.txt |
|
2020-05-13 09:43:24 |
Michael Robertson |
attachment added |
|
CurrentDmesg.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370856/+files/CurrentDmesg.txt |
|
2020-05-13 09:43:25 |
Michael Robertson |
attachment added |
|
Lspci.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370857/+files/Lspci.txt |
|
2020-05-13 09:43:26 |
Michael Robertson |
attachment added |
|
ProcCpuinfo.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370858/+files/ProcCpuinfo.txt |
|
2020-05-13 09:43:27 |
Michael Robertson |
attachment added |
|
ProcCpuinfoMinimal.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370859/+files/ProcCpuinfoMinimal.txt |
|
2020-05-13 09:43:29 |
Michael Robertson |
attachment added |
|
ProcInterrupts.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370860/+files/ProcInterrupts.txt |
|
2020-05-13 09:43:30 |
Michael Robertson |
attachment added |
|
ProcModules.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370861/+files/ProcModules.txt |
|
2020-05-13 09:43:31 |
Michael Robertson |
attachment added |
|
UdevDb.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370862/+files/UdevDb.txt |
|
2020-05-13 09:43:33 |
Michael Robertson |
attachment added |
|
WifiSyslog.txt https://bugs.launchpad.net/bugs/1875884/+attachment/5370863/+files/WifiSyslog.txt |
|
2020-05-13 13:17:43 |
Marcelo Cerri |
linux (Ubuntu Bionic): status |
Incomplete |
In Progress |
|
2020-05-13 16:25:41 |
Marcelo Cerri |
bug task deleted |
linux-azure-4.15 (Ubuntu) |
|
|
2020-05-14 08:12:15 |
Stefan Bader |
linux (Ubuntu Bionic): importance |
Undecided |
Medium |
|
2020-05-15 04:32:10 |
Khaled El Mously |
linux (Ubuntu Bionic): status |
In Progress |
Fix Committed |
|
2020-05-19 18:06:22 |
Ubuntu Kernel Bot |
tags |
amd64 apport-bug apport-collected uec-images xenial |
amd64 apport-bug apport-collected uec-images verification-needed-bionic xenial |
|
2020-06-09 21:09:10 |
Launchpad Janitor |
linux (Ubuntu Bionic): status |
Fix Committed |
Fix Released |
|
2020-06-09 21:09:10 |
Launchpad Janitor |
cve linked |
|
2020-0543 |
|
2020-06-09 21:10:47 |
Launchpad Janitor |
linux-azure-4.15 (Ubuntu Bionic): status |
New |
Fix Released |
|
2020-07-03 09:01:19 |
Po-Hsu Lin |
linux (Ubuntu): status |
Incomplete |
Invalid |
|