| 2017-01-12 06:48:29 |
Mike Williams |
bug |
|
|
added bug |
| 2017-01-12 07:00:16 |
Brad Figg |
linux (Ubuntu): status |
New |
Confirmed |
|
| 2017-01-12 14:27:03 |
Joseph Salisbury |
linux (Ubuntu): importance |
Undecided |
High |
|
| 2017-01-12 14:27:12 |
Joseph Salisbury |
nominated for series |
|
Ubuntu Xenial |
|
| 2017-01-12 14:27:12 |
Joseph Salisbury |
bug task added |
|
linux (Ubuntu Xenial) |
|
| 2017-01-12 14:27:19 |
Joseph Salisbury |
linux (Ubuntu Xenial): status |
New |
Triaged |
|
| 2017-01-12 14:27:21 |
Joseph Salisbury |
linux (Ubuntu Xenial): importance |
Undecided |
High |
|
| 2017-01-12 14:27:24 |
Joseph Salisbury |
linux (Ubuntu): status |
Confirmed |
Triaged |
|
| 2017-01-12 14:37:11 |
Dan Streetman |
bug |
|
|
added subscriber Dan Streetman |
| 2017-01-13 11:49:36 |
Fabian Grünbichler |
bug |
|
|
added subscriber Fabian Grünbichler |
| 2017-01-17 13:28:09 |
Chris Angenent |
bug |
|
|
added subscriber Chris Angenent |
| 2017-01-17 22:53:36 |
Sebastian Unger |
bug |
|
|
added subscriber Sebastian Unger |
| 2017-01-18 15:53:18 |
Jeff Billimek |
bug |
|
|
added subscriber Jeff Billimek |
| 2017-01-18 17:34:30 |
Gaudenz Steinlin |
bug |
|
|
added subscriber Gaudenz Steinlin |
| 2017-01-18 21:22:31 |
Stéphane Graber |
bug |
|
|
added subscriber Stéphane Graber |
| 2017-01-18 22:28:06 |
Erik Hess |
bug |
|
|
added subscriber Erik Hess |
| 2017-01-19 09:57:04 |
wurlyfan |
bug |
|
|
added subscriber wurlyfan |
| 2017-01-19 16:04:27 |
Nick Swanson |
bug |
|
|
added subscriber Nick Swanson |
| 2017-01-19 16:53:39 |
Allen Wild |
bug |
|
|
added subscriber Allen Wild |
| 2017-01-20 00:58:52 |
Tomasz Ratajczak |
bug |
|
|
added subscriber Tomasz Ratajczak |
| 2017-01-20 03:56:24 |
Peter200lx |
bug |
|
|
added subscriber Peter200lx |
| 2017-01-20 11:59:09 |
Thadeu Lima de Souza Cascardo |
linux (Ubuntu): assignee |
|
Thadeu Lima de Souza Cascardo (cascardo) |
|
| 2017-01-20 11:59:14 |
Thadeu Lima de Souza Cascardo |
linux (Ubuntu Xenial): assignee |
|
Thadeu Lima de Souza Cascardo (cascardo) |
|
| 2017-01-21 10:35:50 |
Danny B |
bug |
|
|
added subscriber Danny B |
| 2017-01-21 16:22:29 |
Ben French |
linux (Ubuntu): status |
Triaged |
In Progress |
|
| 2017-01-21 20:55:25 |
Viktor Szathmáry |
bug |
|
|
added subscriber Viktor Szathmáry |
| 2017-01-23 04:41:45 |
David F. |
bug |
|
|
added subscriber David F. |
| 2017-01-23 19:04:09 |
Matt Nordhoff |
bug |
|
|
added subscriber Matt Nordhoff |
| 2017-01-24 05:07:55 |
Michael Loeffler |
bug |
|
|
added subscriber Michael Loeffler |
| 2017-01-24 10:58:57 |
Andre Keller |
bug |
|
|
added subscriber Andre Keller |
| 2017-01-25 02:23:47 |
freelock |
bug |
|
|
added subscriber freelock |
| 2017-01-25 07:01:07 |
Dominique Poulain |
bug |
|
|
added subscriber Dominique Poulain |
| 2017-01-25 15:26:18 |
Eric Desrochers |
bug |
|
|
added subscriber Eric Desrochers |
| 2017-01-26 20:19:16 |
Ellen H. |
bug |
|
|
added subscriber Ellen H. |
| 2017-01-26 20:42:43 |
Michael Barrow |
bug |
|
|
added subscriber Michael Barrow |
| 2017-01-27 00:22:24 |
Eric Cuevas |
bug |
|
|
added subscriber Eric Cuevas |
| 2017-01-27 13:54:32 |
Eric Desrochers |
linux (Ubuntu Xenial): status |
Triaged |
In Progress |
|
| 2017-01-27 19:40:50 |
Eric Desrochers |
tags |
amd64 apport-bug ec2-images xenial |
amd64 apport-bug ec2-images sts xenial |
|
| 2017-01-29 01:26:34 |
Ivan Kozik |
bug |
|
|
added subscriber Ivan Kozik |
| 2017-01-29 09:44:55 |
Ben Parafina |
bug |
|
|
added subscriber Ben Parafina |
| 2017-01-29 14:41:51 |
Nobuto Murata |
bug |
|
|
added subscriber Nobuto Murata |
| 2017-01-30 01:47:15 |
Joel Stanley |
bug |
|
|
added subscriber Joel Stanley |
| 2017-01-30 02:20:56 |
Yoshi Kadokawa |
bug |
|
|
added subscriber Yoshi Kadokawa |
| 2017-01-30 12:18:44 |
Thomas Kriechbaumer |
bug |
|
|
added subscriber Thomas Kriechbaumer |
| 2017-01-30 17:09:03 |
J Delaney |
bug |
|
|
added subscriber J Delaney |
| 2017-01-30 23:43:45 |
Nate Eldredge |
bug |
|
|
added subscriber Nate Eldredge |
| 2017-01-31 09:10:52 |
Ilya Almametov |
bug |
|
|
added subscriber Ilya Almametov |
| 2017-01-31 13:29:01 |
Tim Gardner |
linux (Ubuntu Xenial): status |
In Progress |
Fix Committed |
|
| 2017-01-31 13:29:07 |
Tim Gardner |
linux (Ubuntu): status |
In Progress |
Fix Released |
|
| 2017-01-31 22:14:02 |
Sandor Zeestraten |
bug |
|
|
added subscriber Sandor Zeestraten |
| 2017-02-01 08:35:17 |
Markus Weippert |
bug |
|
|
added subscriber Markus Weippert |
| 2017-02-02 10:58:41 |
Luk van den Borne |
bug |
|
|
added subscriber Luk van den Borne |
| 2017-02-04 01:36:19 |
Charles Wright |
bug |
|
|
added subscriber Charles Wright |
| 2017-02-04 02:11:59 |
Nathan Caza |
bug |
|
|
added subscriber Nathan Caza |
| 2017-02-05 12:26:36 |
Pavel Piatruk |
bug |
|
|
added subscriber Pavel Piatruk |
| 2017-02-05 21:34:59 |
Sridhar Chandramouli |
bug |
|
|
added subscriber Sridhar Chandramouli |
| 2017-02-06 18:09:12 |
Marco Voelz |
bug |
|
|
added subscriber Marco Voelz |
| 2017-02-07 00:46:27 |
Marek Dopiera |
bug |
|
|
added subscriber Marek Dopiera |
| 2017-02-07 01:33:59 |
David Glasser |
bug |
|
|
added subscriber David Glasser |
| 2017-02-09 11:59:22 |
Anton Piatek |
bug |
|
|
added subscriber Anton Piatek |
| 2017-02-09 14:04:38 |
Jon Schewe |
bug |
|
|
added subscriber Jon Schewe |
| 2017-02-09 14:31:51 |
Dorian Fraser-Moore |
bug |
|
|
added subscriber Dorian Fraser-Moore |
| 2017-02-09 22:02:33 |
Thadeu Lima de Souza Cascardo |
tags |
amd64 apport-bug ec2-images sts xenial |
amd64 apport-bug ec2-images sts verification-needed-xenial xenial |
|
| 2017-02-10 09:06:12 |
Tomaz Beltram |
bug |
|
|
added subscriber Tomaz Beltram |
| 2017-02-10 14:07:54 |
Otto Wayne |
bug |
|
|
added subscriber Otto Wayne |
| 2017-02-11 03:42:12 |
Johan van Dijk |
bug |
|
|
added subscriber Johan van Dijk |
| 2017-02-11 16:41:32 |
Oliver O. |
tags |
amd64 apport-bug ec2-images sts verification-needed-xenial xenial |
amd64 apport-bug ec2-images sts verification-done-xenial xenial |
|
| 2017-02-13 03:56:42 |
Anton |
bug |
|
|
added subscriber Anton |
| 2017-02-13 07:42:20 |
Marc Fournier |
bug |
|
|
added subscriber Marc Fournier |
| 2017-02-14 10:20:21 |
Craig Francis |
bug |
|
|
added subscriber Craig Francis |
| 2017-02-15 00:55:21 |
Haw Loeung |
bug |
|
|
added subscriber Haw Loeung |
| 2017-02-15 13:56:56 |
Dave |
bug |
|
|
added subscriber Dave |
| 2017-02-15 14:48:33 |
Jonathan |
bug |
|
|
added subscriber Jonathan |
| 2017-02-16 12:08:06 |
Ian Gordon |
bug |
|
|
added subscriber Ian Gordon |
| 2017-02-16 12:11:50 |
YAMAMOTO Hirotaka |
bug |
|
|
added subscriber YAMAMOTO Hirotaka |
| 2017-02-17 15:49:37 |
Craig Francis |
description |
I recently replaced some Xenial servers, and started experiencing "Out of memory" problems with the default kernel.
We bake Amazon AMIs based on an official Ubuntu-provided image (ami-e6b58e85, in ap-southeast-2, from https://cloud-images.ubuntu.com/locator/ec2/). Previous versions of our AMI included "4.4.0-57-generic", but the latest version picked up "4.4.0-59-generic" as part of a "dist-upgrade".
Instances booted using the new AMI have been using more memory, and experiencing OOM issues - sometimes during boot, and sometimes a while afterwards. An example from the system log is:
[ 130.113411] cloud-init[1560]: Cloud-init v. 0.7.8 running 'modules:final' at Wed, 11 Jan 2017 22:07:53 +0000. Up 29.28 seconds.
[ 130.124219] cloud-init[1560]: Cloud-init v. 0.7.8 finished at Wed, 11 Jan 2017 22:09:35 +0000. Datasource DataSourceEc2. Up 130.09 seconds
[29871.137128] Out of memory: Kill process 2920 (ruby) score 107 or sacrifice child
[29871.140816] Killed process 2920 (ruby) total-vm:675048kB, anon-rss:51184kB, file-rss:2164kB
[29871.449209] Out of memory: Kill process 3257 (splunkd) score 97 or sacrifice child
[29871.453282] Killed process 3258 (splunkd) total-vm:66272kB, anon-rss:6676kB, file-rss:0kB
[29871.677910] Out of memory: Kill process 2647 (fluentd) score 51 or sacrifice child
[29871.681872] Killed process 2647 (fluentd) total-vm:117944kB, anon-rss:23956kB, file-rss:1356kB
I have a hunch that this may be related to the fix for https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1647400, introduced in linux (4.4.0-58.79).
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: linux-image-4.4.0-59-generic 4.4.0-59.80
ProcVersionSignature: User Name 4.4.0-59.80-generic 4.4.35
Uname: Linux 4.4.0-59-generic x86_64
AlsaDevices:
total 0
crw-rw---- 1 root audio 116, 1 Jan 12 06:29 seq
crw-rw---- 1 root audio 116, 33 Jan 12 06:29 timer
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
ApportVersion: 2.20.1-0ubuntu2.4
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
Date: Thu Jan 12 06:38:45 2017
Ec2AMI: ami-0f93966c
Ec2AMIManifest: (unknown)
Ec2AvailabilityZone: ap-southeast-2a
Ec2InstanceType: t2.nano
Ec2Kernel: unavailable
Ec2Ramdisk: unavailable
IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
Lsusb: Error: command ['lsusb'] failed with exit code 1:
MachineType: Xen HVM domU
PciMultimedia:
ProcEnviron:
TERM=xterm-256color
PATH=(custom, no user)
XDG_RUNTIME_DIR=<set>
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcFB: 0 cirrusdrmfb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.4.0-59-generic root=UUID=fb0fef08-f3c5-40bf-9776-f7ba00fe72be ro console=tty1 console=ttyS0
RelatedPackageVersions:
linux-restricted-modules-4.4.0-59-generic N/A
linux-backports-modules-4.4.0-59-generic N/A
linux-firmware 1.157.6
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 12/09/2016
dmi.bios.vendor: Xen
dmi.bios.version: 4.2.amazon
dmi.chassis.type: 1
dmi.chassis.vendor: Xen
dmi.modalias: dmi:bvnXen:bvr4.2.amazon:bd12/09/2016:svnXen:pnHVMdomU:pvr4.2.amazon:cvnXen:ct1:cvr:
dmi.product.name: HVM domU
dmi.product.version: 4.2.amazon
dmi.sys.vendor: Xen |
I recently replaced some Xenial servers, and started experiencing "Out of memory" problems with the default kernel.
We bake Amazon AMIs based on an official Ubuntu-provided image (ami-e6b58e85, in ap-southeast-2, from https://cloud-images.ubuntu.com/locator/ec2/). Previous versions of our AMI included "4.4.0-57-generic", but the latest version picked up "4.4.0-59-generic" as part of a "dist-upgrade".
Instances booted using the new AMI have been using more memory, and experiencing OOM issues - sometimes during boot, and sometimes a while afterwards. An example from the system log is:
[ 130.113411] cloud-init[1560]: Cloud-init v. 0.7.8 running 'modules:final' at Wed, 11 Jan 2017 22:07:53 +0000. Up 29.28 seconds.
[ 130.124219] cloud-init[1560]: Cloud-init v. 0.7.8 finished at Wed, 11 Jan 2017 22:09:35 +0000. Datasource DataSourceEc2. Up 130.09 seconds
[29871.137128] Out of memory: Kill process 2920 (ruby) score 107 or sacrifice child
[29871.140816] Killed process 2920 (ruby) total-vm:675048kB, anon-rss:51184kB, file-rss:2164kB
[29871.449209] Out of memory: Kill process 3257 (splunkd) score 97 or sacrifice child
[29871.453282] Killed process 3258 (splunkd) total-vm:66272kB, anon-rss:6676kB, file-rss:0kB
[29871.677910] Out of memory: Kill process 2647 (fluentd) score 51 or sacrifice child
[29871.681872] Killed process 2647 (fluentd) total-vm:117944kB, anon-rss:23956kB, file-rss:1356kB
I have a hunch that this may be related to the fix for https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1647400, introduced in linux (4.4.0-58.79).
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: linux-image-4.4.0-59-generic 4.4.0-59.80
ProcVersionSignature: User Name 4.4.0-59.80-generic 4.4.35
Uname: Linux 4.4.0-59-generic x86_64
AlsaDevices:
total 0
crw-rw---- 1 root audio 116, 1 Jan 12 06:29 seq
crw-rw---- 1 root audio 116, 33 Jan 12 06:29 timer
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
ApportVersion: 2.20.1-0ubuntu2.4
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
Date: Thu Jan 12 06:38:45 2017
Ec2AMI: ami-0f93966c
Ec2AMIManifest: (unknown)
Ec2AvailabilityZone: ap-southeast-2a
Ec2InstanceType: t2.nano
Ec2Kernel: unavailable
Ec2Ramdisk: unavailable
IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
Lsusb: Error: command ['lsusb'] failed with exit code 1:
MachineType: Xen HVM domU
PciMultimedia:
ProcEnviron:
TERM=xterm-256color
PATH=(custom, no user)
XDG_RUNTIME_DIR=<set>
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcFB: 0 cirrusdrmfb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.4.0-59-generic root=UUID=fb0fef08-f3c5-40bf-9776-f7ba00fe72be ro console=tty1 console=ttyS0
RelatedPackageVersions:
linux-restricted-modules-4.4.0-59-generic N/A
linux-backports-modules-4.4.0-59-generic N/A
linux-firmware 1.157.6
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 12/09/2016
dmi.bios.vendor: Xen
dmi.bios.version: 4.2.amazon
dmi.chassis.type: 1
dmi.chassis.vendor: Xen
dmi.modalias: dmi:bvnXen:bvr4.2.amazon:bd12/09/2016:svnXen:pnHVMdomU:pvr4.2.amazon:cvnXen:ct1:cvr:
dmi.product.name: HVM domU
dmi.product.version: 4.2.amazon
dmi.sys.vendor: Xen |
|
| 2017-02-20 07:42:07 |
Launchpad Janitor |
linux (Ubuntu Xenial): status |
Fix Committed |
Fix Released |
|
| 2017-02-20 13:55:08 |
Iain Buclaw |
attachment added |
|
meminfo-buffers.png https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1655842/+attachment/4822727/+files/meminfo-buffers.png |
|
| 2017-02-27 16:05:25 |
Anton |
bug |
|
|
added subscriber Anton |
| 2017-03-02 12:38:03 |
Julian Kassat |
attachment added |
|
kern.log https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1655842/+attachment/4829766/+files/kern.log |
|
| 2017-03-20 15:25:53 |
Pete Cheslock |
attachment added |
|
kern.log https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1655842/+attachment/4841016/+files/kern.log |
|
| 2017-03-27 10:18:42 |
Luca Lesinigo |
bug |
|
|
added subscriber Luca Lesinigo |
| 2017-04-09 17:59:51 |
Mohammad Anwar Shah |
bug |
|
|
added subscriber Mohammad Anwar Shah |
| 2017-04-09 18:30:08 |
Nate Eldredge |
removed subscriber Nate Eldredge |
|
|
|
| 2017-04-10 14:59:04 |
David F. |
removed subscriber David F. |
|
|
|
| 2017-04-11 06:16:33 |
Sandor Zeestraten |
removed subscriber Sandor Zeestraten |
|
|
|
| 2017-04-11 06:38:16 |
Mohammad Anwar Shah |
attachment added |
|
dmesg log in KDE with 4.4.0-21 kernel https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1655842/+attachment/4859987/+files/shitty-dmesg.txt |
|
| 2017-05-21 12:59:18 |
kimo |
bug |
|
|
added subscriber kimo |
| 2017-05-22 09:40:20 |
Sebastian Unger |
bug task added |
|
linux-raspi2 (Ubuntu) |
|
| 2017-05-25 14:16:26 |
kimo |
linux-raspi2 (Ubuntu): status |
New |
Confirmed |
|
| 2017-05-25 14:18:07 |
kimo |
linux-raspi2 (Ubuntu Xenial): status |
New |
Confirmed |
|
| 2017-05-25 14:46:22 |
Craig Francis |
removed subscriber Craig Francis |
|
|
|
| 2017-05-26 13:31:40 |
Andre Keller |
removed subscriber Andre Keller |
|
|
|
| 2017-06-16 22:38:53 |
Nick Hatch |
attachment added |
|
kthreadd triggered order=2 allocation failure https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1655842/+attachment/4897378/+files/kern.log |
|
| 2017-06-16 22:41:09 |
Nick Hatch |
bug |
|
|
added subscriber Nick Hatch |
| 2017-06-27 12:50:41 |
Chris |
bug |
|
|
added subscriber Chris |
| 2017-06-30 09:21:28 |
Thadeu Lima de Souza Cascardo |
bug |
|
|
added subscriber Paolo Pisati |
| 2017-06-30 09:48:52 |
Paolo Pisati |
linux-raspi2 (Ubuntu): assignee |
|
Paolo Pisati (p-pisati) |
|
| 2017-08-16 13:26:14 |
Jake Billo |
attachment added |
|
kern.log from affected system https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1655842/+attachment/4933628/+files/kern_20170816.log |
|
| 2017-08-16 13:26:29 |
Jake Billo |
bug task added |
|
linux-aws (Ubuntu) |
|
| 2017-08-16 15:29:20 |
Jake Billo |
attachment added |
|
full kern.log contents https://bugs.launchpad.net/ubuntu/+source/linux-aws/+bug/1655842/+attachment/4933724/+files/full_kern_20170816.log |
|
| 2017-08-17 02:29:01 |
Swe W Aung |
attachment added |
|
Kern log attached. https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1655842/+attachment/4934013/+files/kern-log-kernel4.4.0-89.txt |
|
| 2017-08-17 02:29:53 |
Swe W Aung |
attachment added |
|
dmesg-kernel4.4.0-89.txt https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1655842/+attachment/4934014/+files/dmesg-kernel4.4.0-89.txt |
|
| 2017-08-17 13:18:54 |
Michael Hart |
bug |
|
|
added subscriber Michael Hart |
| 2017-09-05 12:36:32 |
Willem |
attachment added |
|
dmesg.txt https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1655842/+attachment/4944720/+files/dmesg.txt |
|
| 2017-09-05 12:37:15 |
Willem |
attachment added |
|
kern.log https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1655842/+attachment/4944721/+files/kern.log |
|
| 2017-09-05 13:10:40 |
Thomas Kriechbaumer |
removed subscriber Thomas Kriechbaumer |
|
|
|
| 2017-09-05 13:26:33 |
Jakob Reiter |
bug |
|
|
added subscriber Jakob Reiter |
| 2017-09-10 20:46:34 |
Willem |
bug |
|
|
added subscriber Willem |
| 2017-09-11 15:58:30 |
Paolo Pisati |
linux-raspi2 (Ubuntu): status |
Confirmed |
Fix Committed |
|
| 2017-09-11 15:58:35 |
Paolo Pisati |
linux-raspi2 (Ubuntu Xenial): status |
Confirmed |
Fix Committed |
|
| 2017-09-11 16:49:04 |
Launchpad Janitor |
linux-aws (Ubuntu): status |
New |
Confirmed |
|
| 2017-09-11 16:49:04 |
Launchpad Janitor |
linux-aws (Ubuntu Xenial): status |
New |
Confirmed |
|
| 2017-09-11 18:50:27 |
Mohammad Anwar Shah |
removed subscriber Mohammad Anwar Shah |
|
|
|
| 2017-09-11 18:50:33 |
Mohammad Anwar Shah |
bug |
|
|
added subscriber Mohammad Anwar Shah |
| 2017-09-11 18:50:36 |
Mohammad Anwar Shah |
removed subscriber Mohammad Anwar Shah |
|
|
|
| 2017-09-12 02:05:03 |
Danny B |
removed subscriber Danny B |
|
|
|
| 2017-09-13 13:21:25 |
Ellen H. |
removed subscriber Ellen H. |
|
|
|
| 2017-10-19 19:57:17 |
Ryan Harper |
bug |
|
|
added subscriber Ryan Harper |
| 2017-11-01 14:17:11 |
Vladimir Nicolici |
attachment added |
|
OOM log https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1655842/+attachment/5001874/+files/oom.log |
|
| 2017-11-15 11:28:38 |
Hervé BRY |
bug |
|
|
added subscriber Hervé BRY |
| 2017-11-27 16:52:27 |
Thadeu Lima de Souza Cascardo |
description |
I recently replaced some Xenial servers, and started experiencing "Out of memory" problems with the default kernel.
We bake Amazon AMIs based on an official Ubuntu-provided image (ami-e6b58e85, in ap-southeast-2, from https://cloud-images.ubuntu.com/locator/ec2/). Previous versions of our AMI included "4.4.0-57-generic", but the latest version picked up "4.4.0-59-generic" as part of a "dist-upgrade".
Instances booted using the new AMI have been using more memory, and experiencing OOM issues - sometimes during boot, and sometimes a while afterwards. An example from the system log is:
[ 130.113411] cloud-init[1560]: Cloud-init v. 0.7.8 running 'modules:final' at Wed, 11 Jan 2017 22:07:53 +0000. Up 29.28 seconds.
[ 130.124219] cloud-init[1560]: Cloud-init v. 0.7.8 finished at Wed, 11 Jan 2017 22:09:35 +0000. Datasource DataSourceEc2. Up 130.09 seconds
[29871.137128] Out of memory: Kill process 2920 (ruby) score 107 or sacrifice child
[29871.140816] Killed process 2920 (ruby) total-vm:675048kB, anon-rss:51184kB, file-rss:2164kB
[29871.449209] Out of memory: Kill process 3257 (splunkd) score 97 or sacrifice child
[29871.453282] Killed process 3258 (splunkd) total-vm:66272kB, anon-rss:6676kB, file-rss:0kB
[29871.677910] Out of memory: Kill process 2647 (fluentd) score 51 or sacrifice child
[29871.681872] Killed process 2647 (fluentd) total-vm:117944kB, anon-rss:23956kB, file-rss:1356kB
I have a hunch that this may be related to the fix for https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1647400, introduced in linux (4.4.0-58.79).
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: linux-image-4.4.0-59-generic 4.4.0-59.80
ProcVersionSignature: User Name 4.4.0-59.80-generic 4.4.35
Uname: Linux 4.4.0-59-generic x86_64
AlsaDevices:
total 0
crw-rw---- 1 root audio 116, 1 Jan 12 06:29 seq
crw-rw---- 1 root audio 116, 33 Jan 12 06:29 timer
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
ApportVersion: 2.20.1-0ubuntu2.4
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
Date: Thu Jan 12 06:38:45 2017
Ec2AMI: ami-0f93966c
Ec2AMIManifest: (unknown)
Ec2AvailabilityZone: ap-southeast-2a
Ec2InstanceType: t2.nano
Ec2Kernel: unavailable
Ec2Ramdisk: unavailable
IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
Lsusb: Error: command ['lsusb'] failed with exit code 1:
MachineType: Xen HVM domU
PciMultimedia:
ProcEnviron:
TERM=xterm-256color
PATH=(custom, no user)
XDG_RUNTIME_DIR=<set>
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcFB: 0 cirrusdrmfb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.4.0-59-generic root=UUID=fb0fef08-f3c5-40bf-9776-f7ba00fe72be ro console=tty1 console=ttyS0
RelatedPackageVersions:
linux-restricted-modules-4.4.0-59-generic N/A
linux-backports-modules-4.4.0-59-generic N/A
linux-firmware 1.157.6
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 12/09/2016
dmi.bios.vendor: Xen
dmi.bios.version: 4.2.amazon
dmi.chassis.type: 1
dmi.chassis.vendor: Xen
dmi.modalias: dmi:bvnXen:bvr4.2.amazon:bd12/09/2016:svnXen:pnHVMdomU:pvr4.2.amazon:cvnXen:ct1:cvr:
dmi.product.name: HVM domU
dmi.product.version: 4.2.amazon
dmi.sys.vendor: Xen |
After a fix for LP#1647400, a bug that caused freezes under some workloads, some users noticed regular OOMs. Those regular OOMs were reported under this bug, and fixed after some releases.
Some of the affected kernels are documented below. In order to check your particular kernel, read its changelog and lookup for 1655842 and 1647400. If it has the fix for 1647400, but not the fix for 1655842, then it's affected.
It's still possible that you notice regressions compared to kernels that didn't have the fixes for any of the bugs. However, reverting all fixes would cause the freeze bug to come back. So, it's not a possible solution moving forward.
If you see any regressions, in the form of OOMs, mainly, please report a new bug. Different workloads may require different solutions, and it's possible that further fixes are needed, be them upstream or not. The best way to get such fixes applied is reporting that under a new bug, one that can be verified, so being able to reproduce the bug makes it possible to verify the fixes really fix the identified bug.
Kernels affected:
linux 4.4.0-58, 4.4.0-59, 4.4.0-60, 4.4.0-61, 4.4.0-62.
linux-raspi2 4.4.0-1039 to 4.4.0-1042 and 4.4.0-1044 to 4.4.0-1071
Particular kernels NOT affected by THIS bug:
linux-aws
To reiterate, if you find an OOM with an affected kernel, please upgrade.
If you find an OOM with a non-affected kernel, please report a new bug. We want to investigate it and fix it.
===================
I recently replaced some Xenial servers, and started experiencing "Out of memory" problems with the default kernel.
We bake Amazon AMIs based on an official Ubuntu-provided image (ami-e6b58e85, in ap-southeast-2, from https://cloud-images.ubuntu.com/locator/ec2/). Previous versions of our AMI included "4.4.0-57-generic", but the latest version picked up "4.4.0-59-generic" as part of a "dist-upgrade".
Instances booted using the new AMI have been using more memory, and experiencing OOM issues - sometimes during boot, and sometimes a while afterwards. An example from the system log is:
[ 130.113411] cloud-init[1560]: Cloud-init v. 0.7.8 running 'modules:final' at Wed, 11 Jan 2017 22:07:53 +0000. Up 29.28 seconds.
[ 130.124219] cloud-init[1560]: Cloud-init v. 0.7.8 finished at Wed, 11 Jan 2017 22:09:35 +0000. Datasource DataSourceEc2. Up 130.09 seconds
[29871.137128] Out of memory: Kill process 2920 (ruby) score 107 or sacrifice child
[29871.140816] Killed process 2920 (ruby) total-vm:675048kB, anon-rss:51184kB, file-rss:2164kB
[29871.449209] Out of memory: Kill process 3257 (splunkd) score 97 or sacrifice child
[29871.453282] Killed process 3258 (splunkd) total-vm:66272kB, anon-rss:6676kB, file-rss:0kB
[29871.677910] Out of memory: Kill process 2647 (fluentd) score 51 or sacrifice child
[29871.681872] Killed process 2647 (fluentd) total-vm:117944kB, anon-rss:23956kB, file-rss:1356kB
I have a hunch that this may be related to the fix for https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1647400, introduced in linux (4.4.0-58.79).
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: linux-image-4.4.0-59-generic 4.4.0-59.80
ProcVersionSignature: User Name 4.4.0-59.80-generic 4.4.35
Uname: Linux 4.4.0-59-generic x86_64
AlsaDevices:
total 0
crw-rw---- 1 root audio 116, 1 Jan 12 06:29 seq
crw-rw---- 1 root audio 116, 33 Jan 12 06:29 timer
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
ApportVersion: 2.20.1-0ubuntu2.4
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
Date: Thu Jan 12 06:38:45 2017
Ec2AMI: ami-0f93966c
Ec2AMIManifest: (unknown)
Ec2AvailabilityZone: ap-southeast-2a
Ec2InstanceType: t2.nano
Ec2Kernel: unavailable
Ec2Ramdisk: unavailable
IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
Lsusb: Error: command ['lsusb'] failed with exit code 1:
MachineType: Xen HVM domU
PciMultimedia:
ProcEnviron:
TERM=xterm-256color
PATH=(custom, no user)
XDG_RUNTIME_DIR=<set>
LANG=en_US.UTF-8
SHELL=/bin/bash
ProcFB: 0 cirrusdrmfb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.4.0-59-generic root=UUID=fb0fef08-f3c5-40bf-9776-f7ba00fe72be ro console=tty1 console=ttyS0
RelatedPackageVersions:
linux-restricted-modules-4.4.0-59-generic N/A
linux-backports-modules-4.4.0-59-generic N/A
linux-firmware 1.157.6
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 12/09/2016
dmi.bios.vendor: Xen
dmi.bios.version: 4.2.amazon
dmi.chassis.type: 1
dmi.chassis.vendor: Xen
dmi.modalias: dmi:bvnXen:bvr4.2.amazon:bd12/09/2016:svnXen:pnHVMdomU:pvr4.2.amazon:cvnXen:ct1:cvr:
dmi.product.name: HVM domU
dmi.product.version: 4.2.amazon
dmi.sys.vendor: Xen |
|
| 2018-02-23 23:59:19 |
woosht |
bug |
|
|
added subscriber woosht |
| 2019-04-07 13:19:19 |
Dan Streetman |
removed subscriber Dan Streetman |
|
|
|
