Missing hugepages in xenial on 4.4.0-36-generic

[Dragan S.]

When spawning multiple VMs and then shutting then down there are hugepages that are unaccounted for, they don't show up in "ipcs -m" or on in /dev/hugepages/

[Ben Hutchings (benh-debian)]

Unrelated to ethtool

[Brad Figg (brad-figg)]

This bug is missing log files that will aid in diagnosing the problem. From a terminal window please run:

apport-collect 1651609

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

[Colin Godsey (crgodsey)]

also getting a similar issue with Java VMs

[Colin Godsey (crgodsey)]

AlsaDevices:
 total 0
 crw-rw---- 1 root audio 116, 1 Nov 21 10:31 seq
 crw-rw---- 1 root audio 116, 33 Nov 21 10:31 timer
AplayDevices: Error: [Errno 2] No such file or directory
ApportVersion: 2.20.1-0ubuntu2.13
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
DistroRelease: Ubuntu 16.04
HibernationDevice: RESUME=UUID=b4afce55-1daa-464d-aa30-0c7c3d9b4c23
InstallationDate: Installed on 2017-09-29 (89 days ago)
InstallationMedia: Ubuntu-Server 16.04.3 LTS "Xenial Xerus" - Release amd64 (20170801)
IwConfig: Error: [Errno 2] No such file or directory
MachineType: HP ProLiant DL360 G7
NonfreeKernelModules: zfs zunicode zcommon znvpair zavl
Package: linux (not installed)
PciMultimedia:

ProcEnviron:
 TERM=xterm-256color
 PATH=(custom, no user)
 XDG_RUNTIME_DIR=<set>
 LANG=en_US.UTF-8
 SHELL=/bin/bash
ProcFB: 0 radeondrmfb
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.4.0-101-generic root=UUID=86c66318-fedd-4218-9720-74b205c95de9 ro transparent_hugepage=never default_hugepagesz=1GB hugepagesz=1GB hugepages=48
ProcVersionSignature: Ubuntu 4.4.0-101.124-generic 4.4.95
RelatedPackageVersions:
 linux-restricted-modules-4.4.0-101-generic N/A
 linux-backports-modules-4.4.0-101-generic N/A
 linux-firmware 1.157.14
RfKill: Error: [Errno 2] No such file or directory
Tags: xenial xenial
Uname: Linux 4.4.0-101-generic x86_64
UnreportableReason: The report belongs to a package that is not installed.
UpgradeStatus: No upgrade log present (probably fresh install)
UserGroups: adm cdrom dip libvirtd lpadmin lxd plugdev sambashare sudo
_MarkForUpload: False
dmi.bios.date: 05/05/2011
dmi.bios.vendor: HP
dmi.bios.version: P68
dmi.chassis.type: 23
dmi.chassis.vendor: HP
dmi.modalias: dmi:bvnHP:bvrP68:bd05/05/2011:svnHP:pnProLiantDL360G7:pvr:cvnHP:ct23:cvr:
dmi.product.name: ProLiant DL360 G7
dmi.sys.vendor: HP

[Colin Godsey (crgodsey)]

apport information

[Colin Godsey (crgodsey)]

apport information

[Colin Godsey (crgodsey)]

apport information

[Colin Godsey (crgodsey)]

apport information

[Colin Godsey (crgodsey)]

apport information

[Colin Godsey (crgodsey)]

apport information

[Colin Godsey (crgodsey)]

apport information

[Colin Godsey (crgodsey)]

apport information

[Colin Godsey (crgodsey)]

apport information

[Colin Godsey (crgodsey)]

apport information

[Colin Godsey (crgodsey)]

Sending in my report now. My issue *maybe* is related to cgroups/docker. I don't think I saw this issue until I started trying to request hugepages from a docker container.

But from what I can see, some processes just... do not give up the pages after they exit. At least not in a way that the kernel can pick up on. Instead I end up with pages that are not available, I cannot free them, and I can find no evidence of them in /dev/hugepages, ipcs, or /proc/*/numa_maps. They are just ghosts!