I'm not sure if this is the right component/package. We are not able to identify a package/program which could be responsible for this bug, so we assume it is the kernel or at least a kernel configuration.
Since the upgrade from trusty to utopic at October 27., our three servers for package building are massively swapping. This leads to by a factor of four slower build times. There were no configuration changes at all.
Munin graphs of one of the affected servers are attached.
The system has 48GB memory, and we have configured several ramdisks:
root@cx1000-02:~# mount | grep -E "tmpfs|ramfs"
none on /sys/fs/cgroup type tmpfs (rw,uid=0,gid=0,mode=0755,size=1024)
udev on /dev type devtmpfs (rw,mode=0755)
tmpfs on /run type tmpfs (rw,noexec,nosuid,size=10%,mode=0755)
none on /run/lock type tmpfs (rw,nodev,noexec,nosuid,size=5242880)
none on /run/shm type tmpfs (rw,nosuid,nodev)
none on /run/user type tmpfs (rw,nodev,noexec,nosuid,size=104857600,mode=0755)
tmpfs on /var/tmp/obs type tmpfs (rw,size=36G)
tmpfs on /run/obs type tmpfs (rw,relatime,size=1G)
ramfs on /var/obscache type ramfs (rw)
tmpfs on /run/obs type tmpfs (rw,relatime,size=1048576k)
The build service uses several chroot environments to build packages for several distributions (http://openbuildservice.org/).
You don't see any process which allocates so much memory with 'top'. Even after stopping the build service and unmounting /var/tmp/obs you are not able to deactivate the swap via swapoff -a:
root@cx1000-02:~# swapoff -a
swapoff: /dev/sda5: swapoff failed: Cannot allocate memory
We also tested the latest kernel (3.16.0-28) and an old trusty kernel (3.13.0-40) without success. Also patching perl to exclude the perl bug https://rt.perl.org/Public/Bug/Display.html?id=123198 as root cause doesn't help.
We don't have any idea what's the cause for this problem...
We can deploy debug packages or anything else on the system, so please hesitate to ask for any information or help.
ProblemType: Bug
DistroRelease: Ubuntu 14.10
Package: linux-image-3.16.0-26-generic 3.16.0-26.35
ProcVersionSignature: Ubuntu 3.16.0-26.35-generic 3.16.7-ckt1
Uname: Linux 3.16.0-26-generic x86_64
AlsaDevices: Error: command ['ls', '-l', '/dev/snd/'] failed with exit code 2: ls: cannot access /dev/snd/: No such file or directory
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
ApportVersion: 2.14.7-0ubuntu8
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
Date: Fri Dec 12 09:54:36 2014
HibernationDevice: RESUME=UUID=531cb8f2-e194-45a7-a13c-3167aacf89bf
InstallationDate: Installed on 2011-09-20 (1178 days ago)
InstallationMedia: Ubuntu-Server 11.04 "Natty Narwhal" - Release amd64 (20110426)
IwConfig:
eth0 no wireless extensions.
eth1 no wireless extensions.
lo no wireless extensions.
MachineType: FUJITSU PRIMERGY CX122 S1
PciMultimedia:
ProcFB: 0 VESA VGA
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.16.0-26-generic root=UUID=6e5b9bee-ccdf-4e6f-b09d-759312aeb3e0 ro quiet
RelatedPackageVersions:
linux-restricted-modules-3.16.0-26-generic N/A
linux-backports-modules-3.16.0-26-generic N/A
linux-firmware 1.138
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
SourcePackage: linux
UpgradeStatus: Upgraded to utopic on 2014-10-27 (45 days ago)
dmi.bios.date: 05/24/2011
dmi.bios.vendor: FUJITSU // Phoenix Technologies Ltd.
dmi.bios.version: 6.00 Rev. 1.10.2899.A1
dmi.board.asset.tag: -
dmi.board.name: D2899
dmi.board.vendor: FUJITSU
dmi.board.version: S26361-D2899-A11 WGS02 GS01
dmi.chassis.asset.tag: YLAM001377
dmi.chassis.type: 23
dmi.chassis.vendor: FUJITSU
dmi.chassis.version: CX122S1R
dmi.modalias: dmi:bvnFUJITSU//PhoenixTechnologiesLtd.:bvr6.00Rev.1.10.2899.A1:bd05/24/2011:svnFUJITSU:pnPRIMERGYCX122S1:pvrGS01:rvnFUJITSU:rnD2899:rvrS26361-D2899-A11WGS02GS01:cvnFUJITSU:ct23:cvrCX122S1R:
dmi.product.name: PRIMERGY CX122 S1
dmi.product.version: GS01
dmi.sys.vendor: FUJITSU
sorry, typo: ...so please DON'T hesitate to ask for any information or help.