Activity log for bug #1668557

Date Who What changed Old value New value Message
2017-02-28 10:10:43 Niklas Edmundsson bug added bug
2017-02-28 10:10:43 Niklas Edmundsson attachment added version.log https://bugs.launchpad.net/bugs/1668557/+attachment/4828073/+files/version.log
2017-02-28 10:11:13 Niklas Edmundsson attachment added lspci-vnvn.log https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1668557/+attachment/4828074/+files/lspci-vnvn.log
2017-02-28 10:11:28 Niklas Edmundsson attachment added hpssacli-show-config-detail.txt https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1668557/+attachment/4828075/+files/hpssacli-show-config-detail.txt
2017-02-28 10:31:02 Brad Figg linux (Ubuntu): status New Incomplete
2017-02-28 11:37:09 Niklas Edmundsson tags apport-collected xenial
2017-02-28 11:37:10 Niklas Edmundsson description Upgrading our HP(E) servers to xenial we have discovered a severe performance regression affecting write performance on Smart Array RAID logical drives. Firmware is up to date with latest HPE SPP release at the time of testing. This performance regression has been verified on multiple sites with different HPE systems and OS:s, downgrading kernel brings back the expected performance. We are NOT seeing this on Dell hardware with H730P (LSI based) controllers, using the same OS installs. Our test system setup: Ubuntu 16.04.2 LTS Server: HP(E) DL380e, 36 G RAM, 1x E5-2420 CPU RAID Controller: Smart Array P420 2GB FBWC RAID setup: 24x 500G SAS HDDs in RAID50 with 2 parity groups. File system: xfs We are also seeing this issue on setups using DL380e with P430 controller and 14 HDDs in RAID6, but those systems are not available for testing. Fast/normal (previous) bulk IO performance is approx 1600-1800 MB/s sustained read and write using a simple dd bs=256k based test. Slow/performance regression reduces the write performance to approx 500-600 MB/s sustained using the same tests and filesystem. We have tested using the following OS installs and kernels: Precise: All tested Ubuntu kernels are fast. Trusty: trusty 3.13.0.110.118 fast utopic 3.16.0.77.68 fast vivid 3.19.0.80.62 slow xenial 4.4.0.64.50 slow Xenial: xenial 4.4.0.64.68 slow hwe 4.8.0.39.10 slow mainline 3.12.64-031264.201610030943 fast mainline 3.16.41-031641.201702270232 fast mainline 3.17.8-031708.201501081837 fast mainline 3.18.0-031800.201412071935 fast mainline 3.18.12-031812.201504221338 fast mainline 3.18.18-031818.201507101433 fast mainline 3.18.21-031821.201509020527 fast mainline 3.18.22-031822.201510031227 slow mainline 3.18.23-031823.201510291931 slow mainline 3.18.24-031824.201511031331 slow mainline 3.18.47-031847.201701181631 slow mainline 4.10.1-041001.201702260735 slow Upgrading our HP(E) servers to xenial we have discovered a severe performance regression affecting write performance on Smart Array RAID logical drives. Firmware is up to date with latest HPE SPP release at the time of testing. This performance regression has been verified on multiple sites with different HPE systems and OS:s, downgrading kernel brings back the expected performance. We are NOT seeing this on Dell hardware with H730P (LSI based) controllers, using the same OS installs. Our test system setup: Ubuntu 16.04.2 LTS Server: HP(E) DL380e, 36 G RAM, 1x E5-2420 CPU RAID Controller: Smart Array P420 2GB FBWC RAID setup: 24x 500G SAS HDDs in RAID50 with 2 parity groups. File system: xfs We are also seeing this issue on setups using DL380e with P430 controller and 14 HDDs in RAID6, but those systems are not available for testing. Fast/normal (previous) bulk IO performance is approx 1600-1800 MB/s sustained read and write using a simple dd bs=256k based test. Slow/performance regression reduces the write performance to approx 500-600 MB/s sustained using the same tests and filesystem. We have tested using the following OS installs and kernels: Precise: All tested Ubuntu kernels are fast. Trusty: trusty 3.13.0.110.118 fast utopic 3.16.0.77.68 fast vivid 3.19.0.80.62 slow xenial 4.4.0.64.50 slow Xenial: xenial 4.4.0.64.68 slow hwe 4.8.0.39.10 slow mainline 3.12.64-031264.201610030943 fast mainline 3.16.41-031641.201702270232 fast mainline 3.17.8-031708.201501081837 fast mainline 3.18.0-031800.201412071935 fast mainline 3.18.12-031812.201504221338 fast mainline 3.18.18-031818.201507101433 fast mainline 3.18.21-031821.201509020527 fast mainline 3.18.22-031822.201510031227 slow mainline 3.18.23-031823.201510291931 slow mainline 3.18.24-031824.201511031331 slow mainline 3.18.47-031847.201701181631 slow mainline 4.10.1-041001.201702260735 slow --- AlsaDevices: total 0 crw-rw---- 1 root audio 116, 1 Feb 28 10:29 seq crw-rw---- 1 root audio 116, 33 Feb 28 10:29 timer AplayDevices: Error: [Errno 2] No such file or directory ApportVersion: 2.20.1-0ubuntu2.5 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: DistroRelease: Ubuntu 16.04 IwConfig: Error: [Errno 2] No such file or directory MachineType: HP ProLiant DL380e Gen8 Package: linux (not installed) PciMultimedia: ProcFB: ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.4.0-64-generic root=/dev/mapper/rootvg-rootlv ro console=ttyS0,115200n8 noquiet nosplash nomodeset ProcVersionSignature: Ubuntu 4.4.0-64.85-generic 4.4.44 RelatedPackageVersions: linux-restricted-modules-4.4.0-64-generic N/A linux-backports-modules-4.4.0-64-generic N/A linux-firmware 1.157.8 RfKill: Error: [Errno 2] No such file or directory Tags: xenial xenial Uname: Linux 4.4.0-64-generic x86_64 UnreportableReason: The report belongs to a package that is not installed. UpgradeStatus: No upgrade log present (probably fresh install) UserGroups: _MarkForUpload: False dmi.bios.date: 08/02/2014 dmi.bios.vendor: HP dmi.bios.version: P73 dmi.chassis.type: 23 dmi.chassis.vendor: HP dmi.modalias: dmi:bvnHP:bvrP73:bd08/02/2014:svnHP:pnProLiantDL380eGen8:pvr:cvnHP:ct23:cvr: dmi.product.name: ProLiant DL380e Gen8 dmi.sys.vendor: HP
2017-02-28 11:37:11 Niklas Edmundsson attachment added CRDA.txt https://bugs.launchpad.net/bugs/1668557/+attachment/4828115/+files/CRDA.txt
2017-02-28 11:37:12 Niklas Edmundsson attachment added CurrentDmesg.txt https://bugs.launchpad.net/bugs/1668557/+attachment/4828116/+files/CurrentDmesg.txt
2017-02-28 11:37:14 Niklas Edmundsson attachment added JournalErrors.txt https://bugs.launchpad.net/bugs/1668557/+attachment/4828117/+files/JournalErrors.txt
2017-02-28 11:37:15 Niklas Edmundsson attachment added Lspci.txt https://bugs.launchpad.net/bugs/1668557/+attachment/4828118/+files/Lspci.txt
2017-02-28 11:37:17 Niklas Edmundsson attachment added Lsusb.txt https://bugs.launchpad.net/bugs/1668557/+attachment/4828119/+files/Lsusb.txt
2017-02-28 11:37:18 Niklas Edmundsson attachment added ProcCpuinfo.txt https://bugs.launchpad.net/bugs/1668557/+attachment/4828120/+files/ProcCpuinfo.txt
2017-02-28 11:37:19 Niklas Edmundsson attachment added ProcEnviron.txt https://bugs.launchpad.net/bugs/1668557/+attachment/4828121/+files/ProcEnviron.txt
2017-02-28 11:37:21 Niklas Edmundsson attachment added ProcInterrupts.txt https://bugs.launchpad.net/bugs/1668557/+attachment/4828122/+files/ProcInterrupts.txt
2017-02-28 11:37:23 Niklas Edmundsson attachment added ProcModules.txt https://bugs.launchpad.net/bugs/1668557/+attachment/4828123/+files/ProcModules.txt
2017-02-28 11:37:25 Niklas Edmundsson attachment added UdevDb.txt https://bugs.launchpad.net/bugs/1668557/+attachment/4828124/+files/UdevDb.txt
2017-02-28 11:37:27 Niklas Edmundsson attachment added WifiSyslog.txt https://bugs.launchpad.net/bugs/1668557/+attachment/4828125/+files/WifiSyslog.txt
2017-02-28 11:39:04 Niklas Edmundsson linux (Ubuntu): status Incomplete Confirmed
2017-02-28 12:11:57 Mattias Wadenstein attachment added iostat-slow-4.4.0-64-generic.txt https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1668557/+attachment/4828136/+files/iostat-slow-4.4.0-64-generic.txt
2017-02-28 12:21:17 Mattias Wadenstein attachment added iostat-fast-3.18.21-031821-generic.txt https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1668557/+attachment/4828146/+files/iostat-fast-3.18.21-031821-generic.txt
2017-02-28 12:29:15 Mattias Wadenstein attachment added iostat-slow-3.18.22-031822-generic.txt https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1668557/+attachment/4828147/+files/iostat-slow-3.18.22-031822-generic.txt
2017-02-28 12:48:26 Mattias Wadenstein attachment added block-3.18.22-031822-generic https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1668557/+attachment/4828158/+files/block-3.18.22-031822-generic
2017-02-28 12:52:42 Mattias Wadenstein attachment added block-3.18.21-031821-generic https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1668557/+attachment/4828159/+files/block-3.18.21-031821-generic
2017-02-28 13:13:23 Christian Ehrhardt  linux (Ubuntu): status Confirmed Invalid
2017-02-28 14:34:15 Niklas Edmundsson attachment added 90-hpsa-limitiosize.rules https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1668557/+attachment/4828213/+files/90-hpsa-limitiosize.rules
2017-03-01 12:13:11 Niklas Edmundsson attachment added 90-smartarray-limitiosize.rules https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1668557/+attachment/4828905/+files/90-smartarray-limitiosize.rules
2017-03-15 10:17:41 Niklas Edmundsson attachment added 90-smartarray-limitiosize.rules https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1668557/+attachment/4838063/+files/90-smartarray-limitiosize.rules