Ubuntu
linux package

sysfs test ubuntu_stress_smoke_test will cause kernel oops on X-lowlatency

Bug #1796250 reported by Po-Hsu Lin on 2018-10-05

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	ubuntu-kernel-tests	Fix Released	Undecided	Colin Ian King
	linux (Ubuntu)	Won't Fix	Medium	Colin Ian King

Bug Description

This is found on a SRU testing node "gonzo", with 4.4 amd64 lowlatency kernel.

This issue cannot be reproduced with the kernel 4.4.0-137 in -updates (a bit random, see comment #4)
And cannot be reproduced with the AMD64 generic kernel in -proposed (4.4.0-138) as well

16:50:01 DEBUG| [stdout] timer STARTING
16:50:05 ERROR| [stderr] /home/ubuntu/autotest/client/tests/ubuntu_stress_smoke_test/ubuntu_stress_smoke_test.sh: line 111: 39506 Killed ./stress-ng -v -t ${DURATION} --${s} ${INSTANCES} ${STRESS_OPTIONS} &> ${TMP_FILE}
16:50:05 DEBUG| [stdout] timer RETURNED 137
16:50:05 DEBUG| [stdout] timer FAILED (kernel oopsed)
16:50:05 DEBUG| [stdout] [ 1418.982110] BUG: unable to handle kernel paging request at 0000000100000001
16:50:05 DEBUG| [stdout] [ 1419.065329] IP: [<ffffffff811f5ac7>] kmem_cache_alloc+0x77/0x1f0
16:50:05 DEBUG| [stdout] [ 1419.137102] PGD 16f6dd067 PUD 0
16:50:05 DEBUG| [stdout] [ 1419.175602] Oops: 0000 [#6] SMP
16:50:05 DEBUG| [stdout] [ 1419.214101] Modules linked in: unix_diag binfmt_misc vhost_net vhost macvtap cuse macvlan dccp_ipv4 dccp jitterentropy_rng algif_rng ghash_generic salsa20_generic salsa20_x86_64 camellia_generic camellia_aesni_avx_x86_64 camellia_x86_64 cast6_avx_x86_64 cast6_generic cast_common serpent_avx_x86_64 serpent_sse2_x86_64 serpent_generic twofish_generic twofish_avx_x86_64 twofish_x86_64_3way twofish_x86_64 twofish_common xts algif_skcipher tgr192 wp512 rmd320 rmd256 rmd160 rmd128 md4 algif_hash af_alg aufs kvm_amd kvm ipmi_devintf ipmi_ssif irqbypass dcdbas ipmi_si fam15h_power acpi_power_meter joydev input_leds ipmi_msghandler serio_raw i2c_piix4 k10temp amd64_edac_mod 8250_fintek mac_hid shpchp edac_mce_amd edac_core ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi
16:50:05 DEBUG| [stdout] [ 1420.062172] scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel mptsas mptscsih pata_acpi hid_generic aesni_intel aes_x86_64 mptbase lrw gf128mul glue_helper psmouse ahci ablk_helper usbhid cryptd pata_atiixp libahci scsi_transport_sas bnx2 hid
16:50:05 DEBUG| [stdout] [ 1420.472200] CPU: 3 PID: 39506 Comm: ubuntu_stress_s Tainted: G D 4.4.0-138-generic #164-Ubuntu
16:50:05 DEBUG| [stdout] [ 1420.588693] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
16:50:05 DEBUG| [stdout] [ 1420.678138] task: ffff880177823800 ti: ffff88016a5b0000 task.ti: ffff88016a5b0000
16:50:05 DEBUG| [stdout] [ 1420.767584] RIP: 0010:[<ffffffff811f5ac7>] [<ffffffff811f5ac7>] kmem_cache_alloc+0x77/0x1f0
16:50:05 DEBUG| [stdout] [ 1420.868478] RSP: 0018:ffff88016a5b3bd0 EFLAGS: 00010202
16:50:05 DEBUG| [stdout] [ 1420.931924] RAX: 0000000000000000 RBX: 00000000024000c0 RCX: 000000000129e216
16:50:05 DEBUG| [stdout] [ 1421.017209] RDX: 000000000129e215 RSI: 00000000024000c0 RDI: 000000000001a5c0
16:50:05 DEBUG| [stdout] [ 1421.102496] RBP: ffff88016a5b3c00 R08: ffff8802156da5c0 R09: 0000000100000001
16:50:05 DEBUG| [stdout] [ 1421.187782] R10: ffff880000000ff0 R11: 0000000000000ff0 R12: 00000000024000c0
16:50:05 DEBUG| [stdout] [ 1421.273070] R13: ffffffff811d53e8 R14: ffff880215003b00 R15: ffff880215003b00
16:50:05 DEBUG| [stdout] [ 1421.358354] FS: 00007f1323076700(0000) GS:ffff8802156c0000(0000) knlGS:0000000000000000
16:50:05 DEBUG| [stdout] [ 1421.455081] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
16:50:05 DEBUG| [stdout] [ 1421.523728] CR2: 0000000100000001 CR3: 000000016f6dc000 CR4: 00000000000406f0
16:50:05 DEBUG| [stdout] [ 1421.609013] Stack:
16:50:05 DEBUG| [stdout] [ 1421.632941] 0000000000000000 ffff88019c080a28 0000000000000000 ffffc00000000fff
16:50:05 DEBUG| [stdout] [ 1421.721371] 00007fffffffefec ffff88020ff29000 ffff88016a5b3c38 ffffffff811d53e8
16:50:05 DEBUG| [stdout] [ 1421.809805] 0000000000000002 ffff88019c080a28 ffffc00000000fff 00007fffffffefec
16:50:05 DEBUG| [stdout] [ 1421.898237] Call Trace:
16:50:05 DEBUG| [stdout] [ 1421.927367] [<ffffffff811d53e8>] anon_vma_prepare+0x48/0x180
16:50:05 DEBUG| [stdout] [ 1421.996017] [<ffffffff811c8c3d>] handle_mm_fault+0x13ed/0x1b70
16:50:05 DEBUG| [stdout] [ 1422.066743] [<ffffffff812350cf>] ? atime_needs_update+0x6f/0xd0
16:50:05 DEBUG| [stdout] [ 1422.138510] [<ffffffff81235163>] ? touch_atime+0x33/0xd0
16:50:05 DEBUG| [stdout] [ 1422.202997] [<ffffffff8119781c>] ? generic_file_read_iter+0x5dc/0x6b0
16:50:05 DEBUG| [stdout] [ 1422.281009] [<ffffffff811cd5b8>] ? find_vma+0x68/0x70
16:50:05 DEBUG| [stdout] [ 1422.342374] [<ffffffff811c3176>] ? follow_page_mask+0x36/0x3a0
16:50:05 DEBUG| [stdout] [ 1422.413100] [<ffffffff811c35fe>] __get_user_pages+0x11e/0x600
16:50:05 DEBUG| [stdout] [ 1422.482788] [<ffffffff811c3ee2>] get_user_pages+0x52/0x60
16:50:05 DEBUG| [stdout] [ 1422.548314] [<ffffffff8121ea03>] copy_strings.isra.20+0x173/0x350
16:50:05 DEBUG| [stdout] [ 1422.622161] [<ffffffff8121ec14>] copy_strings_kernel+0x34/0x40
16:50:05 DEBUG| [stdout] [ 1422.692898] [<ffffffff8121f9cc>] do_execveat_common.isra.31+0x4cc/0x770
16:50:05 DEBUG| [stdout] [ 1422.772986] [<ffffffff8121feca>] SyS_execve+0x3a/0x50
16:50:05 DEBUG| [stdout] [ 1422.834353] [<ffffffff81857a25>] stub_execve+0x5/0x5
16:50:05 DEBUG| [stdout] [ 1422.894679] [<ffffffff818576ce>] ? entry_SYSCALL_64_fastpath+0x22/0xc1
16:50:05 DEBUG| [stdout] [ 1422.973724] Code: 08 65 4c 03 05 53 77 e1 7e 49 83 78 10 00 4d 8b 08 0f 84 2b 01 00 00 4d 85 c9 0f 84 22 01 00 00 49 63 47 20 48 8d 4a 01 49 8b 3f <49> 8b 1c 01 4c 89 c8 65 48 0f c7 0f 0f 94 c0 84 c0 74 bb 49 63
16:50:05 DEBUG| [stdout] [ 1423.199831] RIP [<ffffffff811f5ac7>] kmem_cache_alloc+0x77/0x1f0
16:50:05 DEBUG| [stdout] [ 1423.272646] RSP <ffff88016a5b3bd0>
16:50:05 DEBUG| [stdout] [ 1423.314250] CR2: 0000000100000001
16:50:05 DEBUG| [stdout] [ 1423.353892] ---[ end trace 7c103db725e9179b ]---
16:50:05 DEBUG| [stdout]
16:50:05 DEBUG| [stdout] timerfd STARTING
16:50:10 DEBUG| [stdout] timerfd RETURNED 0
16:50:10 DEBUG| [stdout] timerfd FAILED (kernel oopsed)
16:50:10 DEBUG| [stdout] [ 1424.951012] BUG: unable to handle kernel paging request at 0000000100000001
16:50:10 DEBUG| [stdout] [ 1425.034231] IP: [<ffffffff811f584b>] kmem_cache_alloc_trace+0x7b/0x1f0
16:50:10 DEBUG| [stdout] [ 1425.112252] PGD 2133e0067 PUD 0
16:50:10 DEBUG| [stdout] [ 1425.150753] Oops: 0000 [#7] SMP
16:50:10 DEBUG| [stdout] [ 1425.189259] Modules linked in: unix_diag binfmt_misc vhost_net vhost macvtap cuse macvlan dccp_ipv4 dccp jitterentropy_rng algif_rng ghash_generic salsa20_generic salsa20_x86_64 camellia_generic camellia_aesni_avx_x86_64 camellia_x86_64 cast6_avx_x86_64 cast6_generic cast_common serpent_avx_x86_64 serpent_sse2_x86_64 serpent_generic twofish_generic twofish_avx_x86_64 twofish_x86_64_3way twofish_x86_64 twofish_common xts algif_skcipher tgr192 wp512 rmd320 rmd256 rmd160 rmd128 md4 algif_hash af_alg aufs kvm_amd kvm ipmi_devintf ipmi_ssif irqbypass dcdbas ipmi_si fam15h_power acpi_power_meter joydev input_leds ipmi_msghandler serio_raw i2c_piix4 k10temp amd64_edac_mod 8250_fintek mac_hid shpchp edac_mce_amd edac_core ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi
16:50:10 DEBUG| [stdout] [ 1426.037337] scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel mptsas mptscsih pata_acpi hid_generic aesni_intel aes_x86_64 mptbase lrw gf128mul glue_helper psmouse ahci ablk_helper usbhid cryptd pata_atiixp libahci scsi_transport_sas bnx2 hid
16:50:10 DEBUG| [stdout] [ 1426.447365] CPU: 3 PID: 1404 Comm: irqbalance Tainted: G D 4.4.0-138-generic #164-Ubuntu
16:50:10 DEBUG| [stdout] [ 1426.557614] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
16:50:10 DEBUG| [stdout] [ 1426.647061] task: ffff88020f444600 ti: ffff880211c50000 task.ti: ffff880211c50000
16:50:10 DEBUG| [stdout] [ 1426.736514] RIP: 0010:[<ffffffff811f584b>] [<ffffffff811f584b>] kmem_cache_alloc_trace+0x7b/0x1f0
16:50:10 DEBUG| [stdout] [ 1426.843647] RSP: 0018:ffff880211c53c20 EFLAGS: 00010202
16:50:10 DEBUG| [stdout] [ 1426.907100] RAX: 0000000000000000 RBX: 00000000024080c0 RCX: 000000000129e216
16:50:10 DEBUG| [stdout] [ 1426.992392] RDX: 000000000129e215 RSI: 00000000024080c0 RDI: 000000000001a5c0
16:50:10 DEBUG| [stdout] [ 1427.077678] RBP: ffff880211c53c60 R08: ffff8802156da5c0 R09: ffff880215003b00
16:50:10 DEBUG| [stdout] [ 1427.162965] R10: 0000000100000001 R11: 0000000000000000 R12: 00000000024080c0
16:50:10 DEBUG| [stdout] [ 1427.248251] R13: ffffffff81285f92 R14: ffff88009b8fa700 R15: ffff880215003b00
16:50:10 DEBUG| [stdout] [ 1427.333539] FS: 00007efedee3e740(0000) GS:ffff8802156c0000(0000) knlGS:0000000000000000
16:50:10 DEBUG| [stdout] [ 1427.430270] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
16:50:10 DEBUG| [stdout] [ 1427.498916] CR2: 0000000100000001 CR3: 000000021219f000 CR4: 00000000000406f0
16:50:10 DEBUG| [stdout] [ 1427.584201] Stack:
16:50:10 DEBUG| [stdout] [ 1427.608128] ffff880211c53c40 ffff880211c53c58 0000000000000028 ffff880213963a40
16:50:10 DEBUG| [stdout] [ 1427.696560] ffff880213741fe8 0000000000000000 ffff88009b8fa700 ffff88009b8fa710
16:50:10 DEBUG| [stdout] [ 1427.784992] ffff880211c53c98 ffffffff81285f92 ffff88009b8fa700 ffff88020f81f800
16:50:10 DEBUG| [stdout] [ 1427.873425] Call Trace:
16:50:10 DEBUG| [stdout] [ 1427.902556] [<ffffffff81285f92>] proc_reg_open+0x32/0x110
16:50:10 DEBUG| [stdout] [ 1427.968086] [<ffffffff812159c2>] do_dentry_open+0x202/0x310
16:50:10 DEBUG| [stdout] [ 1428.035699] [<ffffffff81285f60>] ? proc_reg_release+0x70/0x70
16:50:10 DEBUG| [stdout] [ 1428.105391] [<ffffffff81216b54>] vfs_open+0x54/0x80
16:50:10 DEBUG| [stdout] [ 1428.164686] [<ffffffff812228ab>] ? may_open+0x5b/0xf0
16:50:10 DEBUG| [stdout] [ 1428.226058] [<ffffffff81226b6c>] path_openat+0x59c/0x1340
16:50:10 DEBUG| [stdout] [ 1428.291592] [<ffffffff81852ffd>] ? __schedule+0x30d/0x7f0
16:50:10 DEBUG| [stdout] [ 1428.357122] [<ffffffff81852ff1>] ? __schedule+0x301/0x7f0
16:50:10 DEBUG| [stdout] [ 1428.422648] [<ffffffff81228b01>] do_filp_open+0x91/0x100
16:50:10 DEBUG| [stdout]
16:50:10 DEBUG| [stdout] tlb-shootdown STARTING

ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: linux-image-4.4.0-138-lowlatency 4.4.0-138.164
ProcVersionSignature: User Name 4.4.0-138.164-lowlatency 4.4.155
Uname: Linux 4.4.0-138-lowlatency x86_64
AlsaDevices:
total 0
crw-rw---- 1 root audio 116, 1 Oct 5 07:58 seq
crw-rw---- 1 root audio 116, 33 Oct 5 07:58 timer
AplayDevices: Error: [Errno 2] No such file or directory: 'aplay'
ApportVersion: 2.20.1-0ubuntu2.18
Architecture: amd64
ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord'
AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1:
CRDA: N/A
CurrentDmesg:

Date: Fri Oct 5 07:59:12 2018
IwConfig: Error: [Errno 2] No such file or directory: 'iwconfig'
Lsusb:
Bus 002 Device 002: ID 8087:0020 Intel Corp. Integrated Rate Matching Hub
Bus 002 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
Bus 001 Device 003: ID 0424:2514 Standard Microsystems Corp. USB 2.0 Hub
Bus 001 Device 002: ID 8087:0020 Intel Corp. Integrated Rate Matching Hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
MachineType: Dell Inc. PowerEdge R310
PciMultimedia:

ProcFB:

ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-4.4.0-138-lowlatency root=UUID=7b91a2b8-2e02-407e-a51d-766f6d969020 ro console=ttyS0,1152008n1
RelatedPackageVersions:
linux-restricted-modules-4.4.0-138-lowlatency N/A
linux-backports-modules-4.4.0-138-lowlatency N/A
linux-firmware 1.157.20
RfKill: Error: [Errno 2] No such file or directory: 'rfkill'
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 08/17/2011
dmi.bios.vendor: Dell Inc.
dmi.bios.version: 1.8.2
dmi.board.name: 05XKKK
dmi.board.vendor: Dell Inc.
dmi.board.version: A05
dmi.chassis.type: 23
dmi.chassis.vendor: Dell Inc.
dmi.modalias: dmi:bvnDellInc.:bvr1.8.2:bd08/17/2011:svnDellInc.:pnPowerEdgeR310:pvr:rvnDellInc.:rn05XKKK:rvrA05:cvnDellInc.:ct23:cvr:
dmi.product.name: PowerEdge R310
dmi.sys.vendor: Dell Inc.

See original description

Tags:

Revision history for this message

Po-Hsu Lin (cypressyew) wrote on 2018-10-05:

Dependencies.txt Edit (2.8 KiB, text/plain; charset="utf-8")
Lspci.txt Edit (19.5 KiB, text/plain; charset="utf-8")
ProcCpuinfo.txt Edit (7.4 KiB, text/plain; charset="utf-8")
ProcCpuinfoMinimal.txt Edit (944 bytes, text/plain; charset="utf-8")
ProcEnviron.txt Edit (310 bytes, text/plain; charset="utf-8")
ProcInterrupts.txt Edit (6.1 KiB, text/plain; charset="utf-8")
ProcModules.txt Edit (4.4 KiB, text/plain; charset="utf-8")
UdevDb.txt Edit (104.6 KiB, text/plain; charset="utf-8")
WifiSyslog.txt Edit (60.8 KiB, text/plain; charset="utf-8")

Revision history for this message

Ubuntu Kernel Bot (ubuntu-kernel-bot) wrote on 2018-10-05: Missing required logs.

This bug is missing log files that will aid in diagnosing the problem. While running an Ubuntu kernel (not a mainline or third-party kernel) please enter the following command in a terminal window:

apport-collect 1796250

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.

Changed in linux (Ubuntu):
status:	New → Incomplete

Revision history for this message

Po-Hsu Lin (cypressyew) wrote on 2018-10-05: Re: timer test in ubuntu_stress_smoke_test will cause kernel oops on X-lowlatency

Tested on a KVM with 4.4.0-138 amd64 lowlatency kernel, didn't spot this issue.

Need to test on "gonzo"

Revision history for this message

Po-Hsu Lin (cypressyew) wrote on 2018-10-05:

It looks like this issue is a bit random, with 4.4.0-137-lowlatency amd64 kernel on gonzo, the kernel oops happened with sysfs and tee test.

description:	updated
description:	updated

Revision history for this message

Colin Ian King (colin-king) wrote on 2018-10-05:

Download full text (34.2 KiB)

So I believe this is the sysfs test that causes the issues, the subsequent tee timer stressors just appear to be broken because the sysfs stressor got the kernel into a mangled broken state.

I was able to run the tee and timer stressors on a cleanly booted 4.4.0-137-lowlatency kernel without any issues. Running the sysfs stressor caused a load of oopses as follows:

So I believe this is the sysfs test that causes the issues, the subsequent tee timer stressors just appear to be broken because the sysfs stressor got the kernel into a mangled broken state.

I was able to run the tee and timer stressors on a cleanly booted 4.4.0-137-lowlatency kernel without any issues.  Running the sysfs stressor caused a load of oopses as follows:

740.873265] iounmap: bad address ffffc90004da0000
[  740.929503] CPU: 4 PID: 1788 Comm: stress-ng-sysfs Not tainted 4.4.0-138-lowlatency #164-Ubuntu
[  740.929509] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
[  740.929512]  0000000000000286 5dc48b8f33ce7222 ffff8800da813bc0 ffffffff8140dc61
[  740.929536]  ffff8800df1f9d80 ffffc90004da0000 ffff8800da813be0 ffffffff8106ec1f
[  740.929541]  ffff8800df1f9d80 ffffc90004da0000 ffff8800da813bf0 ffffffff8106ec5c
[  740.929544] Call Trace:
[  740.929553]  [<ffffffff8140dc61>] dump_stack+0x63/0x82
[  740.929558]  [<ffffffff8106ec1f>] iounmap.part.1+0x7f/0x90
[  740.929563]  [<ffffffff8106ec5c>] iounmap+0x2c/0x30
[  740.929572]  [<ffffffff814a1bb1>] acpi_os_map_cleanup.part.9+0x31/0x40
[  740.929587]  [<ffffffff8185b71e>] acpi_os_unmap_iomem+0xbe/0xf0
[  740.929607]  [<ffffffff8155614d>] read_log+0xad/0x170
[  740.929619]  [<ffffffff81555e77>] tpm_binary_bios_measurements_open+0x37/0x90
[  740.929626]  [<ffffffff8121a7d2>] do_dentry_open+0x202/0x310
[  740.929632]  [<ffffffff81555e40>] ? tpm_ascii_bios_measurements_show+0x260/0x260
[  740.929645]  [<ffffffff8121b964>] vfs_open+0x54/0x80
[  740.929656]  [<ffffffff8122771b>] ? may_open+0x5b/0xf0
[  740.929662]  [<ffffffff8122ac36>] path_openat+0x1b6/0x13a0
[  740.929670]  [<ffffffff8106e34a>] ? __do_page_fault+0x23a/0x440
[  740.929678]  [<ffffffff8119fb91>] ? free_one_page+0x191/0x340
[  740.929686]  [<ffffffff8122d9f1>] do_filp_open+0x91/0x100
[  740.929695]  [<ffffffff8123e26e>] ? mntput_no_expire+0x2e/0x1b0
[  740.929702]  [<ffffffff8123b907>] ? __alloc_fd+0xc7/0x190
[  740.929720]  [<ffffffff8121bd38>] do_sys_open+0x138/0x2b0
[  740.929735]  [<ffffffff8121bece>] SyS_open+0x1e/0x20
[  740.929747]  [<ffffffff81864e8e>] entry_SYSCALL_64_fastpath+0x22/0xc1
[  749.735460] BUG: unable to handle kernel paging request at 0000000100000001
[  749.818685] IP: [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  749.896706] PGD d3e68067 PUD 0 
[  749.934172] Oops: 0000 [#1] PREEMPT SMP 
[  749.981003] Modules linked in: kvm_amd kvm irqbypass ipmi_devintf ipmi_ssif dcdbas input_leds joydev amd64_edac_mod 8250_fintek k10temp fam15h_power serio_raw edac_mce_amd ipmi_si i2c_piix4 acpi_power_meter edac_core ipmi_msghandler shpchp mac_hid ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel hid_generic aes_x86_64 mptsas lrw mptscsih gf128mul usbhid glue_helper ablk_helper pata_acpi hid cryptd psmouse pata_atiixp mptbase ahci bnx2 libahci scsi_transport_sas
[  750.743813] CPU: 4 PID: 1791 Comm: stress-ng-sysfs Not tainted 4.4.0-138-lowlatency #164-Ubuntu
[  750.847825] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
[  750.937282] task: ffff8800d3e45580 ti: ffff8800da824000 task.ti: ffff8800da824000
[  751.026734] RIP: 0010:[<ffffffff811fa246>]  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  751.133881] RSP: 0018:ffff8800da827c18  EFLAGS: 00010202
[  751.197334] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000b1af204
[  751.282627] RDX: 000000000b1af004 RSI: 000000000b1af004 RDI: 000000000001a740
[  751.367921] RBP: ffff8800da827c58 R08: ffff880215003b00 R09: ffffffff8129e635
[  751.453209] R10: 000000000637760b R11: 0000000000000000 R12: 00000000024000c0
[  751.538502] R13: 0000000100000001 R14: ffff88020fc24900 R15: ffff880215003b00
[  751.623798] FS:  00007f8e5a1f4700(0000) GS:ffff880215700000(0000) knlGS:0000000000000000
[  751.720535] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  751.789183] CR2: 0000000100000001 CR3: 00000000db29e000 CR4: 00000000000406f0
[  751.874477] Stack:
[  751.898415]  0000000000000000 ffff88020fc24900 0000000000000030 0000000000000000
[  751.986848]  ffff88020f67cf00 ffff8800d94cf980 ffff88020fc24900 ffff8802124386a8
[  752.075289]  ffff8800da827c98 ffffffff8129e635 0000000000000000 ffff88020fc24900
[  752.163722] Call Trace:
[  752.192853]  [<ffffffff8129e635>] kernfs_fop_open+0x275/0x370
[  752.261505]  [<ffffffff8121a7d2>] do_dentry_open+0x202/0x310
[  752.329117]  [<ffffffff8129e3c0>] ? kernfs_fop_release+0x60/0x60
[  752.400893]  [<ffffffff8121b964>] vfs_open+0x54/0x80
[  752.460186]  [<ffffffff8122771b>] ? may_open+0x5b/0xf0
[  752.521559]  [<ffffffff8122ac36>] path_openat+0x1b6/0x13a0
[  752.587093]  [<ffffffff8106dfa3>] ? bad_area_access_error+0x43/0x50
[  752.661986]  [<ffffffff8122d9f1>] do_filp_open+0x91/0x100
[  752.726486]  [<ffffffff8123b907>] ? __alloc_fd+0xc7/0x190
[  752.790980]  [<ffffffff8121bd38>] do_sys_open+0x138/0x2b0
[  752.855479]  [<ffffffff8121bece>] SyS_open+0x1e/0x20
[  752.914775]  [<ffffffff81864e8e>] entry_SYSCALL_64_fastpath+0x22/0xc1
[  752.991744] Code: 08 48 39 f2 75 e7 48 83 78 10 00 4c 8b 28 0f 84 48 01 00 00 4d 85 ed 0f 84 3f 01 00 00 49 63 47 20 49 8b 3f 48 8d 8a 00 02 00 00 <49> 8b 5c 05 00 4c 89 e8 65 48 0f c7 0f 0f 94 c0 84 c0 74 ab 49 
[  753.217863] RIP  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  753.296928]  RSP <ffff8800da827c18>
[  753.338534] CR2: 0000000100000001
[  753.378680] ---[ end trace 05e981119b7b5f0d ]---
[  753.455915] BUG: unable to handle kernel paging request at 0000000100000001
[  753.539141] IP: [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  753.617166] PGD db319067 PUD 0 
[  753.654626] Oops: 0000 [#2] PREEMPT SMP 
[  753.701452] Modules linked in: kvm_amd kvm irqbypass ipmi_devintf ipmi_ssif dcdbas input_leds joydev amd64_edac_mod 8250_fintek k10temp fam15h_power serio_raw edac_mce_amd ipmi_si i2c_piix4 acpi_power_meter edac_core ipmi_msghandler shpchp mac_hid ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel hid_generic aes_x86_64 mptsas lrw mptscsih gf128mul usbhid glue_helper ablk_helper pata_acpi hid cryptd psmouse pata_atiixp mptbase ahci bnx2 libahci scsi_transport_sas
[  754.464262] CPU: 4 PID: 1795 Comm: stress-ng-sysfs Tainted: G      D         4.4.0-138-lowlatency #164-Ubuntu
[  754.582834] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
[  754.672289] task: ffff880213200000 ti: ffff8800d9424000 task.ti: ffff8800d9424000
[  754.761743] RIP: 0010:[<ffffffff811fa246>]  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  754.868889] RSP: 0018:ffff8800d9427c18  EFLAGS: 00010202
[  754.932342] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000b1af204
[  755.017636] RDX: 000000000b1af004 RSI: 000000000b1af004 RDI: 000000000001a740
[  755.102929] RBP: ffff8800d9427c58 R08: ffff880215003b00 R09: ffffffff8129e635
[  755.188224] R10: 000000000637760b R11: 0000000000000000 R12: 00000000024000c0
[  755.273518] R13: 0000000100000001 R14: ffff8800d8b28b00 R15: ffff880215003b00
[  755.358812] FS:  00007f8e5a1f4700(0000) GS:ffff880215700000(0000) knlGS:0000000000000000
[  755.455545] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  755.524198] CR2: 0000000100000001 CR3: 00000000db332000 CR4: 00000000000406f0
[  755.609493] Stack:
[  755.633423]  ffffffff81a33fe0 ffff8800d8b28b00 0000000000000030 0000000000000000
[  755.721858]  ffff880213e5cf78 ffff8800d94cfa80 ffff8800d8b28b00 ffff8800d9c66ef0
[  755.810292]  ffff8800d9427c98 ffffffff8129e635 0000000000000000 ffff8800d8b28b00
[  755.898723] Call Trace:
[  755.927858]  [<ffffffff8129e635>] kernfs_fop_open+0x275/0x370
[  755.996509]  [<ffffffff8121a7d2>] do_dentry_open+0x202/0x310
[  756.064121]  [<ffffffff8129e3c0>] ? kernfs_fop_release+0x60/0x60
[  756.135895]  [<ffffffff8121b964>] vfs_open+0x54/0x80
[  756.195187]  [<ffffffff8122771b>] ? may_open+0x5b/0xf0
[  756.256562]  [<ffffffff8122ac36>] path_openat+0x1b6/0x13a0
[  756.322096]  [<ffffffff8122d9f1>] do_filp_open+0x91/0x100
[  756.386590]  [<ffffffff8123e26e>] ? mntput_no_expire+0x2e/0x1b0
[  756.457322]  [<ffffffff8123b907>] ? __alloc_fd+0xc7/0x190
[  756.521822]  [<ffffffff8121bd38>] do_sys_open+0x138/0x2b0
[  756.586323]  [<ffffffff8121bece>] SyS_open+0x1e/0x20
[  756.645624]  [<ffffffff81864e8e>] entry_SYSCALL_64_fastpath+0x22/0xc1
[  756.722600] Code: 08 48 39 f2 75 e7 48 83 78 10 00 4c 8b 28 0f 84 48 01 00 00 4d 85 ed 0f 84 3f 01 00 00 49 63 47 20 49 8b 3f 48 8d 8a 00 02 00 00 <49> 8b 5c 05 00 4c 89 e8 65 48 0f c7 0f 0f 94 c0 84 c0 74 ab 49 
[  756.948717] RIP  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  757.027776]  RSP <ffff8800d9427c18>
[  757.069383] CR2: 0000000100000001
[  757.109008] ---[ end trace 05e981119b7b5f0e ]---
[  757.197243] BUG: unable to handle kernel paging request at 0000000100000001
[  757.280467] IP: [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  757.358487] PGD d3e68067 PUD 0 
[  757.395948] Oops: 0000 [#3] PREEMPT SMP 
[  757.442780] Modules linked in: kvm_amd kvm irqbypass ipmi_devintf ipmi_ssif dcdbas input_leds joydev amd64_edac_mod 8250_fintek k10temp fam15h_power serio_raw edac_mce_amd ipmi_si i2c_piix4 acpi_power_meter edac_core ipmi_msghandler shpchp mac_hid ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel hid_generic aes_x86_64 mptsas lrw mptscsih gf128mul usbhid glue_helper ablk_helper pata_acpi hid cryptd psmouse pata_atiixp mptbase ahci bnx2 libahci scsi_transport_sas
[  758.205616] CPU: 4 PID: 1789 Comm: stress-ng-sysfs Tainted: G      D         4.4.0-138-lowlatency #164-Ubuntu
[  758.324187] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
[  758.413642] task: ffff88020f4e0000 ti: ffff8800da860000 task.ti: ffff8800da860000
[  758.503095] RIP: 0010:[<ffffffff811fa246>]  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  758.610237] RSP: 0018:ffff8800da863c18  EFLAGS: 00010202
[  758.673689] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000b1af204
[  758.758983] RDX: 000000000b1af004 RSI: 000000000b1af004 RDI: 000000000001a740
[  758.844282] RBP: ffff8800da863c58 R08: ffff880215003b00 R09: ffffffff8129e635
[  758.929570] R10: 000000000637760b R11: 0000000000000000 R12: 00000000024000c0
[  759.014864] R13: 0000000100000001 R14: ffff8800d8b28c00 R15: ffff880215003b00
[  759.100158] FS:  00007f8e5b1f6700(0000) GS:ffff880215700000(0000) knlGS:0000000000000000
[  759.196892] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  759.265546] CR2: 0000000100000001 CR3: 00000000db29e000 CR4: 00000000000406f0
[  759.350838] Stack:
[  759.374771]  ffffffff81a33fe0 ffff8800d8b28c00 0000000000000030 0000000000000000
[  759.463206]  ffff8800df2b1ca8 ffff8800d94cfa00 ffff8800d8b28c00 ffff8800d9c2dd30
[  759.551644]  ffff8800da863c98 ffffffff8129e635 0000000000000000 ffff8800d8b28c00
[  759.640082] Call Trace:
[  759.669219]  [<ffffffff8129e635>] kernfs_fop_open+0x275/0x370
[  759.737875]  [<ffffffff8121a7d2>] do_dentry_open+0x202/0x310
[  759.805485]  [<ffffffff8129e3c0>] ? kernfs_fop_release+0x60/0x60
[  759.877262]  [<ffffffff8121b964>] vfs_open+0x54/0x80
[  759.936552]  [<ffffffff8122771b>] ? may_open+0x5b/0xf0
[  759.997927]  [<ffffffff8122ac36>] path_openat+0x1b6/0x13a0
[  760.063462]  [<ffffffff81860440>] ? __schedule+0x310/0x830
[  760.128995]  [<ffffffff81860434>] ? __schedule+0x304/0x830
[  760.194527]  [<ffffffff81860440>] ? __schedule+0x310/0x830
[  760.260062]  [<ffffffff81860434>] ? __schedule+0x304/0x830
[  760.325595]  [<ffffffff8122d9f1>] do_filp_open+0x91/0x100
[  760.390089]  [<ffffffff81860440>] ? __schedule+0x310/0x830
[  760.455622]  [<ffffffff81860434>] ? __schedule+0x304/0x830
[  760.521164]  [<ffffffff8123b907>] ? __alloc_fd+0xc7/0x190
[  760.585662]  [<ffffffff8121bd38>] do_sys_open+0x138/0x2b0
[  760.650155]  [<ffffffff81860474>] ? __schedule+0x344/0x830
[  760.715691]  [<ffffffff8121bece>] SyS_open+0x1e/0x20
[  760.774982]  [<ffffffff81864e8e>] entry_SYSCALL_64_fastpath+0x22/0xc1
[  760.851956] Code: 08 48 39 f2 75 e7 48 83 78 10 00 4c 8b 28 0f 84 48 01 00 00 4d 85 ed 0f 84 3f 01 00 00 49 63 47 20 49 8b 3f 48 8d 8a 00 02 00 00 <49> 8b 5c 05 00 4c 89 e8 65 48 0f c7 0f 0f 94 c0 84 c0 74 ab 49 
[  761.078070] RIP  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  761.157130]  RSP <ffff8800da863c18>
[  761.198737] CR2: 0000000100000001
[  761.238362] ---[ end trace 05e981119b7b5f0f ]---
[  761.300125] BUG: unable to handle kernel paging request at 0000000100000001
[  761.383353] IP: [<ffffffff811f9ba1>] __kmalloc+0x91/0x270
[  761.447852] PGD db282067 PUD 0 
[  761.485312] Oops: 0000 [#4] PREEMPT SMP 
[  761.532139] Modules linked in: kvm_amd kvm irqbypass ipmi_devintf ipmi_ssif dcdbas input_leds joydev amd64_edac_mod 8250_fintek k10temp fam15h_power serio_raw edac_mce_amd ipmi_si i2c_piix4 acpi_power_meter edac_core ipmi_msghandler shpchp mac_hid ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel hid_generic aes_x86_64 mptsas lrw mptscsih gf128mul usbhid glue_helper ablk_helper pata_acpi hid cryptd psmouse pata_atiixp mptbase ahci bnx2 libahci scsi_transport_sas
[  762.294968] CPU: 4 PID: 1787 Comm: stress-ng-sysfs Tainted: G      D         4.4.0-138-lowlatency #164-Ubuntu
[  762.413541] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
[  762.502994] task: ffff88020ff5d580 ti: ffff8800db37c000 task.ti: ffff8800db37c000
[  762.592449] RIP: 0010:[<ffffffff811f9ba1>]  [<ffffffff811f9ba1>] __kmalloc+0x91/0x270
[  762.686074] RSP: 0018:ffff8800db37fba0  EFLAGS: 00010202
[  762.749522] RAX: 0000000000000000 RBX: ffff8800d9c32f00 RCX: 000000000b1af204
[  762.834816] RDX: 000000000b1af004 RSI: 000000000b1af004 RDI: 000000000001a740
[  762.920109] RBP: ffff8800db37fbd8 R08: ffff880215003b00 R09: ffffffff81236802
[  763.005403] R10: 000000000637760b R11: 8080808080808080 R12: 00000000024000c0
[  763.090704] R13: 0000000000000033 R14: ffff880215003b00 R15: 0000000100000001
[  763.175997] FS:  00007f8e5ddce700(0000) GS:ffff880215700000(0000) knlGS:0000000000000000
[  763.272730] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  763.341383] CR2: 0000000100000001 CR3: 00000000db18c000 CR4: 00000000000406f0
[  763.426677] Stack:
[  763.450609]  ffff88021159103f ffffffff812366e5 ffff8800d9c32f00 ffff8800db37fd40
[  763.539042]  ffff880213df4000 ffff8800db37fc7f 0000000000000001 ffff8800db37fc00
[  763.627477]  ffffffff81236802 0000000000000001 ffff880212d53ec0 ffff8800db37fd40
[  763.715909] Call Trace:
[  763.745041]  [<ffffffff812366e5>] ? __d_alloc+0x25/0x180
[  763.808493]  [<ffffffff81236802>] __d_alloc+0x142/0x180
[  763.870906]  [<ffffffff8123685a>] d_alloc+0x1a/0x90
[  763.929159]  [<ffffffff81228373>] lookup_dcache+0x83/0xb0
[  763.993654]  [<ffffffff812283cd>] __lookup_hash+0x2d/0x60
[  764.058147]  [<ffffffff8122994c>] walk_component+0x22c/0x310
[  764.125760]  [<ffffffff81228b09>] ? path_init+0x219/0x400
[  764.190255]  [<ffffffff8122a73d>] path_lookupat+0x5d/0x110
[  764.255787]  [<ffffffff8122cdd1>] filename_lookup+0xb1/0x180
[  764.323403]  [<ffffffff8103c955>] ? copy_fpstate_to_sigframe+0xb5/0x190
[  764.402462]  [<ffffffff81096605>] ? __set_current_blocked+0x55/0x60
[  764.477353]  [<ffffffff8122c9d6>] ? getname_flags+0x56/0x1f0
[  764.544970]  [<ffffffff8122cf76>] user_path_at_empty+0x36/0x40
[  764.614662]  [<ffffffff81221c96>] vfs_fstatat+0x66/0xc0
[  764.677076]  [<ffffffff812221ee>] SYSC_newstat+0x2e/0x60
[  764.740537]  [<ffffffff81003556>] ? exit_to_usermode_loop+0xa6/0xd0
[  764.815430]  [<ffffffff8122237e>] SyS_newstat+0xe/0x10
[  764.876805]  [<ffffffff81864e8e>] entry_SYSCALL_64_fastpath+0x22/0xc1
[  764.953780] Code: 08 48 39 f2 75 e7 48 83 78 10 00 4c 8b 38 0f 84 6b 01 00 00 4d 85 ff 0f 84 62 01 00 00 49 63 46 20 49 8b 3e 48 8d 8a 00 02 00 00 <49> 8b 1c 07 4c 89 f8 65 48 0f c7 0f 0f 94 c0 84 c0 74 ac 49 63 
[  765.179897] RIP  [<ffffffff811f9ba1>] __kmalloc+0x91/0x270
[  765.245437]  RSP <ffff8800db37fba0>
[  765.287043] CR2: 0000000100000001
[  765.326869] ---[ end trace 05e981119b7b5f10 ]---
[  765.383554] BUG: unable to handle kernel paging request at 0000000100000001
[  765.466783] IP: [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  765.544805] PGD d3c7a067 PUD 0 
[  765.582269] Oops: 0000 [#5] PREEMPT SMP 
[  765.629097] Modules linked in: kvm_amd kvm irqbypass ipmi_devintf ipmi_ssif dcdbas input_leds joydev amd64_edac_mod 8250_fintek k10temp fam15h_power serio_raw edac_mce_amd ipmi_si i2c_piix4 acpi_power_meter edac_core ipmi_msghandler shpchp mac_hid ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel hid_generic aes_x86_64 mptsas lrw mptscsih gf128mul usbhid glue_helper ablk_helper pata_acpi hid cryptd psmouse pata_atiixp mptbase ahci bnx2 libahci scsi_transport_sas
[  766.391906] CPU: 4 PID: 1802 Comm: stress-ng-sysfs Tainted: G      D         4.4.0-138-lowlatency #164-Ubuntu
[  766.510479] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
[  766.599934] task: ffff8800d3f18e40 ti: ffff8800da8d8000 task.ti: ffff8800da8d8000
[  766.689386] RIP: 0010:[<ffffffff811fa246>]  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  766.796528] RSP: 0018:ffff8800da8dbc18  EFLAGS: 00010202
[  766.859980] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000b1af204
[  766.945275] RDX: 000000000b1af004 RSI: 000000000b1af004 RDI: 000000000001a740
[  767.030566] RBP: ffff8800da8dbc58 R08: ffff880215003b00 R09: ffffffff8129e635
[  767.115861] R10: 0000000000000263 R11: 0000000000000000 R12: 00000000024000c0
[  767.201155] R13: 0000000100000001 R14: ffff8800350d1800 R15: ffff880215003b00
[  767.286450] FS:  00007f8e5a1f4700(0000) GS:ffff880215700000(0000) knlGS:0000000000000000
[  767.383182] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  767.451828] CR2: 0000000100000001 CR3: 00000000d3f6e000 CR4: 00000000000406f0
[  767.537116] Stack:
[  767.561050]  ffffffff81a33fe0 ffff8800350d1800 0000000000000030 0000000000000000
[  767.649482]  ffff8800df3841e0 ffff8800d94cf900 ffff8800350d1800 ffff88021254df68
[  767.737915]  ffff8800da8dbc98 ffffffff8129e635 0000000000000000 ffff8800350d1800
[  767.826347] Call Trace:
[  767.855481]  [<ffffffff8129e635>] kernfs_fop_open+0x275/0x370
[  767.924131]  [<ffffffff8121a7d2>] do_dentry_open+0x202/0x310
[  767.991746]  [<ffffffff8129e3c0>] ? kernfs_fop_release+0x60/0x60
[  768.063526]  [<ffffffff8121b964>] vfs_open+0x54/0x80
[  768.122820]  [<ffffffff8122771b>] ? may_open+0x5b/0xf0
[  768.184191]  [<ffffffff8122ac36>] path_openat+0x1b6/0x13a0
[  768.249728]  [<ffffffff81860440>] ? __schedule+0x310/0x830
[  768.315266]  [<ffffffff81860434>] ? __schedule+0x304/0x830
[  768.380799]  [<ffffffff81860440>] ? __schedule+0x310/0x830
[  768.446335]  [<ffffffff81860434>] ? __schedule+0x304/0x830
[  768.511866]  [<ffffffff8122d9f1>] do_filp_open+0x91/0x100
[  768.576362]  [<ffffffff8123b907>] ? __alloc_fd+0xc7/0x190
[  768.640860]  [<ffffffff8121bd38>] do_sys_open+0x138/0x2b0
[  768.705355]  [<ffffffff8121bece>] SyS_open+0x1e/0x20
[  768.764653]  [<ffffffff81864e8e>] entry_SYSCALL_64_fastpath+0x22/0xc1
[  768.841624] Code: 08 48 39 f2 75 e7 48 83 78 10 00 4c 8b 28 0f 84 48 01 00 00 4d 85 ed 0f 84 3f 01 00 00 49 63 47 20 49 8b 3f 48 8d 8a 00 02 00 00 <49> 8b 5c 05 00 4c 89 e8 65 48 0f c7 0f 0f 94 c0 84 c0 74 ab 49 
[  769.067736] RIP  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  769.146796]  RSP <ffff8800da8dbc18>
[  769.188403] CR2: 0000000100000001
[  769.228128] ---[ end trace 05e981119b7b5f11 ]---
[  769.266088] BUG: unable to handle kernel paging request at 0000000100000001
[  769.266094] IP: [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  769.266095] PGD d82d7067 PUD 0 
[  769.266097] Oops: 0000 [#6] PREEMPT SMP 
[  769.266139] Modules linked in: kvm_amd kvm irqbypass ipmi_devintf ipmi_ssif dcdbas input_leds joydev amd64_edac_mod 8250_fintek k10temp fam15h_power serio_raw edac_mce_amd ipmi_si i2c_piix4 acpi_power_meter edac_core ipmi_msghandler shpchp mac_hid ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel hid_generic aes_x86_64 mptsas lrw mptscsih gf128mul usbhid glue_helper ablk_helper pata_acpi hid cryptd psmouse pata_atiixp mptbase ahci bnx2 libahci scsi_transport_sas
[  769.266142] CPU: 4 PID: 1797 Comm: stress-ng-sysfs Tainted: G      D         4.4.0-138-lowlatency #164-Ubuntu
[  769.266143] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
[  769.266144] task: ffff880213253900 ti: ffff8800d94d8000 task.ti: ffff8800d94d8000
[  769.266147] RIP: 0010:[<ffffffff811fa246>]  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  769.266148] RSP: 0018:ffff8800d94dbc18  EFLAGS: 00010202
[  769.266152] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000b1af204
[  769.266153] RDX: 000000000b1af004 RSI: 000000000b1af004 RDI: 000000000001a740
[  769.266154] RBP: ffff8800d94dbc58 R08: ffff880215003b00 R09: ffffffff8129e635
[  769.266157] R10: 000000000637760b R11: 0000000000000000 R12: 00000000024000c0
[  769.266158] R13: 0000000100000001 R14: ffff8800d8b28d00 R15: ffff880215003b00
[  769.266160] FS:  00007f8e5b1f6700(0000) GS:ffff880215700000(0000) knlGS:0000000000000000
[  769.266163] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  769.266164] CR2: 0000000100000001 CR3: 00000000d82ec000 CR4: 00000000000406f0
[  769.266165] Stack:
[  769.266171]  ffffffff81a33fe0 ffff8800d8b28d00 0000000000000030 0000000000000000
[  769.266188]  ffff88020fbd64b0 ffff8800d94cf880 ffff8800d8b28d00 ffff8800d9c444c8
[  769.266197]  ffff8800d94dbc98 ffffffff8129e635 0000000000000000 ffff8800d8b28d00
[  769.266199] Call Trace:
[  769.266207]  [<ffffffff8129e635>] kernfs_fop_open+0x275/0x370
[  769.266214]  [<ffffffff8121a7d2>] do_dentry_open+0x202/0x310
[  769.266219]  [<ffffffff8129e3c0>] ? kernfs_fop_release+0x60/0x60
[  769.266224]  [<ffffffff8121b964>] vfs_open+0x54/0x80
[  769.266230]  [<ffffffff8122771b>] ? may_open+0x5b/0xf0
[  769.266235]  [<ffffffff8122ac36>] path_openat+0x1b6/0x13a0
[  769.266240]  [<ffffffff81860440>] ? __schedule+0x310/0x830
[  769.266246]  [<ffffffff81860434>] ? __schedule+0x304/0x830
[  769.266252]  [<ffffffff81860440>] ? __schedule+0x310/0x830
[  769.266255]  [<ffffffff81860434>] ? __schedule+0x304/0x830
[  769.266261]  [<ffffffff8122d9f1>] do_filp_open+0x91/0x100
[  769.266267]  [<ffffffff8123b907>] ? __alloc_fd+0xc7/0x190
[  769.266273]  [<ffffffff8121bd38>] do_sys_open+0x138/0x2b0
[  769.266280]  [<ffffffff8121bece>] SyS_open+0x1e/0x20
[  769.266285]  [<ffffffff81864e8e>] entry_SYSCALL_64_fastpath+0x22/0xc1
[  769.266401] Code: 08 48 39 f2 75 e7 48 83 78 10 00 4c 8b 28 0f 84 48 01 00 00 4d 85 ed 0f 84 3f 01 00 00 49 63 47 20 49 8b 3f 48 8d 8a 00 02 00 00 <49> 8b 5c 05 00 4c 89 e8 65 48 0f c7 0f 0f 94 c0 84 c0 74 ab 49 
[  769.266405] RIP  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  769.266406]  RSP <ffff8800d94dbc18>
[  769.266407] CR2: 0000000100000001
[  769.266677] ---[ end trace 05e981119b7b5f12 ]---
[  769.283380] BUG: unable to handle kernel paging request at 0000000100000001
[  769.283392] IP: [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  769.283403] PGD db319067 PUD 0 
[  769.283415] Oops: 0000 [#7] PREEMPT SMP 
[  769.283543] Modules linked in: kvm_amd kvm irqbypass ipmi_devintf ipmi_ssif dcdbas input_leds joydev amd64_edac_mod 8250_fintek k10temp fam15h_power serio_raw edac_mce_amd ipmi_si i2c_piix4 acpi_power_meter edac_core ipmi_msghandler shpchp mac_hid ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel hid_generic aes_x86_64 mptsas lrw mptscsih gf128mul usbhid glue_helper ablk_helper pata_acpi hid cryptd psmouse pata_atiixp mptbase ahci bnx2 libahci scsi_transport_sas
[  769.283545] CPU: 4 PID: 1794 Comm: stress-ng-sysfs Tainted: G      D         4.4.0-138-lowlatency #164-Ubuntu
[  769.283545] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
[  769.283546] task: ffff880213203900 ti: ffff8800d945c000 task.ti: ffff8800d945c000
[  769.283550] RIP: 0010:[<ffffffff811fa246>]  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  769.283551] RSP: 0018:ffff8800d945fc18  EFLAGS: 00010202
[  769.283551] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000b1af204
[  769.283552] RDX: 000000000b1af004 RSI: 000000000b1af004 RDI: 000000000001a740
[  769.283553] RBP: ffff8800d945fc58 R08: ffff880215003b00 R09: ffffffff8129e635
[  769.283554] R10: 0000000000000347 R11: 0000000000000000 R12: 00000000024000c0
[  769.283555] R13: 0000000100000001 R14: ffff8800d8b28e00 R15: ffff880215003b00
[  769.283556] FS:  00007f8e5a9f5700(0000) GS:ffff880215700000(0000) knlGS:0000000000000000
[  769.283557] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  769.283558] CR2: 0000000100000001 CR3: 00000000db332000 CR4: 00000000000406f0
[  769.283559] Stack:
[  769.283561]  0000000000000001 ffff8800d945fc18 0000000000000030 0000000000000000
[  769.283562]  ffff88020f548078 ffff8800d94cf700 ffff8800d8b28e00 ffff8800d9c2c058
[  769.283564]  ffff8800d945fc98 ffffffff8129e635 0000000000000000 ffff8800d8b28e00
[  769.283564] Call Trace:
[  769.283567]  [<ffffffff8129e635>] kernfs_fop_open+0x275/0x370
[  769.283570]  [<ffffffff8121a7d2>] do_dentry_open+0x202/0x310
[  769.283572]  [<ffffffff8129e3c0>] ? kernfs_fop_release+0x60/0x60
[  769.283574]  [<ffffffff8121b964>] vfs_open+0x54/0x80
[  769.283575]  [<ffffffff8122771b>] ? may_open+0x5b/0xf0
[  769.283577]  [<ffffffff8122ac36>] path_openat+0x1b6/0x13a0
[  769.283579]  [<ffffffff81860440>] ? __schedule+0x310/0x830
[  769.283581]  [<ffffffff81860434>] ? __schedule+0x304/0x830
[  769.283583]  [<ffffffff81860440>] ? __schedule+0x310/0x830
[  769.283585]  [<ffffffff81860434>] ? __schedule+0x304/0x830
[  769.283586]  [<ffffffff8122d9f1>] do_filp_open+0x91/0x100
[  769.283588]  [<ffffffff8123b907>] ? __alloc_fd+0xc7/0x190
[  769.283591]  [<ffffffff8121bd38>] do_sys_open+0x138/0x2b0
[  769.283593]  [<ffffffff8121bece>] SyS_open+0x1e/0x20
[  769.283595]  [<ffffffff81864e8e>] entry_SYSCALL_64_fastpath+0x22/0xc1
[  769.283613] Code: 08 48 39 f2 75 e7 48 83 78 10 00 4c 8b 28 0f 84 48 01 00 00 4d 85 ed 0f 84 3f 01 00 00 49 63 47 20 49 8b 3f 48 8d 8a 00 02 00 00 <49> 8b 5c 05 00 4c 89 e8 65 48 0f c7 0f 0f 94 c0 84 c0 74 ab 49 
[  769.283615] RIP  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  769.283615]  RSP <ffff8800d945fc18>
[  769.283616] CR2: 0000000100000001
[  769.283618] ---[ end trace 05e981119b7b5f13 ]---
[  769.367379] BUG: unable to handle kernel paging request at 0000000100000001
[  769.367384] IP: [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  769.367389] PGD d3e68067 PUD 0 
[  769.367395] Oops: 0000 [#8] PREEMPT SMP 
[  769.367506] Modules linked in: kvm_amd kvm irqbypass ipmi_devintf ipmi_ssif dcdbas input_leds joydev amd64_edac_mod 8250_fintek k10temp fam15h_power serio_raw edac_mce_amd ipmi_si i2c_piix4 acpi_power_meter edac_core ipmi_msghandler shpchp mac_hid ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel hid_generic aes_x86_64 mptsas lrw mptscsih gf128mul usbhid glue_helper ablk_helper pata_acpi hid cryptd psmouse pata_atiixp mptbase ahci bnx2 libahci scsi_transport_sas
[  769.367514] CPU: 4 PID: 1788 Comm: stress-ng-sysfs Tainted: G      D         4.4.0-138-lowlatency #164-Ubuntu
[  769.367517] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
[  769.367519] task: ffff88020f4e63c0 ti: ffff8800da810000 task.ti: ffff8800da810000
[  769.367527] RIP: 0010:[<ffffffff811fa246>]  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  769.367530] RSP: 0018:ffff8800da813c18  EFLAGS: 00010202
[  769.367533] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000b1af204
[  769.367537] RDX: 000000000b1af004 RSI: 000000000b1af004 RDI: 000000000001a740
[  769.367538] RBP: ffff8800da813c58 R08: ffff880215003b00 R09: ffffffff8129e635
[  769.367541] R10: 000000000637760b R11: 0000000000000000 R12: 00000000024000c0
[  769.367544] R13: 0000000100000001 R14: ffff88020723f500 R15: ffff880215003b00
[  769.367549] FS:  00007f8e5b9f7700(0000) GS:ffff880215700000(0000) knlGS:0000000000000000
[  769.367552] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  769.367554] CR2: 0000000100000001 CR3: 00000000db29e000 CR4: 00000000000406f0
[  769.367557] Stack:
[  769.367562]  ffffffff81a33fe0 ffff88020723f500 0000000000000030 0000000000000000
[  769.367568]  ffff880213820438 ffff8800d94cf800 ffff88020723f500 ffff880212412380
[  769.367573]  ffff8800da813c98 ffffffff8129e635 0000000000000000 ffff88020723f500
[  769.367576] Call Trace:
[  769.367581]  [<ffffffff8129e635>] kernfs_fop_open+0x275/0x370
[  769.367587]  [<ffffffff8121a7d2>] do_dentry_open+0x202/0x310
[  769.367592]  [<ffffffff8129e3c0>] ? kernfs_fop_release+0x60/0x60
[  769.367597]  [<ffffffff8121b964>] vfs_open+0x54/0x80
[  769.367600]  [<ffffffff8122771b>] ? may_open+0x5b/0xf0
[  769.367605]  [<ffffffff8122ac36>] path_openat+0x1b6/0x13a0
[  769.367611]  [<ffffffff8122d9f1>] do_filp_open+0x91/0x100
[  769.367616]  [<ffffffff8123e26e>] ? mntput_no_expire+0x2e/0x1b0
[  769.367622]  [<ffffffff8123b907>] ? __alloc_fd+0xc7/0x190
[  769.367627]  [<ffffffff8121bd38>] do_sys_open+0x138/0x2b0
[  769.367633]  [<ffffffff8121bece>] SyS_open+0x1e/0x20
[  769.367638]  [<ffffffff81864e8e>] entry_SYSCALL_64_fastpath+0x22/0xc1
[  769.367706] Code: 08 48 39 f2 75 e7 48 83 78 10 00 4c 8b 28 0f 84 48 01 00 00 4d 85 ed 0f 84 3f 01 00 00 49 63 47 20 49 8b 3f 48 8d 8a 00 02 00 00 <49> 8b 5c 05 00 4c 89 e8 65 48 0f c7 0f 0f 94 c0 84 c0 74 ab 49 
[  769.367711] RIP  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  769.367713]  RSP <ffff8800da813c18>
[  769.367714] CR2: 0000000100000001
[  769.367717] ---[ end trace 05e981119b7b5f14 ]---
[  769.371909] BUG: unable to handle kernel paging request at 0000000100000001
[  769.371915] IP: [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  769.371920] PGD d3c7a067 PUD 0 
[  769.371926] Oops: 0000 [#9] PREEMPT SMP 
[  769.372007] Modules linked in: kvm_amd kvm irqbypass ipmi_devintf ipmi_ssif dcdbas input_leds joydev amd64_edac_mod 8250_fintek k10temp fam15h_power serio_raw edac_mce_amd ipmi_si i2c_piix4 acpi_power_meter edac_core ipmi_msghandler shpchp mac_hid ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel hid_generic aes_x86_64 mptsas lrw mptscsih gf128mul usbhid glue_helper ablk_helper pata_acpi hid cryptd psmouse pata_atiixp mptbase ahci bnx2 libahci scsi_transport_sas
[  769.372012] CPU: 4 PID: 1800 Comm: stress-ng-sysfs Tainted: G      D         4.4.0-138-lowlatency #164-Ubuntu
[  769.372015] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
[  769.372018] task: ffff88020f658e40 ti: ffff8800daba8000 task.ti: ffff8800daba8000
[  769.372024] RIP: 0010:[<ffffffff811fa246>]  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  769.372026] RSP: 0018:ffff8800dababc18  EFLAGS: 00010202
[  769.372029] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000b1af204
[  769.372032] RDX: 000000000b1af004 RSI: 000000000b1af004 RDI: 000000000001a740
[  769.372034] RBP: ffff8800dababc58 R08: ffff880215003b00 R09: ffffffff8129e635
[  769.372037] R10: 000000000637760b R11: 0000000000000000 R12: 00000000024000c0
[  769.372040] R13: 0000000100000001 R14: ffff8800d8b29900 R15: ffff880215003b00
[  769.372045] FS:  00007f8e5b1f6700(0000) GS:ffff880215700000(0000) knlGS:0000000000000000
[  769.372047] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  769.372050] CR2: 0000000100000001 CR3: 00000000d3f6e000 CR4: 00000000000406f0
[  769.372052] Stack:
[  769.372058]  ffffffff81a33fe0 ffff8800d8b29900 0000000000000030 0000000000000000
[  769.372064]  ffff8800df3d5078 ffff8800d94cf780 ffff8800d8b29900 ffff88021257cda8
[  769.372069]  ffff8800dababc98 ffffffff8129e635 0000000000000000 ffff8800d8b29900
[  769.372071] Call Trace:
[  769.372077]  [<ffffffff8129e635>] kernfs_fop_open+0x275/0x370
[  769.372083]  [<ffffffff8121a7d2>] do_dentry_open+0x202/0x310
[  769.372088]  [<ffffffff8129e3c0>] ? kernfs_fop_release+0x60/0x60
[  769.372094]  [<ffffffff8121b964>] vfs_open+0x54/0x80
[  769.372098]  [<ffffffff8122771b>] ? may_open+0x5b/0xf0
[  769.372102]  [<ffffffff8122ac36>] path_openat+0x1b6/0x13a0
[  769.372107]  [<ffffffff8122d9f1>] do_filp_open+0x91/0x100
[  769.372112]  [<ffffffff8123b907>] ? __alloc_fd+0xc7/0x190
[  769.372118]  [<ffffffff8121bd38>] do_sys_open+0x138/0x2b0
[  769.372123]  [<ffffffff8121bece>] SyS_open+0x1e/0x20
[  769.372131]  [<ffffffff81864e8e>] entry_SYSCALL_64_fastpath+0x22/0xc1
[  769.372202] Code: 08 48 39 f2 75 e7 48 83 78 10 00 4c 8b 28 0f 84 48 01 00 00 4d 85 ed 0f 84 3f 01 00 00 49 63 47 20 49 8b 3f 48 8d 8a 00 02 00 00 <49> 8b 5c 05 00 4c 89 e8 65 48 0f c7 0f 0f 94 c0 84 c0 74 ab 49 
[  769.372207] RIP  [<ffffffff811fa246>] kmem_cache_alloc_trace+0x76/0x210
[  769.372209]  RSP <ffff8800dababc18>
[  769.372210] CR2: 0000000100000001

Revision history for this message

Colin Ian King (colin-king) wrote on 2018-10-05:

Exercising /sys/kernel/security/tpm0/ascii_bios_measurements causes:

[ 381.545913] iounmap: bad address ffffc9000e620000
[ 381.602107] CPU: 2 PID: 1833 Comm: stress-ng-sysfs Not tainted 4.4.0-138-lowlatency #164-Ubuntu
[ 381.602109] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
[ 381.602111] 0000000000000286 fc02aae09141f60c ffff8800daa03bc0 ffffffff8140dc61
[ 381.602117] ffff88021145cbc0 ffffc9000e620000 ffff8800daa03be0 ffffffff8106ec1f
[ 381.602124] ffff88021145cbc0 ffffc9000e620000 ffff8800daa03bf0 ffffffff8106ec5c
[ 381.602127] Call Trace:
[ 381.602134] [<ffffffff8140dc61>] dump_stack+0x63/0x82
[ 381.602138] [<ffffffff8106ec1f>] iounmap.part.1+0x7f/0x90
[ 381.602140] [<ffffffff8106ec5c>] iounmap+0x2c/0x30
[ 381.602144] [<ffffffff814a1bb1>] acpi_os_map_cleanup.part.9+0x31/0x40
[ 381.602147] [<ffffffff8185b71e>] acpi_os_unmap_iomem+0xbe/0xf0
[ 381.602151] [<ffffffff8155614d>] read_log+0xad/0x170
[ 381.602153] [<ffffffff81555f07>] tpm_ascii_bios_measurements_open+0x37/0x90
[ 381.602158] [<ffffffff8121a7d2>] do_dentry_open+0x202/0x310
[ 381.602160] [<ffffffff81555ed0>] ? tpm_binary_bios_measurements_open+0x90/0x90
[ 381.602164] [<ffffffff8121b964>] vfs_open+0x54/0x80
[ 381.602166] [<ffffffff8122771b>] ? may_open+0x5b/0xf0
[ 381.602169] [<ffffffff8122ac36>] path_openat+0x1b6/0x13a0
[ 381.602172] [<ffffffff8119fb91>] ? free_one_page+0x191/0x340
[ 381.602175] [<ffffffff8122d9f1>] do_filp_open+0x91/0x100
[ 381.602179] [<ffffffff813a7050>] ? common_file_perm+0x70/0x1b0
[ 381.602181] [<ffffffff8123b907>] ? __alloc_fd+0xc7/0x190
[ 381.602185] [<ffffffff8121bd38>] do_sys_open+0x138/0x2b0
[ 381.602187] [<ffffffff8121bece>] SyS_open+0x1e/0x20
[ 381.602191] [<ffffffff81864e8e>] entry_SYSCALL_64_fastpath+0x22/0xc1

Revision history for this message

Colin Ian King (colin-king) wrote on 2018-10-05:

It appears to hang when more than one thread is concurrently opening /sys/kernel/security/tpm0/ascii_bios_measurements

Revision history for this message

Colin Ian King (colin-king) wrote on 2018-10-05:

..after this hangs, I see:

[ 261.473664] Oops: 0000 [#1] PREEMPT SMP
[ 261.520488] Modules linked in: ipmi_ssif ipmi_devintf kvm_amd kvm dcdbas irqbypass input_leds serio_raw joydev amd64_edac_mod edac_mce_amd fam15h_power edac_core k10temp ipmi_si shpchp i2c_piix4 ipmi_msghandler 8250_fintek mac_hid acpi_power_meter ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul hid_generic ghash_clmulni_intel aesni_intel mptsas aes_x86_64 pata_acpi lrw mptscsih gf128mul usbhid ahci glue_helper ablk_helper hid cryptd psmouse pata_atiixp mptbase libahci bnx2 scsi_transport_sas
[ 262.283269] CPU: 3 PID: 1846 Comm: stress-ng Not tainted 4.4.0-138-lowlatency #164-Ubuntu
[ 262.381038] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
[ 262.470483] task: ffff8800d8323900 ti: ffff8800ded34000 task.ti: ffff8800ded34000
[ 262.559926] RIP: 0010:[<ffffffff811fa502>] [<ffffffff811fa502>] kmem_cache_alloc+0x72/0x200
[ 262.660817] RSP: 0018:ffff8800ded37d18 EFLAGS: 00010206
[ 262.724260] RAX: 0000000000000000 RBX: ffff88020f630e10 RCX: 0000000022a95403
[ 262.809545] RDX: 0000000022a95203 RSI: 0000000022a95203 RDI: 000000000001a740
[ 262.894829] RBP: ffff8800ded37d48 R08: ffffffff811d8ebc R09: 0000000000000001
[ 262.980114] R10: ffff88021eff9000 R11: 0000000000000000 R12: 0000000002000200
[ 263.065397] R13: 00007ffcfd834000 R14: ffff880215003b00 R15: ffff880215003b00
[ 263.150683] FS: 00007f0599fc9700(0000) GS:ffff8802156c0000(0000) knlGS:0000000000000000
[ 263.247404] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 263.316050] CR2: 00007ffcfd834000 CR3: 00000000d83a6000 CR4: 00000000000406f0
[ 263.401334] Stack:
[ 263.425258] 00007f059881dfff ffff88020f630e10 0000000000000000 ffff8800d3d84f40
[ 263.513690] 0000000000000001 ffff8800dae95a40 ffff8800ded37da0 ffffffff811d8ebc
[ 263.602120] 0000000000000000 ffff88020ef23518 ffff88020f630e88 ffff88020ef23590
[ 263.690550] Call Trace:
[ 263.719678] [<ffffffff811d8ebc>] anon_vma_clone+0x6c/0x200
[ 263.786248] [<ffffffff811d9082>] anon_vma_fork+0x32/0x140
[ 263.851779] [<ffffffff81084554>] copy_process+0x1474/0x1c70
[ 263.919385] [<ffffffff81084ee0>] _do_fork+0x80/0x390
[ 263.979714] [<ffffffff81085299>] SyS_clone+0x19/0x20
[ 264.040041] [<ffffffff81864e8e>] entry_SYSCALL_64_fastpath+0x22/0xc1
[ 264.117009] Code: 08 48 39 f2 75 e7 48 83 78 10 00 4c 8b 28 0f 84 40 01 00 00 4d 85 ed 0f 84 37 01 00 00 49 63 46 20 49 8b 3e 48 8d 8a 00 02 00 00 <49> 8b 5c 05 00 4c 89 e8 65 48 0f c7 0f 0f 94 c0 84 c0 74 ab 49
[ 264.343111] RIP [<ffffffff811fa502>] kmem_cache_alloc+0x72/0x200
[ 264.415924] RSP <ffff8800ded37d18>
[ 264.457529] CR2: 00007ffcfd834000
[ 264.497083] ---[ end trace 9af64fddce7496da ]---

and further opens seem to hang up.

..after this hangs, I see:

[  261.473664] Oops: 0000 [#1] PREEMPT SMP 
[  261.520488] Modules linked in: ipmi_ssif ipmi_devintf kvm_amd kvm dcdbas irqbypass input_leds serio_raw joydev amd64_edac_mod edac_mce_amd fam15h_power edac_core k10temp ipmi_si shpchp i2c_piix4 ipmi_msghandler 8250_fintek mac_hid acpi_power_meter ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi autofs4 btrfs raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul hid_generic ghash_clmulni_intel aesni_intel mptsas aes_x86_64 pata_acpi lrw mptscsih gf128mul usbhid ahci glue_helper ablk_helper hid cryptd psmouse pata_atiixp mptbase libahci bnx2 scsi_transport_sas
[  262.283269] CPU: 3 PID: 1846 Comm: stress-ng Not tainted 4.4.0-138-lowlatency #164-Ubuntu
[  262.381038] Hardware name: Dell Inc. PowerEdge R415/08WNM9, BIOS 1.9.3 04/26/2012
[  262.470483] task: ffff8800d8323900 ti: ffff8800ded34000 task.ti: ffff8800ded34000
[  262.559926] RIP: 0010:[<ffffffff811fa502>]  [<ffffffff811fa502>] kmem_cache_alloc+0x72/0x200
[  262.660817] RSP: 0018:ffff8800ded37d18  EFLAGS: 00010206
[  262.724260] RAX: 0000000000000000 RBX: ffff88020f630e10 RCX: 0000000022a95403
[  262.809545] RDX: 0000000022a95203 RSI: 0000000022a95203 RDI: 000000000001a740
[  262.894829] RBP: ffff8800ded37d48 R08: ffffffff811d8ebc R09: 0000000000000001
[  262.980114] R10: ffff88021eff9000 R11: 0000000000000000 R12: 0000000002000200
[  263.065397] R13: 00007ffcfd834000 R14: ffff880215003b00 R15: ffff880215003b00
[  263.150683] FS:  00007f0599fc9700(0000) GS:ffff8802156c0000(0000) knlGS:0000000000000000
[  263.247404] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[  263.316050] CR2: 00007ffcfd834000 CR3: 00000000d83a6000 CR4: 00000000000406f0
[  263.401334] Stack:
[  263.425258]  00007f059881dfff ffff88020f630e10 0000000000000000 ffff8800d3d84f40
[  263.513690]  0000000000000001 ffff8800dae95a40 ffff8800ded37da0 ffffffff811d8ebc
[  263.602120]  0000000000000000 ffff88020ef23518 ffff88020f630e88 ffff88020ef23590
[  263.690550] Call Trace:
[  263.719678]  [<ffffffff811d8ebc>] anon_vma_clone+0x6c/0x200
[  263.786248]  [<ffffffff811d9082>] anon_vma_fork+0x32/0x140
[  263.851779]  [<ffffffff81084554>] copy_process+0x1474/0x1c70
[  263.919385]  [<ffffffff81084ee0>] _do_fork+0x80/0x390
[  263.979714]  [<ffffffff81085299>] SyS_clone+0x19/0x20
[  264.040041]  [<ffffffff81864e8e>] entry_SYSCALL_64_fastpath+0x22/0xc1
[  264.117009] Code: 08 48 39 f2 75 e7 48 83 78 10 00 4c 8b 28 0f 84 40 01 00 00 4d 85 ed 0f 84 37 01 00 00 49 63 46 20 49 8b 3e 48 8d 8a 00 02 00 00 <49> 8b 5c 05 00 4c 89 e8 65 48 0f c7 0f 0f 94 c0 84 c0 74 ab 49 
[  264.343111] RIP  [<ffffffff811fa502>] kmem_cache_alloc+0x72/0x200
[  264.415924]  RSP <ffff8800ded37d18>
[  264.457529] CR2: 00007ffcfd834000
[  264.497083] ---[ end trace 9af64fddce7496da ]---

and further opens seem to hang up.

Revision history for this message

Colin Ian King (colin-king) wrote on 2018-10-05:

..and after that last oops we get:

ubuntu@gonzo:~$ dmesg
Killed
ubuntu@gonzo:~$ top
Killed
ubuntu@gonzo:~$ ps
Killed

Revision history for this message

Colin Ian King (colin-king) wrote on 2018-10-05:

#10

And is reproduced in previous kernel 4.4.0-137-lowlatency too, so not a regression on -138

Revision history for this message

Colin Ian King (colin-king) wrote on 2018-10-05:

#11

And reproducible way back to 4.4.0-21-lowlatency too

Colin Ian King (colin-king) on 2018-10-05

Changed in linux (Ubuntu):
assignee:	nobody → Colin Ian King (colin-king)
importance:	Undecided → Medium
status:	Incomplete → In Progress
summary:	- timer test in ubuntu_stress_smoke_test will cause kernel oops on + sysfs test ubuntu_stress_smoke_test will cause kernel oops on X-lowlatency

Revision history for this message

Colin Ian King (colin-king) wrote on 2018-10-08:

#12

Course bisect, fixed between 4.8 and 4.9

Revision history for this message

Colin Ian King (colin-king) wrote on 2018-10-08:

#13

repeated course bisect, now got something more reasonable:

4.8 fail
4.9 fail
4.10 - ok
4.11 - ok
4.12 - ok
4.14 - ok
4.18 - ok

Revision history for this message

Colin Ian King (colin-king) wrote on 2018-10-09:

#14

Bisected, fixed with upstream commit:

From 748935eeb72c34368ab514a2bfdf75161768cec0 Mon Sep 17 00:00:00 2001
From: Nayna Jain <email address hidden>
Date: Mon, 14 Nov 2016 05:00:52 -0500
Subject: [PATCH] tpm: have event log use the tpm_chip

Revision history for this message

Colin Ian King (colin-king) wrote on 2018-10-09:

#15

The number of prerequisite fixes before we can apply the fix 748935eeb72c343 makes this a rather overly involved fix. I doubt it will be SRU'able. Since this *only* occurs when accessing two TPM related interfaces in a fast multiple multi-threaded race on a few specific x86 devices as root makes this a very risky set of backport changes for such a corner case.

For now, I'm going to force stress-ng sysfs test to skip the tpm files for older kernels to workaround this issue. (Ugh).

Workaround committed in stress-ng:

http://kernel.ubuntu.com/git/cking/stress-ng.git/commit/?id=c7fcb4112b97188c8fcba6138b29b5c5a82938ea

Changed in linux (Ubuntu):
status:	In Progress → Fix Committed

Revision history for this message

Po-Hsu Lin (cypressyew) wrote on 2018-10-11:

#16

Verified on the same node with the same kernel.
The stress smoke test can pass without any issue.
Thanks!

Changed in ubuntu-kernel-tests:
status:	New → Fix Released

Po-Hsu Lin (cypressyew) on 2018-10-11

Changed in ubuntu-kernel-tests:
assignee:	nobody → Colin Ian King (colin-king)

Colin Ian King (colin-king) on 2018-10-11

Changed in linux (Ubuntu):
status:	Fix Committed → Won't Fix

Report a bug

This report contains Public information

Everyone can see this information.

You are

Subscribing...

Edit bug mail

Other bug subscribers

Bug attachments

Add attachment

Remote bug watches

Bug watches keep track of this bug in other bug trackers.

Ubuntulinux package

sysfs test ubuntu_stress_smoke_test will cause kernel oops on X-lowlatency

Bug Description

Other bug subscribers

Bug attachments

Remote bug watches

Ubuntu
linux package