kernel-level crash when debugging from inside Docker

[Alexandre Bourget]

I get this crash:

Nov 7 11:12:10 cerise kernel: [455791.145575] show_signal_msg: 3594 callbacks suppressed
Nov 7 11:12:10 cerise kernel: [455791.145581] asterisk[6942]: segfault at 14 ip 000000000058f426 sp 00007fad2e0ecb40 error 4 in asterisk[400000+28f000]
Nov 7 11:12:10 cerise kernel: [455791.145925] ------------[ cut here ]------------
Nov 7 11:12:10 cerise kernel: [455791.145948] kernel BUG at /build/buildd/linux-3.13.0/kernel/cred.c:423!
Nov 7 11:12:10 cerise kernel: [455791.145982] invalid opcode: 0000 [#1] SMP
Nov 7 11:12:10 cerise kernel: [455791.146007] Modules linked in: cdc_acm nfnetlink_queue nfnetlink_log nfnetlink btrfs raid6_pq xor ufs qnx4 hfsplus hfs minix ntfs msdos jfs xfs libcrc32c hidp hid veth xt_nat xt_tcpudp xt_addrtype xt_conntrack ipt_MASQUERADE iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack bridge stp llc aufs iptable_filter ip_tables x_tables ctr ccm pci_stub vboxpci(OF) vboxnetadp(OF) vboxnetflt(OF) vboxdrv(OF) bnep rfcomm binfmt_misc nfsd auth_rpcgss nfs_acl nfs lockd sunrpc fscache btusb bluetooth arc4 iwldvm uvcvideo videobuf2_vmalloc mac80211 videobuf2_memops videobuf2_core videodev snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_intel snd_hda_codec snd_hwdep snd_pcm intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel thinkpad_acpi kvm nvram snd_seq_midi snd_seq_midi_event snd_rawmidi iwlwifi joydev serio_raw snd_seq lpc_ich cfg80211 snd_seq_device snd_page_alloc snd_timer mei_me mei snd soundcore parport_pc mac_hid ppdev lp parport dm_crypt crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 lrw gf128mul glue_helper ablk_helper cryptd psmouse ahci sdhci_pci libahci sdhci e1000e ptp i915 pps_core wmi i2c_algo_bit drm_kms_helper video drm
Nov 7 11:12:10 cerise kernel: [455791.146556] CPU: 3 PID: 6942 Comm: asterisk Tainted: GF W O 3.13.0-32-generic #57-Ubuntu
Nov 7 11:12:10 cerise kernel: [455791.146590] Hardware name: LENOVO 2352CTO/2352CTO, BIOS G7ET31WW (1.13 ) 07/02/2012
Nov 7 11:12:10 cerise kernel: [455791.146619] task: ffff880003422fe0 ti: ffff880079574000 task.ti: ffff880079574000
Nov 7 11:12:10 cerise kernel: [455791.146648] RIP: 0010:[<ffffffff81090b3f>] [<ffffffff81090b3f>] commit_creds+0x20f/0x240
Nov 7 11:12:10 cerise kernel: [455791.146686] RSP: 0000:ffff880079575a08 EFLAGS: 00010287
Nov 7 11:12:10 cerise kernel: [455791.146706] RAX: 0000000000000001 RBX: ffff88021e53b240 RCX: 0000000000000001
Nov 7 11:12:10 cerise kernel: [455791.146733] RDX: 0000000000000017 RSI: ffff88021e792200 RDI: ffff88021e53b240
Nov 7 11:12:10 cerise kernel: [455791.146761] RBP: ffff880079575a20 R08: 00000000000171c0 R09: ffff880331803c00
Nov 7 11:12:10 cerise kernel: [455791.146787] R10: ffffffff81308497 R11: ffff880079575aee R12: ffff88004e161540
Nov 7 11:12:10 cerise kernel: [455791.146814] R13: ffff880003422fe0 R14: ffff880079575c24 R15: 00000000ffffff9c
Nov 7 11:12:10 cerise kernel: [455791.146842] FS: 00007fad2e0ed700(0000) GS:ffff88033e2c0000(0000) knlGS:0000000000000000
Nov 7 11:12:10 cerise kernel: [455791.146872] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Nov 7 11:12:10 cerise kernel: [455791.146894] CR2: 0000000000000014 CR3: 000000009db46000 CR4: 00000000001407e0
Nov 7 11:12:10 cerise kernel: [455791.146921] Stack:
Nov 7 11:12:10 cerise kernel: [455791.146929] ffff8800597f0030 ffff88021e792f00 ffff88021e53b240 ffff880079575a48
Nov 7 11:12:10 cerise kernel: [455791.146960] ffffffff813087be ffff8800597f0030 ffff88000d5dd200 ffff880079575c48
Nov 7 11:12:10 cerise kernel: [455791.146990] ffff880079575a70 ffffffff81311c4a 0000000000000000 ffff88000d5dd200
Nov 7 11:12:10 cerise kernel: [455791.147021] Call Trace:
Nov 7 11:12:10 cerise kernel: [455791.147035] [<ffffffff813087be>] aa_replace_current_label+0xee/0x170
Nov 7 11:12:10 cerise kernel: [455791.147062] [<ffffffff81311c4a>] apparmor_file_alloc_security+0xca/0x180
Nov 7 11:12:10 cerise kernel: [455791.147090] [<ffffffff812d41a6>] security_file_alloc+0x16/0x20
Nov 7 11:12:10 cerise kernel: [455791.147116] [<ffffffff811be960>] get_empty_filp+0x90/0x180
Nov 7 11:12:10 cerise kernel: [455791.147140] [<ffffffff8109df94>] ? arch_vtime_task_switch+0x94/0xa0
Nov 7 11:12:10 cerise kernel: [455791.147167] [<ffffffff811cc30d>] path_openat+0x3d/0x640
Nov 7 11:12:10 cerise kernel: [455791.147189] [<ffffffff8136a8a3>] ? number.isra.1+0x323/0x360
Nov 7 11:12:10 cerise kernel: [455791.147215] [<ffffffff8171fc61>] ? __schedule+0x381/0x7d0
Nov 7 11:12:10 cerise kernel: [455791.147238] [<ffffffff811cd76a>] do_filp_open+0x3a/0x90
Nov 7 11:12:10 cerise kernel: [455791.147259] [<ffffffff8136c815>] ? vsnprintf+0x415/0x610
Nov 7 11:12:10 cerise kernel: [455791.147283] [<ffffffff812192ac>] ? cn_vprintf+0x6c/0xa0
Nov 7 11:12:10 cerise kernel: [455791.147305] [<ffffffff811bbcc8>] file_open_name+0xe8/0x140
Nov 7 11:12:10 cerise kernel: [455791.147327] [<ffffffff811bbd55>] filp_open+0x35/0x40
Nov 7 11:12:10 cerise kernel: [455791.147348] [<ffffffff81219a6e>] do_coredump+0x4fe/0xe90
Nov 7 11:12:10 cerise kernel: [455791.147371] [<ffffffff81078e1c>] ? force_sig_info+0xcc/0xe0
Nov 7 11:12:10 cerise kernel: [455791.147395] [<ffffffff8107a067>] get_signal_to_deliver+0x1c7/0x6f0
Nov 7 11:12:10 cerise kernel: [455791.147422] [<ffffffff81013448>] do_signal+0x48/0x960
Nov 7 11:12:10 cerise kernel: [455791.147445] [<ffffffff8111155c>] ? acct_account_cputime+0x1c/0x20
Nov 7 11:12:10 cerise kernel: [455791.147469] [<ffffffff8109d7db>] ? account_user_time+0x8b/0xa0
Nov 7 11:12:10 cerise kernel: [455791.147493] [<ffffffff8109ddf4>] ? vtime_account_user+0x54/0x60
Nov 7 11:12:10 cerise kernel: [455791.147517] [<ffffffff81013dc9>] do_notify_resume+0x69/0xb0
Nov 7 11:12:10 cerise kernel: [455791.147541] [<ffffffff8172423c>] retint_signal+0x48/0x8c
Nov 7 11:12:10 cerise kernel: [455791.147562] Code: f8 c3 81 0f 84 5e fe ff ff 48 89 d1 48 8b 91 c8 00 00 00 48 39 d6 75 e4 3b 81 d4 00 00 00 0f 84 65 fe ff ff 48 89 f2 eb d3 0f 0b <0f> 0b 49 8b 4c 24 30 48 89 d6 48 c1 ee 20 48 89 c8 f7 d1 48 c1
Nov 7 11:12:10 cerise kernel: [455791.147699] RIP [<ffffffff81090b3f>] commit_creds+0x20f/0x240
Nov 7 11:12:10 cerise kernel: [455791.147742] RSP <ffff880079575a08>
Nov 7 11:12:10 cerise kernel: [455791.154718] ---[ end trace f135ba1d997aba87 ]---

while trying to debug Asterisk from within a Docker container.

The image I'm using is built with this revision:

    https://github.com/abourget/asterisk-docker/tree/aefa342d7d50bafd61d07e71b50db1a580ba70f8

enabling heavier debug.

I then run:

    sudo docker run --cap-add=SYS_PTRACE -ti --rm --name="asterisk13" --net=host -v `pwd`/etc_asterisk:/etc/asterisk -v `pwd`/voicemail:/var/spool/asterisk/voicemail -v `pwd`/spool:/var/spool/asterisk -v `pwd`/run:/var/run/asterisk asterisk13

with some shared directories and some dialplans.

Before getting that stacktrace, I had run:

    aa-complain /etc/apparmor.d/docker

because I was trying to gdb and from inside Docker I couldn't because of some "ptrace" permissions.

After I aa-complain'd it.. I got that stacktrace.

My host OS is Ubuntu 14.04, running Docker 1.3.1

[Brad Figg (brad-figg)]

This bug is missing log files that will aid in diagnosing the problem. From a terminal window please run:

apport-collect 1390546

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable to run this command, please add a comment stating that fact and change the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the Ubuntu Kernel Team.