| 2012-06-11 19:21:12 |
Matt Wilson |
bug |
|
|
added bug |
| 2012-06-11 20:00:16 |
JC Lima |
bug |
|
|
added subscriber JC Lima |
| 2012-06-11 22:43:24 |
Steven Noonan |
bug |
|
|
added subscriber Steven Noonan |
| 2012-06-12 00:19:56 |
Cristian Gafton |
bug |
|
|
added subscriber Cristian Gafton |
| 2012-06-12 21:54:38 |
Simon Kuhn |
bug |
|
|
added subscriber Simon Kuhn |
| 2012-06-20 14:16:43 |
Todd |
bug |
|
|
added subscriber Todd |
| 2012-08-13 22:40:08 |
Matt Wilson |
bug task added |
|
linux (Ubuntu) |
|
| 2012-08-13 22:42:17 |
Matt Wilson |
tags |
|
oneiric |
|
| 2012-08-13 22:46:25 |
Matt Wilson |
summary |
Scheduler deadlock running 3.0.0-20-virtual on c1.xlarge EC2 instance |
Scheduler deadlock running 3.0.0 on multiple EC2 instance types |
|
| 2012-08-13 23:00:17 |
Brad Figg |
linux (Ubuntu): status |
New |
Incomplete |
|
| 2012-08-13 23:44:15 |
Matt Wilson |
linux (Ubuntu): status |
Incomplete |
Confirmed |
|
| 2012-08-14 16:33:47 |
Launchpad Janitor |
linux-lts-backport-oneiric (Ubuntu): status |
New |
Confirmed |
|
| 2012-08-14 18:06:37 |
Andrew R |
bug |
|
|
added subscriber Andrew R |
| 2012-08-16 01:01:13 |
Matt Wilson |
summary |
Scheduler deadlock running 3.0.0 on multiple EC2 instance types |
Kernel lockup running 3.0.0 and 3.2.0 on multiple EC2 instance types |
|
| 2012-08-16 02:54:40 |
Ben Howard |
linux-lts-backport-oneiric (Ubuntu): importance |
Undecided |
Critical |
|
| 2012-08-16 02:54:44 |
Ben Howard |
linux (Ubuntu): importance |
Undecided |
Critical |
|
| 2012-08-16 07:56:11 |
Stefan Bader |
bug |
|
|
added subscriber Stefan Bader |
| 2012-08-17 01:18:21 |
Mike Krieger |
bug |
|
|
added subscriber Mike Krieger |
| 2012-08-17 01:19:26 |
Mike Krieger |
tags |
oneiric |
apport-collected ec2-images oneiric precise |
|
| 2012-08-17 01:19:30 |
Mike Krieger |
attachment added |
|
BootDmesg.txt https://bugs.launchpad.net/bugs/1011792/+attachment/3264700/+files/BootDmesg.txt |
|
| 2012-08-17 01:19:34 |
Mike Krieger |
attachment added |
|
CurrentDmesg.txt https://bugs.launchpad.net/bugs/1011792/+attachment/3264701/+files/CurrentDmesg.txt |
|
| 2012-08-17 01:19:35 |
Mike Krieger |
attachment added |
|
ProcCpuinfo.txt https://bugs.launchpad.net/bugs/1011792/+attachment/3264702/+files/ProcCpuinfo.txt |
|
| 2012-08-17 01:19:37 |
Mike Krieger |
attachment added |
|
ProcInterrupts.txt https://bugs.launchpad.net/bugs/1011792/+attachment/3264703/+files/ProcInterrupts.txt |
|
| 2012-08-17 01:19:38 |
Mike Krieger |
attachment added |
|
ProcModules.txt https://bugs.launchpad.net/bugs/1011792/+attachment/3264704/+files/ProcModules.txt |
|
| 2012-08-17 01:19:41 |
Mike Krieger |
attachment added |
|
UdevDb.txt https://bugs.launchpad.net/bugs/1011792/+attachment/3264705/+files/UdevDb.txt |
|
| 2012-08-17 01:19:42 |
Mike Krieger |
attachment added |
|
UdevLog.txt https://bugs.launchpad.net/bugs/1011792/+attachment/3264706/+files/UdevLog.txt |
|
| 2012-08-21 16:36:15 |
Joseph Salisbury |
tags |
apport-collected ec2-images oneiric precise |
apport-collected ec2-images kernel-da-key oneiric precise |
|
| 2012-08-21 16:51:11 |
Joseph Salisbury |
tags |
apport-collected ec2-images kernel-da-key oneiric precise |
apport-collected ec2-images kernel-da-key kernel-key oneiric precise |
|
| 2012-09-19 23:24:55 |
Rick Branson |
attachment added |
|
pgslam.py https://bugs.launchpad.net/ubuntu/+source/linux-lts-backport-oneiric/+bug/1011792/+attachment/3324324/+files/pgslam.py |
|
| 2012-09-19 23:25:16 |
Rick Branson |
attachment added |
|
setup_hi1_4xlarge_for_crash_test.sh https://bugs.launchpad.net/ubuntu/+source/linux-lts-backport-oneiric/+bug/1011792/+attachment/3324325/+files/setup_hi1_4xlarge_for_crash_test.sh |
|
| 2012-10-09 22:01:54 |
Shane Meyers |
bug |
|
|
added subscriber Shane Meyers |
| 2012-10-10 18:44:25 |
Andrew Shieh |
bug |
|
|
added subscriber Andrew Shieh |
| 2012-10-15 02:42:26 |
Bryan Gahagan |
bug |
|
|
added subscriber Bryan Gahagan |
| 2012-10-16 02:26:36 |
Matt Blair |
bug |
|
|
added subscriber Matt Blair |
| 2012-10-16 13:55:22 |
Joseph Salisbury |
tags |
apport-collected ec2-images kernel-da-key kernel-key oneiric precise |
apport-collected ec2-images kernel-da-key oneiric precise |
|
| 2012-10-23 14:36:55 |
Stefan Bader |
bug |
|
|
added subscriber Konrad Rzeszutek Wilk |
| 2012-11-06 09:39:36 |
maf |
bug |
|
|
added subscriber maf |
| 2012-11-28 09:36:23 |
Stefan Bader |
attachment added |
|
0001-xen-pv-spinlock-Never-enable-interrupts-in-xen_spin_.patch https://bugs.launchpad.net/ubuntu/+source/linux-lts-backport-oneiric/+bug/1011792/+attachment/3445884/+files/0001-xen-pv-spinlock-Never-enable-interrupts-in-xen_spin_.patch |
|
| 2012-11-28 12:19:21 |
Ubuntu Foundations Team Bug Bot |
tags |
apport-collected ec2-images kernel-da-key oneiric precise |
apport-collected ec2-images kernel-da-key oneiric patch precise |
|
| 2012-11-28 12:19:22 |
Ubuntu Foundations Team Bug Bot |
bug |
|
|
added subscriber Joseph Salisbury |
| 2013-01-04 00:06:12 |
Bjoern Voigt |
bug |
|
|
added subscriber Bjoern Voigt |
| 2013-01-07 05:58:38 |
Edward Chu |
bug |
|
|
added subscriber Edward Chu |
| 2013-01-07 11:31:18 |
Michael Hood |
bug |
|
|
added subscriber Michael Hood |
| 2013-01-30 15:13:56 |
Mike Heffner |
bug |
|
|
added subscriber Mike Heffner |
| 2013-02-04 13:46:23 |
Stefan Bader |
nominated for series |
|
Ubuntu Precise |
|
| 2013-02-04 13:46:23 |
Stefan Bader |
bug task added |
|
linux (Ubuntu Precise) |
|
| 2013-02-04 13:46:23 |
Stefan Bader |
bug task added |
|
linux-lts-backport-oneiric (Ubuntu Precise) |
|
| 2013-02-04 13:46:41 |
Stefan Bader |
linux (Ubuntu Precise): status |
New |
In Progress |
|
| 2013-02-04 13:46:46 |
Stefan Bader |
linux (Ubuntu Precise): importance |
Undecided |
Critical |
|
| 2013-02-04 13:46:50 |
Stefan Bader |
linux (Ubuntu Precise): assignee |
|
Stefan Bader (stefan-bader-canonical) |
|
| 2013-02-04 13:47:12 |
Stefan Bader |
linux-lts-backport-oneiric (Ubuntu Precise): status |
New |
Invalid |
|
| 2013-02-04 13:58:30 |
Stefan Bader |
description |
Scheduler deadlocks have been observed on c1.xlarge EC2 instances running 10.04.3 LTS with the 3.0.0-20-virtual Oneiric backport kernel. The symptoms appear similar to bug 929941, where multiple CPUs are waiting on scheduler runqueue locks. But in this case, only a few CPUs are stuck.
A typical set of stack traces from the guest state looks like:
VCPU0
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001202 i nz
rsp: ffff8801b3c27910
rax: 0000000000000000 rcx: ffffffff810013aa rdx: ffff8801b3c27954
rbx: ffff88000265cb30 rsi: ffff8801b3c27938 rdi: 0000000000000003
rbp: ffff8801b3c27958 r8: 0000000000000001 r9: 0000000000000001
r10: 0000000000000000 r11: 0000000000000202 r12: 0000000000000011
r13: 0000000000000001 r14: 0000000000000001 r15: 0000000000000000
cs: e033 ss: e02b ds: 0000 es: 0000
fs: 0000 @ 00007f4ce223f700
gs: 0000 @ ffff8801bfed4000/0000000000000000
cr0: 80050033
cr2: 0061ade0
cr3: 0e93d000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000000246 0000000000000000 ffffffff81394b42 ffff8801b3c27938
0000000000000000 ffff8801b3c27954 ffffffff00000001 0000000000000000
0000000481394ad6 ffff8801b3c27968 ffffffff81394b60 ffff8801b3c279b8
ffffffff8100933f ffff8801b3c27a48 0000000000000000 ffff8801b3c27998
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81394b42>] xen_poll_irq_timeout+0x42
[<ffffffff81394b60>] xen_poll_irq+0x10
[<ffffffff8100933f>] xen_spin_lock_slow+0x7f
[<ffffffff81009435>] xen_spin_lock_flags+0x75
[<ffffffff8160365f>] _raw_spin_lock_irqsave+0x2f
[<ffffffff8104ee50>] task_rq_lock+0x40
[<ffffffff8104f069>] task_sched_runtime+0x29
[<ffffffff81085f38>] thread_group_cputime+0x88
[<ffffffff812c4dc9>] apparmor_ptrace_access_check+0x39
[<ffffffff81051593>] thread_group_times+0x33
[<ffffffff811d4192>] do_task_stat+0x6d2
[<ffffffff8160361e>] _raw_spin_lock+0xe
[<ffffffff8119165f>] seq_open+0x4f
[<ffffffff811d0380>] sched_autogroup_show+0x70
[<ffffffff811d0380>] sched_autogroup_show+0x70
[<ffffffff8119173a>] single_open+0x7a
[<ffffffff811cdbf0>] sched_open+0x20
[<ffffffff811cdc0b>] proc_single_open+0x1b
[<ffffffff8118e460>] mntput_no_expire+0x60
[<ffffffff8118e5ad>] mntput+0x1d
[<ffffffff811d4624>] proc_tgid_stat+0x14
[<ffffffff811d03e1>] proc_single_show+0x61
[<ffffffff81191be2>] seq_read+0xf2
[<ffffffff8116fe35>] vfs_read+0xc5
[<ffffffff81170001>] sys_read+0x51
[<ffffffff8160ba02>] system_call_fastpath+0x16
VCPU1
rip: ffffffff8105a777 try_to_wake_up+0xd7
flags: 00001202 i nz
rsp: ffff8801bfef28f0
rax: 0000000000000003 rcx: 0000000000000000 rdx: 0000000000000001
rbx: 0000000000012980 rsi: ffff8801b1990078 rdi: 0000000000000000
rbp: ffff8801bfef2950 r8: 0000000000000000 r9: 0000000000000000
r10: 0000000000000000 r11: 00000000fb981853 r12: ffff88000265c530
r13: 0000000000000000 r14: ffff88000265cb30 r15: 0000000000000000
cs: e033 ss: e02b ds: 0000 es: 0000
fs: 0000 @ 00007ff68926c700
gs: 0000 @ ffff8801bfeef000/0000000000000000
cr0: 8005003b
cr2: 00441d80
cr3: 1174cb000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff8105a777)
00 00 eb 0c 66 2e 0f 1f 84 00 00 00 00 00 f3 90 41 8b 54 24 28 <85> d2 75 f5 49 8b 14 24 31 c0 83
Stack:
0000000000000000 ffff8801b41d2858 ffff8801bfef2950 ffffffff8153e51e
0000000300000004 ffff8801b1990078 ffff8801bfef2930 ffff8800026f6c18
0000000000000001 ffff8800026f6c30 0000000000000000 0000000000000000
ffff8801bfef2960 ffffffff8105a962 ffff8801bfef29b0 ffffffff81049709
Call Trace:
[<ffffffff8105a777>] try_to_wake_up+0xd7 <--
[<ffffffff8153e51e>] ip_finish_output+0x16e
[<ffffffff8105a962>] default_wake_function+0x12
[<ffffffff81049709>] __wake_up_common+0x59
[<ffffffff81049758>] __wake_up_locked+0x18
[<ffffffff811afcf4>] ep_poll_callback+0xa4
[<ffffffff81049709>] __wake_up_common+0x59
[<ffffffff8104ed53>] __wake_up_sync_key+0x53
[<ffffffff814f3d2e>] sock_def_readable+0x3e
[<ffffffff8155255a>] tcp_rcv_established+0x26a
[<ffffffff8100742d>] xen_force_evtchn_callback+0xd
[<ffffffff81007b72>] check_events+0x12
[<ffffffff8155a9a5>] tcp_v4_do_rcv+0x125
[<ffffffff8155c169>] tcp_v4_rcv+0x5a9
[<ffffffff8153854d>] ip_local_deliver_finish+0xdd
[<ffffffff81538790>] ip_local_deliver+0x80
[<ffffffff81537db9>] ip_rcv_finish+0x119
[<ffffffff815383a8>] ip_rcv+0x228
[<ffffffff815d0afd>] packet_rcv_spkt+0x4d
[<ffffffff815036b0>] __netif_receive_skb+0x1e0
[<ffffffff81506790>] netif_receive_skb+0x80
[<ffffffff814614f4>] handle_incoming_queue+0x134
[<ffffffff81461fd7>] xennet_poll+0x277
[<ffffffff81506ff8>] net_rx_action+0x108
[<ffffffff8160361e>] _raw_spin_lock+0xe
[<ffffffff8106889f>] __do_softirq+0xbf
[<ffffffff810d3f7d>] handle_edge_irq+0x9d
[<ffffffff8160cc1c>] call_softirq+0x1c
[<ffffffff8100d3d5>] do_softirq+0x65
[<ffffffff8106869d>] irq_exit+0xbd
[<ffffffff81394ee5>] xen_evtchn_do_upcall+0x35
[<ffffffff8160cc6e>] xen_do_hypervisor_callback+0x1e
VCPU2
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001202 i nz
rsp: ffff8801bff0da00
rax: 0000000000000000 rcx: ffffffff810013aa rdx: ffff8801bff0da44
rbx: ffff8800026f6c00 rsi: ffff8801bff0da28 rdi: 0000000000000003
rbp: ffff8801bff0da48 r8: 00000000000000c3 r9: 000000000000c110
r10: 0000000000100000 r11: 0000000000000202 r12: 000000000000001d
r13: 0000000000000001 r14: 0000000000000001 r15: 0000000000000000
cs: e033 ss: e02b ds: 0000 es: 0000
fs: 0000 @ 00007f408128b700
gs: 0000 @ ffff8801bff0a000/0000000000000000
cr0: 80050033
cr2: 0061ade0
cr3: 289f2000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000112000 0000000000000000 ffffffff81394b42 ffff8801bff0da28
0000000000000000 ffff8801bff0da44 ffffffff00000001 0000000000000000
0000001081394ad6 ffff8801bff0da58 ffffffff81394b60 ffff8801bff0daa8
ffffffff8100933f ffff8801bff0da88 0000000000000000 ffff8801b3d14530
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81394b42>] xen_poll_irq_timeout+0x42
[<ffffffff81394b60>] xen_poll_irq+0x10
[<ffffffff8100933f>] xen_spin_lock_slow+0x7f
[<ffffffff81009435>] xen_spin_lock_flags+0x75
[<ffffffff8160365f>] _raw_spin_lock_irqsave+0x2f
[<ffffffff811afca9>] ep_poll_callback+0x59
[<ffffffff816036ae>] _raw_spin_unlock_irqrestore+0x1e
[<ffffffff81049709>] __wake_up_common+0x59
[<ffffffff8104ed53>] __wake_up_sync_key+0x53
[<ffffffff814f3d2e>] sock_def_readable+0x3e
[<ffffffff8154ef50>] tcp_data_queue+0x300
[<ffffffff81552639>] tcp_rcv_established+0x349
[<ffffffff8155a9a5>] tcp_v4_do_rcv+0x125
[<ffffffff8155c169>] tcp_v4_rcv+0x5a9
[<ffffffff81054e18>] enqueue_sleeper+0x188
[<ffffffff8153854d>] ip_local_deliver_finish+0xdd
[<ffffffff81538790>] ip_local_deliver+0x80
[<ffffffff81537db9>] ip_rcv_finish+0x119
[<ffffffff815383a8>] ip_rcv+0x228
[<ffffffff815036b0>] __netif_receive_skb+0x1e0
[<ffffffff81007b5f>] xen_restore_fl_direct_reloc+0x4
[<ffffffff810d7af4>] rcu_enter_nohz+0x44
[<ffffffff81503aeb>] process_backlog+0x10b
[<ffffffff810d10b5>] handle_irq_event_percpu+0xb5
[<ffffffff81506ff8>] net_rx_action+0x108
[<ffffffff8100742d>] xen_force_evtchn_callback+0xd
[<ffffffff8106889f>] __do_softirq+0xbf
[<ffffffff81007b5f>] xen_restore_fl_direct_reloc+0x4
[<ffffffff8160cc1c>] call_softirq+0x1c
VCPU3
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001202 i nz
rsp: ffff8801b1993b10
rax: 0000000000000000 rcx: ffffffff810013aa rdx: ffff8801b1993b54
rbx: ffff8801bff01980 rsi: ffff8801b1993b38 rdi: 0000000000000003
rbp: ffff8801b1993b58 r8: ffff8801bf004760 r9: 0000000000000040
r10: 000000000000001d r11: 0000000000000202 r12: 0000000000000023
r13: 0000000000000001 r14: 0000000000000001 r15: 0000000000000000
cs: e033 ss: e02b ds: 0000 es: 0000
fs: 0000 @ 00007f1a15c06700
gs: 0000 @ ffff8801bff25000/0000000000000000
cr0: 80050033
cr2: 7f78b037de20
cr3: 0e9c9000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000000001 0000000000000000 ffffffff81394b42 ffff8801b1993b38
0000000000000000 ffff8801b1993b54 ffffffff00000001 0000000000000000
0000001681394ad6 ffff8801b1993b68 ffffffff81394b60 ffff8801b1993bb8
ffffffff8100933f 0000000000000000 0000000000000000 0000000000000000
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81394b42>] xen_poll_irq_timeout+0x42
[<ffffffff81394b60>] xen_poll_irq+0x10
[<ffffffff8100933f>] xen_spin_lock_slow+0x7f
[<ffffffff81009496>] xen_spin_lock+0x56
[<ffffffff8160361e>] _raw_spin_lock+0xe
[<ffffffff8104d90d>] double_rq_lock+0x2d
[<ffffffff81059f15>] load_balance+0x1f5
[<ffffffff81601576>] __schedule+0x7e6
[<ffffffff8160165f>] schedule+0x3f
[<ffffffff816025b5>] schedule_hrtimeout_range_clock+0xc5
[<ffffffff810881c0>] update_rmtp+0x80
[<ffffffff81089524>] hrtimer_start_range_ns+0x14
[<ffffffff81602663>] schedule_hrtimeout_range+0x13
[<ffffffff811af9f8>] ep_poll+0x2d8
[<ffffffff8105a950>] try_to_wake_up+0x2b0
[<ffffffff81290c2b>] security_file_permission+0x8b
[<ffffffff8116fee0>] vfs_read+0x170
[<ffffffff811afb35>] sys_epoll_wait+0xc5
[<ffffffff8160ba02>] system_call_fastpath+0x16
VCPU4
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001246 i z p
rsp: ffff8801b45f5ed8
rax: 0000000000000000 rcx: ffffffff810013aa rdx: 0000000000000000
rbx: ffff8801b45f4010 rsi: 0000000000000000 rdi: 0000000000000001
rbp: ffff8801b45f5ef0 r8: 0000000000000000 r9: 0000000000000000
r10: 0000000000000000 r11: 0000000000000246 r12: 0000000000000004
r13: 0000000000000000 r14: 0000000000000000 r15: 0000000000000000
cs: e033 ss: e02b ds: 002b es: 002b
fs: 0000 @ 00007fe085364700
gs: 0000 @ ffff8801bff40000/0000000000000000
cr0: 8005003b
cr2: 7f7127c10000
cr3: 29c76000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000000000 0000000000000000 ffffffff81007490 ffff8801b45f5f10
ffffffff81013c3d ffff8801b45f4010 ffffffff81cc7f48 ffff8801b45f5f40
ffffffff8100b0c7 ffffffff81007b19 6811f30c74562efe 0000000000000000
0000000000000000 ffff8801b45f5f50 ffffffff815f523d 0000000000000000
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81007490>] xen_safe_halt+0x10
[<ffffffff81013c3d>] default_idle+0x5d
[<ffffffff8100b0c7>] cpu_idle+0xb7
[<ffffffff81007b19>] xen_irq_enable_direct_reloc+0x4
[<ffffffff815f523d>] cpu_bringup_and_idle+0xe
VCPU5
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001246 i z p
rsp: ffff8801b45f7ed8
rax: 0000000000000000 rcx: ffffffff810013aa rdx: 0000000000000000
rbx: ffff8801b45f6010 rsi: 0000000000000000 rdi: 0000000000000001
rbp: ffff8801b45f7ef0 r8: 0000000000000000 r9: 0000000000000000
r10: 0000000000000000 r11: 0000000000000246 r12: 0000000000000005
r13: 0000000000000000 r14: 0000000000000000 r15: 0000000000000000
cs: e033 ss: e02b ds: 002b es: 002b
fs: 0000 @ 00007fcf9cf7a700
gs: 0000 @ ffff8801bff5b000/0000000000000000
cr0: 8005003b
cr2: 7faf54aac360
cr3: 325e8000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000000000 0000000000000000 ffffffff81007490 ffff8801b45f7f10
ffffffff81013c3d ffff8801b45f6010 ffffffff81cc7f48 ffff8801b45f7f40
ffffffff8100b0c7 ffffffff81007b19 afec8dc6140892fe 0000000000000000
0000000000000000 ffff8801b45f7f50 ffffffff815f523d 0000000000000000
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81007490>] xen_safe_halt+0x10
[<ffffffff81013c3d>] default_idle+0x5d
[<ffffffff8100b0c7>] cpu_idle+0xb7
[<ffffffff81007b19>] xen_irq_enable_direct_reloc+0x4
[<ffffffff815f523d>] cpu_bringup_and_idle+0xe
VCPU6
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001246 i z p
rsp: ffff8801b4601ed8
rax: 0000000000000000 rcx: ffffffff810013aa rdx: 0000000000000000
rbx: ffff8801b4600010 rsi: 0000000000000000 rdi: 0000000000000001
rbp: ffff8801b4601ef0 r8: 0000000000000000 r9: 0000000000000000
r10: 0000000000000000 r11: 0000000000000246 r12: 0000000000000006
r13: 0000000000000000 r14: 0000000000000000 r15: 0000000000000000
cs: e033 ss: e02b ds: 002b es: 002b
fs: 0000 @ 00007ff5deb9b700
gs: 0000 @ ffff8801bff76000/0000000000000000
cr0: 8005003b
cr2: 7faf5345dff8
cr3: 10160000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000000000 0000000000000000 ffffffff81007490 ffff8801b4601f10
ffffffff81013c3d ffff8801b4600010 ffffffff81cc7f48 ffff8801b4601f40
ffffffff8100b0c7 ffffffff81007b19 f6fcdef4e1be86f4 0000000000000000
0000000000000000 ffff8801b4601f50 ffffffff815f523d 0000000000000000
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81007490>] xen_safe_halt+0x10
[<ffffffff81013c3d>] default_idle+0x5d
[<ffffffff8100b0c7>] cpu_idle+0xb7
[<ffffffff81007b19>] xen_irq_enable_direct_reloc+0x4
[<ffffffff815f523d>] cpu_bringup_and_idle+0xe
VCPU7
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001246 i z p
rsp: ffff8801b4603ed8
rax: 0000000000000000 rcx: ffffffff810013aa rdx: 0000000000000000
rbx: ffff8801b4602010 rsi: 0000000000000000 rdi: 0000000000000001
rbp: ffff8801b4603ef0 r8: 0000000000000000 r9: 0000000000000000
r10: 0000000000000000 r11: 0000000000000246 r12: 0000000000000007
r13: 0000000000000000 r14: 0000000000000000 r15: 0000000000000000
cs: e033 ss: e02b ds: 002b es: 002b
fs: 0000 @ 00007fe081751700
gs: 0000 @ ffff8801bff91000/0000000000000000
cr0: 8005003b
cr2: 7faf54bdfde0
cr3: 29c76000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000000000 0000000000000000 ffffffff81007490 ffff8801b4603f10
ffffffff81013c3d ffff8801b4602010 ffffffff81cc7f48 ffff8801b4603f40
ffffffff8100b0c7 ffffffff81007b19 0c1d63da394a80a3 0000000000000000
0000000000000000 ffff8801b4603f50 ffffffff815f523d 0000000000000000
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81007490>] xen_safe_halt+0x10
[<ffffffff81013c3d>] default_idle+0x5d
[<ffffffff8100b0c7>] cpu_idle+0xb7
[<ffffffff81007b19>] xen_irq_enable_direct_reloc+0x4
[<ffffffff815f523d>] cpu_bringup_and_idle+0xe |
SRU Justification:
Impact: Running lots of threads which utilize spinlocks (the pgslam testcase is quite successful in causing this), we hit a stage where the spinlock is still locked but none of the CPUs seem to be actively holding it. The reason for this is not yet completely understood. From evidence it looks like at least one CPU tries to get the lock, fails and goes into the pv-spinlocks special case of doing a hv call. This call seems to return, but somehow not to where it left, so the lock is never taken and other cpus are sometimes stuck in the hv call.
Fix: This problem seems to be avoidable by not enabling the cpu interrupts/event channel before doing the hv call. This may have some performance penalties but on the other hand testing did not seem to be much worse and does actually survive the run.
Testcase: pgslam test script below.
---
Scheduler deadlocks have been observed on c1.xlarge EC2 instances running 10.04.3 LTS with the 3.0.0-20-virtual Oneiric backport kernel. The symptoms appear similar to bug 929941, where multiple CPUs are waiting on scheduler runqueue locks. But in this case, only a few CPUs are stuck.
A typical set of stack traces from the guest state looks like:
VCPU0
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001202 i nz
rsp: ffff8801b3c27910
rax: 0000000000000000 rcx: ffffffff810013aa rdx: ffff8801b3c27954
rbx: ffff88000265cb30 rsi: ffff8801b3c27938 rdi: 0000000000000003
rbp: ffff8801b3c27958 r8: 0000000000000001 r9: 0000000000000001
r10: 0000000000000000 r11: 0000000000000202 r12: 0000000000000011
r13: 0000000000000001 r14: 0000000000000001 r15: 0000000000000000
cs: e033 ss: e02b ds: 0000 es: 0000
fs: 0000 @ 00007f4ce223f700
gs: 0000 @ ffff8801bfed4000/0000000000000000
cr0: 80050033
cr2: 0061ade0
cr3: 0e93d000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000000246 0000000000000000 ffffffff81394b42 ffff8801b3c27938
0000000000000000 ffff8801b3c27954 ffffffff00000001 0000000000000000
0000000481394ad6 ffff8801b3c27968 ffffffff81394b60 ffff8801b3c279b8
ffffffff8100933f ffff8801b3c27a48 0000000000000000 ffff8801b3c27998
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81394b42>] xen_poll_irq_timeout+0x42
[<ffffffff81394b60>] xen_poll_irq+0x10
[<ffffffff8100933f>] xen_spin_lock_slow+0x7f
[<ffffffff81009435>] xen_spin_lock_flags+0x75
[<ffffffff8160365f>] _raw_spin_lock_irqsave+0x2f
[<ffffffff8104ee50>] task_rq_lock+0x40
[<ffffffff8104f069>] task_sched_runtime+0x29
[<ffffffff81085f38>] thread_group_cputime+0x88
[<ffffffff812c4dc9>] apparmor_ptrace_access_check+0x39
[<ffffffff81051593>] thread_group_times+0x33
[<ffffffff811d4192>] do_task_stat+0x6d2
[<ffffffff8160361e>] _raw_spin_lock+0xe
[<ffffffff8119165f>] seq_open+0x4f
[<ffffffff811d0380>] sched_autogroup_show+0x70
[<ffffffff811d0380>] sched_autogroup_show+0x70
[<ffffffff8119173a>] single_open+0x7a
[<ffffffff811cdbf0>] sched_open+0x20
[<ffffffff811cdc0b>] proc_single_open+0x1b
[<ffffffff8118e460>] mntput_no_expire+0x60
[<ffffffff8118e5ad>] mntput+0x1d
[<ffffffff811d4624>] proc_tgid_stat+0x14
[<ffffffff811d03e1>] proc_single_show+0x61
[<ffffffff81191be2>] seq_read+0xf2
[<ffffffff8116fe35>] vfs_read+0xc5
[<ffffffff81170001>] sys_read+0x51
[<ffffffff8160ba02>] system_call_fastpath+0x16
VCPU1
rip: ffffffff8105a777 try_to_wake_up+0xd7
flags: 00001202 i nz
rsp: ffff8801bfef28f0
rax: 0000000000000003 rcx: 0000000000000000 rdx: 0000000000000001
rbx: 0000000000012980 rsi: ffff8801b1990078 rdi: 0000000000000000
rbp: ffff8801bfef2950 r8: 0000000000000000 r9: 0000000000000000
r10: 0000000000000000 r11: 00000000fb981853 r12: ffff88000265c530
r13: 0000000000000000 r14: ffff88000265cb30 r15: 0000000000000000
cs: e033 ss: e02b ds: 0000 es: 0000
fs: 0000 @ 00007ff68926c700
gs: 0000 @ ffff8801bfeef000/0000000000000000
cr0: 8005003b
cr2: 00441d80
cr3: 1174cb000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff8105a777)
00 00 eb 0c 66 2e 0f 1f 84 00 00 00 00 00 f3 90 41 8b 54 24 28 <85> d2 75 f5 49 8b 14 24 31 c0 83
Stack:
0000000000000000 ffff8801b41d2858 ffff8801bfef2950 ffffffff8153e51e
0000000300000004 ffff8801b1990078 ffff8801bfef2930 ffff8800026f6c18
0000000000000001 ffff8800026f6c30 0000000000000000 0000000000000000
ffff8801bfef2960 ffffffff8105a962 ffff8801bfef29b0 ffffffff81049709
Call Trace:
[<ffffffff8105a777>] try_to_wake_up+0xd7 <--
[<ffffffff8153e51e>] ip_finish_output+0x16e
[<ffffffff8105a962>] default_wake_function+0x12
[<ffffffff81049709>] __wake_up_common+0x59
[<ffffffff81049758>] __wake_up_locked+0x18
[<ffffffff811afcf4>] ep_poll_callback+0xa4
[<ffffffff81049709>] __wake_up_common+0x59
[<ffffffff8104ed53>] __wake_up_sync_key+0x53
[<ffffffff814f3d2e>] sock_def_readable+0x3e
[<ffffffff8155255a>] tcp_rcv_established+0x26a
[<ffffffff8100742d>] xen_force_evtchn_callback+0xd
[<ffffffff81007b72>] check_events+0x12
[<ffffffff8155a9a5>] tcp_v4_do_rcv+0x125
[<ffffffff8155c169>] tcp_v4_rcv+0x5a9
[<ffffffff8153854d>] ip_local_deliver_finish+0xdd
[<ffffffff81538790>] ip_local_deliver+0x80
[<ffffffff81537db9>] ip_rcv_finish+0x119
[<ffffffff815383a8>] ip_rcv+0x228
[<ffffffff815d0afd>] packet_rcv_spkt+0x4d
[<ffffffff815036b0>] __netif_receive_skb+0x1e0
[<ffffffff81506790>] netif_receive_skb+0x80
[<ffffffff814614f4>] handle_incoming_queue+0x134
[<ffffffff81461fd7>] xennet_poll+0x277
[<ffffffff81506ff8>] net_rx_action+0x108
[<ffffffff8160361e>] _raw_spin_lock+0xe
[<ffffffff8106889f>] __do_softirq+0xbf
[<ffffffff810d3f7d>] handle_edge_irq+0x9d
[<ffffffff8160cc1c>] call_softirq+0x1c
[<ffffffff8100d3d5>] do_softirq+0x65
[<ffffffff8106869d>] irq_exit+0xbd
[<ffffffff81394ee5>] xen_evtchn_do_upcall+0x35
[<ffffffff8160cc6e>] xen_do_hypervisor_callback+0x1e
VCPU2
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001202 i nz
rsp: ffff8801bff0da00
rax: 0000000000000000 rcx: ffffffff810013aa rdx: ffff8801bff0da44
rbx: ffff8800026f6c00 rsi: ffff8801bff0da28 rdi: 0000000000000003
rbp: ffff8801bff0da48 r8: 00000000000000c3 r9: 000000000000c110
r10: 0000000000100000 r11: 0000000000000202 r12: 000000000000001d
r13: 0000000000000001 r14: 0000000000000001 r15: 0000000000000000
cs: e033 ss: e02b ds: 0000 es: 0000
fs: 0000 @ 00007f408128b700
gs: 0000 @ ffff8801bff0a000/0000000000000000
cr0: 80050033
cr2: 0061ade0
cr3: 289f2000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000112000 0000000000000000 ffffffff81394b42 ffff8801bff0da28
0000000000000000 ffff8801bff0da44 ffffffff00000001 0000000000000000
0000001081394ad6 ffff8801bff0da58 ffffffff81394b60 ffff8801bff0daa8
ffffffff8100933f ffff8801bff0da88 0000000000000000 ffff8801b3d14530
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81394b42>] xen_poll_irq_timeout+0x42
[<ffffffff81394b60>] xen_poll_irq+0x10
[<ffffffff8100933f>] xen_spin_lock_slow+0x7f
[<ffffffff81009435>] xen_spin_lock_flags+0x75
[<ffffffff8160365f>] _raw_spin_lock_irqsave+0x2f
[<ffffffff811afca9>] ep_poll_callback+0x59
[<ffffffff816036ae>] _raw_spin_unlock_irqrestore+0x1e
[<ffffffff81049709>] __wake_up_common+0x59
[<ffffffff8104ed53>] __wake_up_sync_key+0x53
[<ffffffff814f3d2e>] sock_def_readable+0x3e
[<ffffffff8154ef50>] tcp_data_queue+0x300
[<ffffffff81552639>] tcp_rcv_established+0x349
[<ffffffff8155a9a5>] tcp_v4_do_rcv+0x125
[<ffffffff8155c169>] tcp_v4_rcv+0x5a9
[<ffffffff81054e18>] enqueue_sleeper+0x188
[<ffffffff8153854d>] ip_local_deliver_finish+0xdd
[<ffffffff81538790>] ip_local_deliver+0x80
[<ffffffff81537db9>] ip_rcv_finish+0x119
[<ffffffff815383a8>] ip_rcv+0x228
[<ffffffff815036b0>] __netif_receive_skb+0x1e0
[<ffffffff81007b5f>] xen_restore_fl_direct_reloc+0x4
[<ffffffff810d7af4>] rcu_enter_nohz+0x44
[<ffffffff81503aeb>] process_backlog+0x10b
[<ffffffff810d10b5>] handle_irq_event_percpu+0xb5
[<ffffffff81506ff8>] net_rx_action+0x108
[<ffffffff8100742d>] xen_force_evtchn_callback+0xd
[<ffffffff8106889f>] __do_softirq+0xbf
[<ffffffff81007b5f>] xen_restore_fl_direct_reloc+0x4
[<ffffffff8160cc1c>] call_softirq+0x1c
VCPU3
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001202 i nz
rsp: ffff8801b1993b10
rax: 0000000000000000 rcx: ffffffff810013aa rdx: ffff8801b1993b54
rbx: ffff8801bff01980 rsi: ffff8801b1993b38 rdi: 0000000000000003
rbp: ffff8801b1993b58 r8: ffff8801bf004760 r9: 0000000000000040
r10: 000000000000001d r11: 0000000000000202 r12: 0000000000000023
r13: 0000000000000001 r14: 0000000000000001 r15: 0000000000000000
cs: e033 ss: e02b ds: 0000 es: 0000
fs: 0000 @ 00007f1a15c06700
gs: 0000 @ ffff8801bff25000/0000000000000000
cr0: 80050033
cr2: 7f78b037de20
cr3: 0e9c9000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000000001 0000000000000000 ffffffff81394b42 ffff8801b1993b38
0000000000000000 ffff8801b1993b54 ffffffff00000001 0000000000000000
0000001681394ad6 ffff8801b1993b68 ffffffff81394b60 ffff8801b1993bb8
ffffffff8100933f 0000000000000000 0000000000000000 0000000000000000
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81394b42>] xen_poll_irq_timeout+0x42
[<ffffffff81394b60>] xen_poll_irq+0x10
[<ffffffff8100933f>] xen_spin_lock_slow+0x7f
[<ffffffff81009496>] xen_spin_lock+0x56
[<ffffffff8160361e>] _raw_spin_lock+0xe
[<ffffffff8104d90d>] double_rq_lock+0x2d
[<ffffffff81059f15>] load_balance+0x1f5
[<ffffffff81601576>] __schedule+0x7e6
[<ffffffff8160165f>] schedule+0x3f
[<ffffffff816025b5>] schedule_hrtimeout_range_clock+0xc5
[<ffffffff810881c0>] update_rmtp+0x80
[<ffffffff81089524>] hrtimer_start_range_ns+0x14
[<ffffffff81602663>] schedule_hrtimeout_range+0x13
[<ffffffff811af9f8>] ep_poll+0x2d8
[<ffffffff8105a950>] try_to_wake_up+0x2b0
[<ffffffff81290c2b>] security_file_permission+0x8b
[<ffffffff8116fee0>] vfs_read+0x170
[<ffffffff811afb35>] sys_epoll_wait+0xc5
[<ffffffff8160ba02>] system_call_fastpath+0x16
VCPU4
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001246 i z p
rsp: ffff8801b45f5ed8
rax: 0000000000000000 rcx: ffffffff810013aa rdx: 0000000000000000
rbx: ffff8801b45f4010 rsi: 0000000000000000 rdi: 0000000000000001
rbp: ffff8801b45f5ef0 r8: 0000000000000000 r9: 0000000000000000
r10: 0000000000000000 r11: 0000000000000246 r12: 0000000000000004
r13: 0000000000000000 r14: 0000000000000000 r15: 0000000000000000
cs: e033 ss: e02b ds: 002b es: 002b
fs: 0000 @ 00007fe085364700
gs: 0000 @ ffff8801bff40000/0000000000000000
cr0: 8005003b
cr2: 7f7127c10000
cr3: 29c76000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000000000 0000000000000000 ffffffff81007490 ffff8801b45f5f10
ffffffff81013c3d ffff8801b45f4010 ffffffff81cc7f48 ffff8801b45f5f40
ffffffff8100b0c7 ffffffff81007b19 6811f30c74562efe 0000000000000000
0000000000000000 ffff8801b45f5f50 ffffffff815f523d 0000000000000000
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81007490>] xen_safe_halt+0x10
[<ffffffff81013c3d>] default_idle+0x5d
[<ffffffff8100b0c7>] cpu_idle+0xb7
[<ffffffff81007b19>] xen_irq_enable_direct_reloc+0x4
[<ffffffff815f523d>] cpu_bringup_and_idle+0xe
VCPU5
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001246 i z p
rsp: ffff8801b45f7ed8
rax: 0000000000000000 rcx: ffffffff810013aa rdx: 0000000000000000
rbx: ffff8801b45f6010 rsi: 0000000000000000 rdi: 0000000000000001
rbp: ffff8801b45f7ef0 r8: 0000000000000000 r9: 0000000000000000
r10: 0000000000000000 r11: 0000000000000246 r12: 0000000000000005
r13: 0000000000000000 r14: 0000000000000000 r15: 0000000000000000
cs: e033 ss: e02b ds: 002b es: 002b
fs: 0000 @ 00007fcf9cf7a700
gs: 0000 @ ffff8801bff5b000/0000000000000000
cr0: 8005003b
cr2: 7faf54aac360
cr3: 325e8000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000000000 0000000000000000 ffffffff81007490 ffff8801b45f7f10
ffffffff81013c3d ffff8801b45f6010 ffffffff81cc7f48 ffff8801b45f7f40
ffffffff8100b0c7 ffffffff81007b19 afec8dc6140892fe 0000000000000000
0000000000000000 ffff8801b45f7f50 ffffffff815f523d 0000000000000000
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81007490>] xen_safe_halt+0x10
[<ffffffff81013c3d>] default_idle+0x5d
[<ffffffff8100b0c7>] cpu_idle+0xb7
[<ffffffff81007b19>] xen_irq_enable_direct_reloc+0x4
[<ffffffff815f523d>] cpu_bringup_and_idle+0xe
VCPU6
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001246 i z p
rsp: ffff8801b4601ed8
rax: 0000000000000000 rcx: ffffffff810013aa rdx: 0000000000000000
rbx: ffff8801b4600010 rsi: 0000000000000000 rdi: 0000000000000001
rbp: ffff8801b4601ef0 r8: 0000000000000000 r9: 0000000000000000
r10: 0000000000000000 r11: 0000000000000246 r12: 0000000000000006
r13: 0000000000000000 r14: 0000000000000000 r15: 0000000000000000
cs: e033 ss: e02b ds: 002b es: 002b
fs: 0000 @ 00007ff5deb9b700
gs: 0000 @ ffff8801bff76000/0000000000000000
cr0: 8005003b
cr2: 7faf5345dff8
cr3: 10160000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000000000 0000000000000000 ffffffff81007490 ffff8801b4601f10
ffffffff81013c3d ffff8801b4600010 ffffffff81cc7f48 ffff8801b4601f40
ffffffff8100b0c7 ffffffff81007b19 f6fcdef4e1be86f4 0000000000000000
0000000000000000 ffff8801b4601f50 ffffffff815f523d 0000000000000000
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81007490>] xen_safe_halt+0x10
[<ffffffff81013c3d>] default_idle+0x5d
[<ffffffff8100b0c7>] cpu_idle+0xb7
[<ffffffff81007b19>] xen_irq_enable_direct_reloc+0x4
[<ffffffff815f523d>] cpu_bringup_and_idle+0xe
VCPU7
rip: ffffffff810013aa hypercall_page+0x3aa
flags: 00001246 i z p
rsp: ffff8801b4603ed8
rax: 0000000000000000 rcx: ffffffff810013aa rdx: 0000000000000000
rbx: ffff8801b4602010 rsi: 0000000000000000 rdi: 0000000000000001
rbp: ffff8801b4603ef0 r8: 0000000000000000 r9: 0000000000000000
r10: 0000000000000000 r11: 0000000000000246 r12: 0000000000000007
r13: 0000000000000000 r14: 0000000000000000 r15: 0000000000000000
cs: e033 ss: e02b ds: 002b es: 002b
fs: 0000 @ 00007fe081751700
gs: 0000 @ ffff8801bff91000/0000000000000000
cr0: 8005003b
cr2: 7faf54bdfde0
cr3: 29c76000
cr4: 00002660
dr0: 00000000
dr1: 00000000
dr2: 00000000
dr3: 00000000
dr6: ffff0ff0
dr7: 00000400
Code (instr addr ffffffff810013aa)
cc cc cc cc cc cc cc cc cc cc cc 51 41 53 b8 1d 00 00 00 0f 05 <41> 5b 59 c3 cc cc cc cc cc cc cc
Stack:
0000000000000000 0000000000000000 ffffffff81007490 ffff8801b4603f10
ffffffff81013c3d ffff8801b4602010 ffffffff81cc7f48 ffff8801b4603f40
ffffffff8100b0c7 ffffffff81007b19 0c1d63da394a80a3 0000000000000000
0000000000000000 ffff8801b4603f50 ffffffff815f523d 0000000000000000
Call Trace:
[<ffffffff810013aa>] hypercall_page+0x3aa <--
[<ffffffff81007490>] xen_safe_halt+0x10
[<ffffffff81013c3d>] default_idle+0x5d
[<ffffffff8100b0c7>] cpu_idle+0xb7
[<ffffffff81007b19>] xen_irq_enable_direct_reloc+0x4
[<ffffffff815f523d>] cpu_bringup_and_idle+0xe |
|
| 2013-02-04 19:00:25 |
Jeffrey Gelens |
bug |
|
|
added subscriber Jeffrey Gelens |
| 2013-02-14 15:34:57 |
Stefan Bader |
linux (Ubuntu Precise): status |
In Progress |
Fix Committed |
|
| 2013-02-15 15:23:50 |
Stefan Bader |
attachment added |
|
0001-xen-Send-spinlock-IPI-to-all-waiters.patch https://bugs.launchpad.net/ubuntu/+source/linux-lts-backport-oneiric/+bug/1011792/+attachment/3530204/+files/0001-xen-Send-spinlock-IPI-to-all-waiters.patch |
|
| 2013-02-22 13:10:08 |
TooAngel |
bug |
|
|
added subscriber Tobias Wilken |
| 2013-02-24 00:27:54 |
david duncan |
bug |
|
|
added subscriber david duncan |
| 2013-02-26 07:56:16 |
Travis Reeder |
bug |
|
|
added subscriber Travis Reeder |
| 2013-02-27 10:13:24 |
Stefan Bader |
nominated for series |
|
Ubuntu Lucid |
|
| 2013-02-27 10:13:24 |
Stefan Bader |
bug task added |
|
linux (Ubuntu Lucid) |
|
| 2013-02-27 10:13:24 |
Stefan Bader |
bug task added |
|
linux-lts-backport-oneiric (Ubuntu Lucid) |
|
| 2013-02-27 10:13:24 |
Stefan Bader |
nominated for series |
|
Ubuntu Oneiric |
|
| 2013-02-27 10:13:24 |
Stefan Bader |
bug task added |
|
linux (Ubuntu Oneiric) |
|
| 2013-02-27 10:13:24 |
Stefan Bader |
bug task added |
|
linux-lts-backport-oneiric (Ubuntu Oneiric) |
|
| 2013-02-27 10:13:24 |
Stefan Bader |
nominated for series |
|
Ubuntu Raring |
|
| 2013-02-27 10:13:24 |
Stefan Bader |
bug task added |
|
linux (Ubuntu Raring) |
|
| 2013-02-27 10:13:24 |
Stefan Bader |
bug task added |
|
linux-lts-backport-oneiric (Ubuntu Raring) |
|
| 2013-02-27 10:13:24 |
Stefan Bader |
nominated for series |
|
Ubuntu Quantal |
|
| 2013-02-27 10:13:24 |
Stefan Bader |
bug task added |
|
linux (Ubuntu Quantal) |
|
| 2013-02-27 10:13:24 |
Stefan Bader |
bug task added |
|
linux-lts-backport-oneiric (Ubuntu Quantal) |
|
| 2013-02-27 10:13:52 |
Stefan Bader |
linux-lts-backport-oneiric (Ubuntu Lucid): status |
New |
Invalid |
|
| 2013-02-27 10:14:33 |
Stefan Bader |
linux-lts-backport-oneiric (Ubuntu Quantal): status |
New |
Invalid |
|
| 2013-02-27 10:14:51 |
Stefan Bader |
linux-lts-backport-oneiric (Ubuntu Raring): status |
Confirmed |
Invalid |
|
| 2013-02-27 10:15:11 |
Stefan Bader |
linux-lts-backport-oneiric (Ubuntu Oneiric): importance |
Undecided |
Critical |
|
| 2013-02-27 10:15:11 |
Stefan Bader |
linux-lts-backport-oneiric (Ubuntu Oneiric): status |
New |
Confirmed |
|
| 2013-02-27 10:15:28 |
Stefan Bader |
linux-lts-backport-oneiric (Ubuntu Raring): importance |
Critical |
Undecided |
|
| 2013-02-27 10:15:51 |
Stefan Bader |
linux (Ubuntu Quantal): importance |
Undecided |
Critical |
|
| 2013-02-27 10:15:51 |
Stefan Bader |
linux (Ubuntu Quantal): status |
New |
Confirmed |
|
| 2013-02-27 10:16:12 |
Stefan Bader |
linux (Ubuntu Quantal): importance |
Critical |
High |
|
| 2013-02-27 10:16:32 |
Stefan Bader |
linux (Ubuntu Oneiric): importance |
Undecided |
Critical |
|
| 2013-02-27 10:16:32 |
Stefan Bader |
linux (Ubuntu Oneiric): status |
New |
Confirmed |
|
| 2013-02-27 10:16:57 |
Stefan Bader |
linux (Ubuntu Lucid): importance |
Undecided |
Medium |
|
| 2013-02-27 10:16:57 |
Stefan Bader |
linux (Ubuntu Lucid): status |
New |
Triaged |
|
| 2013-02-27 10:17:12 |
Stefan Bader |
linux (Ubuntu Raring): importance |
Critical |
High |
|
| 2013-03-02 00:43:26 |
Launchpad Janitor |
linux (Ubuntu Raring): status |
Confirmed |
Fix Released |
|
| 2013-03-02 16:02:50 |
Brad Figg |
tags |
apport-collected ec2-images kernel-da-key oneiric patch precise |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-needed-precise |
|
| 2013-03-03 02:50:15 |
Fleish |
bug |
|
|
added subscriber Fleish |
| 2013-03-07 08:47:26 |
Stefan Bader |
tags |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-needed-precise |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-done-precise |
|
| 2013-03-08 09:15:33 |
Daniel Farina |
bug |
|
|
added subscriber Daniel Farina |
| 2013-03-18 16:55:18 |
Launchpad Janitor |
linux (Ubuntu Precise): status |
Fix Committed |
Fix Released |
|
| 2013-03-18 16:55:18 |
Launchpad Janitor |
cve linked |
|
2013-0190 |
|
| 2013-03-18 16:55:18 |
Launchpad Janitor |
cve linked |
|
2013-0216 |
|
| 2013-03-18 16:55:18 |
Launchpad Janitor |
cve linked |
|
2013-0217 |
|
| 2013-03-18 16:55:18 |
Launchpad Janitor |
cve linked |
|
2013-0231 |
|
| 2013-03-18 16:55:18 |
Launchpad Janitor |
cve linked |
|
2013-0311 |
|
| 2013-03-21 15:06:12 |
Brad Figg |
tags |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-done-precise |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-done-precise verification-needed-quantal |
|
| 2013-03-25 13:23:48 |
Stefan Bader |
tags |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-done-precise verification-needed-quantal |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-done-precise verification-done-quantal |
|
| 2013-03-25 13:24:21 |
Stefan Bader |
linux (Ubuntu Quantal): status |
Confirmed |
Fix Committed |
|
| 2013-03-25 13:25:19 |
Stefan Bader |
linux (Ubuntu Precise): assignee |
Stefan Bader (stefan-bader-canonical) |
|
|
| 2013-03-25 17:30:50 |
Brad Figg |
tags |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-done-precise verification-done-quantal |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-done-precise verification-done-quantal verification-needed-oneiric |
|
| 2013-03-25 17:53:44 |
Stefan Bader |
linux (Ubuntu Oneiric): status |
Confirmed |
Fix Committed |
|
| 2013-03-25 17:54:23 |
Matt Blair |
removed subscriber Matt Blair |
|
|
|
| 2013-03-25 18:46:27 |
Stefan Bader |
tags |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-done-precise verification-done-quantal verification-needed-oneiric |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-done-oneiric verification-done-precise verification-done-quantal |
|
| 2013-04-01 23:23:15 |
Launchpad Janitor |
linux (Ubuntu Oneiric): status |
Fix Committed |
Fix Released |
|
| 2013-04-01 23:23:15 |
Launchpad Janitor |
cve linked |
|
2013-0914 |
|
| 2013-04-01 23:23:15 |
Launchpad Janitor |
cve linked |
|
2013-1792 |
|
| 2013-04-03 01:10:20 |
Launchpad Janitor |
linux-lts-backport-oneiric (Ubuntu Lucid): status |
Invalid |
Fix Released |
|
| 2013-04-08 21:19:10 |
Launchpad Janitor |
linux (Ubuntu Quantal): status |
Fix Committed |
Fix Released |
|
| 2013-04-08 21:19:10 |
Launchpad Janitor |
cve linked |
|
2013-2546 |
|
| 2013-05-07 17:21:21 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/lucid-security/linux-lts-backport-oneiric |
|
| 2013-05-08 02:32:56 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/precise-security/linux-ti-omap4 |
|
| 2013-06-03 18:53:16 |
Brad Figg |
tags |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-done-oneiric verification-done-precise verification-done-quantal |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-done-oneiric verification-done-precise verification-done-quantal verification-needed-lucid |
|
| 2013-06-04 14:47:59 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/lucid-proposed/linux-ec2 |
|
| 2013-06-04 17:07:41 |
Stefan Bader |
tags |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-done-oneiric verification-done-precise verification-done-quantal verification-needed-lucid |
apport-collected ec2-images kernel-da-key oneiric patch precise verification-done-lucid verification-done-oneiric verification-done-precise verification-done-quantal |
|
| 2013-06-13 15:07:13 |
Launchpad Janitor |
linux (Ubuntu Lucid): status |
Triaged |
Fix Released |
|
| 2013-06-13 15:07:13 |
Launchpad Janitor |
cve linked |
|
2013-1798 |
|
| 2013-06-13 15:07:13 |
Launchpad Janitor |
cve linked |
|
2013-3222 |
|
| 2013-06-13 15:07:13 |
Launchpad Janitor |
cve linked |
|
2013-3223 |
|
| 2013-06-13 15:07:13 |
Launchpad Janitor |
cve linked |
|
2013-3224 |
|
| 2013-06-13 15:07:13 |
Launchpad Janitor |
cve linked |
|
2013-3225 |
|
| 2013-06-13 15:07:13 |
Launchpad Janitor |
cve linked |
|
2013-3228 |
|
| 2013-06-13 15:07:13 |
Launchpad Janitor |
cve linked |
|
2013-3229 |
|
| 2013-06-13 15:07:13 |
Launchpad Janitor |
cve linked |
|
2013-3231 |
|
| 2013-06-13 15:07:13 |
Launchpad Janitor |
cve linked |
|
2013-3232 |
|
| 2013-06-13 15:07:13 |
Launchpad Janitor |
cve linked |
|
2013-3234 |
|
| 2013-06-13 15:07:13 |
Launchpad Janitor |
cve linked |
|
2013-3235 |
|
| 2014-01-15 15:13:22 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/lucid-proposed/linux-lts-backport-oneiric |
|
| 2014-01-15 21:39:30 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/lucid-updates/linux-lts-backport-oneiric |
|
| 2014-05-17 00:31:00 |
Simon Kuhn |
removed subscriber Simon Kuhn |
|
|
|
| 2014-12-03 09:15:06 |
Rolf Leggewie |
linux-lts-backport-oneiric (Ubuntu Oneiric): status |
Confirmed |
Won't Fix |
|
