i-79b81f15 2011-01-20T18:10:08+0000 [ 0.000000] Linux version 2.6.24-10-xen (buildd@papaya) (gcc version 4.2.4 (Ubuntu 4.2.4-1ubuntu4)) #1 SMP Tue Sep 8 19:06:53 UTC 2009 (Ubuntu 2.6.24-10-xen) [ 0.000000] Reserving virtual address space above 0xf5800000 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] Xen: 0000000000000000 - 000000006d400000 (usable) [ 0.000000] 1020MB HIGHMEM available. [ 0.000000] 728MB LOWMEM available. [ 0.000000] NX (Execute Disable) protection: active [15195954.514790] Zone PFN ranges: [15195954.514792] DMA 0 -> 4096 [15195954.514793] Normal 4096 -> 186368 [15195954.514795] HighMem 186368 -> 447488 [15195954.514796] Movable zone start PFN for each node [15195954.514798] early_node_map[1] active PFN ranges [15195954.514799] 0: 0 -> 447488 [15195954.542605] ACPI in unprivileged domain disabled [15195954.542612] Allocating PCI resources starting at 70000000 (gap: 6d400000:92c00000) [15195954.542664] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 443992 [15195954.542668] Kernel command line: root=/dev/sda1 ro 4 [15195954.542823] Enabling fast FPU save and restore... done. [15195954.542828] Enabling unmasked SIMD FPU exception support... done. [15195954.542831] Initializing CPU#0 [15195954.542961] PID hash table entries: 4096 (order: 12, 16384 bytes) [15195954.542995] Xen reported: 2327.500 MHz processor. [ 0.336752] console [xvc0] enabled [ 0.336802] Console: colour dummy device 80x25 [ 0.336980] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes) [ 0.337184] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes) [ 0.337256] Software IO TLB disabled [ 0.337260] vmalloc area: ee000000-f53fe000, maxmem 2d800000 [ 0.385579] Memory: 1742848k/1789952k available (2228k kernel code, 38156k reserved, 1002k data, 212k init, 1044480k highmem) [ 0.385590] virtual kernel memory layout: [ 0.385591] fixmap : 0xf568d000 - 0xf57ff000 (1480 kB) [ 0.385592] pkmap : 0xf5400000 - 0xf5600000 (2048 kB) [ 0.385593] vmalloc : 0xee000000 - 0xf53fe000 ( 115 MB) [ 0.385593] lowmem : 0xc0000000 - 0xed800000 ( 728 MB) [ 0.385594] .init : 0xc042d000 - 0xc0462000 ( 212 kB) [ 0.385595] .data : 0xc032d3b5 - 0xc0427d04 (1002 kB) [ 0.385596] .text : 0xc0100000 - 0xc032d3b5 (2228 kB) [ 0.385611] Checking if this processor honours the WP bit even in supervisor mode... Ok. [ 0.474793] Calibrating delay using timer specific routine.. 5821.60 BogoMIPS (lpj=11643219) [ 0.474845] Security Framework initialized [ 0.474864] SELinux: Disabled at boot. [ 0.474870] AppArmor: AppArmor initialized [ 0.474874] Failure registering capabilities with primary security module. [ 0.474891] Mount-cache hash table entries: 512 [ 0.475036] CPU: L1 I cache: 32K, L1 D cache: 32K [ 0.475042] CPU: L2 cache: 4096K [ 0.475058] Compat vDSO mapped to f57fe000. [ 0.475065] Checking 'hlt' instruction... OK. [ 0.475477] SMP alternatives: switching to UP code [ 0.476223] Early unpacking initramfs... done [ 0.498456] Brought up 1 CPUs [ 0.499098] net_namespace: 64 bytes [ 0.499105] failed to set up cpufreq notifier [ 0.514862] Time: 165:165:165 Date: 165/165/65 [ 0.514999] NET: Registered protocol family 16 [ 0.526300] SMP alternatives: switching to SMP code [ 0.000012] Initializing CPU#1 [ 0.000062] 00000001 00000000 [ 0.000069] CPU: L1 I cache: 32K, L1 D cache: 32K [ 0.000072] CPU: L2 cache: 4096K [ 0.527111] PCI: Fatal: No config space access function found [ 0.527116] PCI: setting up Xen PCI frontend stub [ 0.527802] ACPI: Interpreter disabled. [ 0.527809] Linux Plug and Play Support v0.97 (c) Adam Belay [ 0.527837] pnp: PnP ACPI: disabled [ 0.528008] xen_mem: Initialising balloon driver. [ 0.530144] Setting mem allocation to 1781760 kiB [ 0.530397] PCI: System does not support PCI [ 0.530401] PCI: System does not support PCI [ 0.538232] NET: Registered protocol family 8 [ 0.538237] NET: Registered protocol family 20 [ 0.538336] AppArmor: AppArmor Filesystem Enabled [ 0.538741] NET: Registered protocol family 2 [ 0.015164] Time: xen clocksource has been installed. [ 0.574298] IP route cache hash table entries: 32768 (order: 5, 131072 bytes) [ 0.574540] TCP established hash table entries: 131072 (order: 8, 1048576 bytes) [ 0.574963] TCP bind hash table entries: 65536 (order: 7, 524288 bytes) [ 0.575162] TCP: Hash tables configured (established 131072 bind 65536) [ 0.575172] TCP reno registered [ 0.586326] checking if image is initramfs... it is [ 0.619543] Freeing initrd memory: 15923k freed [ 0.093444] audit: initializing netlink socket (disabled) [ 0.093467] audit(1295502598.781:1): initialized [ 0.093736] highmem bounce pool size: 64 pages [ 0.093901] VFS: Disk quotas dquot_6.5.1 [ 0.093931] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes) [ 0.094031] io scheduler noop registered [ 0.094035] io scheduler anticipatory registered [ 0.094038] io scheduler deadline registered [ 0.094062] io scheduler cfq registered (default) [ 0.094422] Xen virtual console successfully installed as xvc0 [ 0.094482] Event-channel device installed. [ 0.102080] Successfully initialized TPM backend driver. [ 0.126071] netfront: Initialising virtual ethernet driver. [ 0.655433] xen-vbd: registered block device major 8 [ 0.172636] rtc: IRQ 8 is not free. [ 0.173916] RAMDISK driver initialized: 16 RAM disks of 65536K size 1024 blocksize [ 0.174015] input: Macintosh mouse button emulation as /devices/virtual/input/input0 [ 0.174207] PNP: No PS/2 controller found. Probing ports directly. [ 0.175220] i8042.c: No controller found. [ 0.185054] mice: PS/2 mouse device common for all mice [ 0.185128] cpuidle: using governor ladder [ 0.185210] NET: Registered protocol family 1 [ 0.185237] Using IPI No-Shortcut mode [ 0.185269] registered taskstats version 1 [ 0.185293] Magic number: 1:252:3141 [ 0.185435] Freeing unused kernel memory: 212k freed Loading, please wait... Begin: Loading essential drivers... ... [ 0.435183] fuse init (API version 7.9) [ 0.444113] uvesafb: failed to execute /sbin/v86d [ 0.444118] uvesafb: make sure that the v86d helper is installed and executable [ 0.444121] uvesafb: Getting VBE info block failed (eax=0x4f00, err=-2) [ 0.444124] uvesafb: vbe_init() failed with -22 [ 0.444129] uvesafb: probe of uvesafb.0 failed with error -22 [ 0.516958] thermal: Unknown symbol acpi_processor_set_thermal_limit Done. Begin: Running /scripts/init-premount ... Done. Begin: Mounting root file system... ... Begin: Running /scripts/local-top ... Done. Begin: Waiting for root file system... ... Done. Begin: Running /scripts/local-premount ... Begin: Waiting for resume device... ... Done. Done. [ 7.153434] kjournald starting. Commit interval 5 seconds [ 7.153446] EXT3-fs: mounted filesystem with ordered data mode. Begin: Running /scripts/local-bottom ... Done. Done. Begin: Running /scripts/init-bottom ... Done. [74G[ OK ] preliminary keymap... [80G [74G[ OK ]g basic networking... [80G [74G[ OK ]g kernel event manager... [80G [74G[ OK ] hardware drivers... [80G * Loading kernel modules... [80G * Loading manual drivers... [80G [ 8.608286] pci_hotplug: PCI Hot Plug PCI Core version: 0.5 [ 8.609405] ACPI Exception (utmutex-0263): AE_BAD_PARAMETER, Thread EC40ED30 could not acquire Mutex [1] [20070126] [ 8.609414] No dock devices found. [ 8.610831] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 8.610837] ACPI Exception (utmutex-0263): AE_BAD_PARAMETER, Thread EC40ED30 could not acquire Mutex [1] [20070126] [74G[ OK ] [74G[ OK ] kernel variables... [80G [74G[ OK ]ing swap... [80G * Checking file systems... [80G fsck 1.40.8 (13-Mar-2008) [74G[ OK ] [74G[ OK ]g local filesystems... [80G [74G[ OK ]ing swapfile swap... [80G $Mounting securityfs on /sys/kernel/security: done. Loading AppArmor profiles : done. [74G[ OK ]g minimum space in /tmp... [80G [74G[ OK ]g firewall: ufw (not enabled)... [80G [74G[ OK ]ring network interfaces... [80G [74G[ OK ]g system log daemon... [80G [74G[ OK ]g kernel log daemon... [80G [74G[ OK ]g system message bus dbus [80G [74G[ OK ] for EC2 meta-data service [80G ec2: Generating public/private rsa key pair. ec2: Your identification has been saved in /etc/ssh/ssh_host_rsa_key. ec2: Your public key has been saved in /etc/ssh/ssh_host_rsa_key.pub. ec2: The key fingerprint is: ec2: 17:27:fe:e1:fb:7e:30:52:c2:9e:06:ba:66:e1:ff:55 root@ubuntu ec2: Generating public/private dsa key pair. ec2: Your identification has been saved in /etc/ssh/ssh_host_dsa_key. ec2: Your public key has been saved in /etc/ssh/ssh_host_dsa_key.pub. ec2: The key fingerprint is: ec2: 4f:97:92:ce:df:7e:df:52:e8:f6:8e:17:c1:cb:59:c9 root@ubuntu ec2: ec2: ec2: ############################################################# ec2: -----BEGIN SSH HOST KEY FINGERPRINTS----- ec2: 2048 17:27:fe:e1:fb:7e:30:52:c2:9e:06:ba:66:e1:ff:55 /etc/ssh/ssh_host_rsa_key.pub ec2: 1024 4f:97:92:ce:df:7e:df:52:e8:f6:8e:17:c1:cb:59:c9 /etc/ssh/ssh_host_dsa_key.pub ec2: -----END SSH HOST KEY FINGERPRINTS----- ec2: ############################################################# * Setting EC2 defaults [80G Generating locales... en_US.UTF-8... done Generation complete. [74G[ OK ] [74G[ OK ]g EC2 SSH keys [80G [74G[ OK ] hostname to EC2 localhostname [80G [74G[ OK ]ing system log daemon... [80G [74G[ OK ]g OpenBSD Secure Shell server sshd [80G [74G[ OK ]g Hardware abstraction layer hald [80G landscape-client is not configured, please run landscape-config. [74G[ OK ]g deferred execution scheduler atd [80G [74G[ OK ]g periodic command scheduler crond [80G [74G[ OK ] EC2 user data [80G [74G[ OK ] local boot scripts (/etc/rc.local) [80G Ubuntu 8.04.4 LTS domU-12-31-39-01-80-E3 xvc0 domU-12-31-39-01-80-E3 login: * Stopping MTA * Starting MTA * Stopping nagios-nrpe nagios-nrpe * Starting nagios-nrpe nagios-nrpe * Stopping system logging syslog-ng * Starting system logging syslog-ng * Starting ah-ddos-monitor daemon ah-ddos-monitor * Restarting ah-ddos-monitor daemon ah-ddos-monitor [42675.340310] BUG: soft lockup - CPU#1 stuck for 11s! [php:24602] [42675.340325] [42675.340329] Pid: 24602, comm: php Tainted: G D (2.6.24-10-xen #1) [42675.340332] EIP: 0061:[] EFLAGS: 00000282 CPU: 1 [42675.340341] EIP is at _spin_lock+0xa/0x10 [42675.340344] EAX: c19c9a8c EBX: 00000000 ECX: 187d4000 EDX: 00000000 [42675.340347] ESI: 040fb067 EDI: c19c9a8c EBP: d87d4938 ESP: d87e7e4c [42675.340350] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069 [42675.340357] CR0: 80050033 CR2: b7f27c65 CR3: 18778000 CR4: 00002660 [42675.340361] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [42675.340364] DR6: ffff0ff0 DR7: 00000000 [42675.340367] [] handle_mm_fault+0x310/0x1360 [42675.340381] [] security_inode_alloc+0x16/0x20 [42675.340388] [] alloc_inode+0x10e/0x1b0 [42675.340394] [] shmem_permission+0x0/0x10 [42675.340401] [] may_open+0xad/0x260 [42675.340407] [] vfs_create+0x11e/0x180 [42675.340416] [] cp_new_stat64+0xf9/0x110 [42675.340422] [] do_page_fault+0x35e/0xe70 [42675.340429] [] exact_lock+0x4/0x10 [42675.340435] [] do_page_fault+0x0/0xe70 [42675.340439] [] error_code+0x35/0x40 [42675.340445] ======================= [42673.289965] BUG: soft lockup - CPU#0 stuck for 11s! [sh:24630] [42673.289979] [42673.289982] Pid: 24630, comm: sh Tainted: G D (2.6.24-10-xen #1) [42673.289985] EIP: 0061:[] EFLAGS: 00000286 CPU: 0 [42673.289993] EIP is at _spin_lock+0x5/0x10 [42673.289996] EAX: c19c81ac EBX: 00000000 ECX: 1870d000 EDX: 00000000 [42673.289998] ESI: 5d803067 EDI: c19c81ac EBP: d870d2f0 ESP: d6521e4c [42673.290001] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069 [42673.290007] CR0: 8005003b CR2: 0805e194 CR3: 18700000 CR4: 00002660 [42673.290010] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [42673.290014] DR6: ffff0ff0 DR7: 00000000 [42673.290017] [] handle_mm_fault+0x310/0x1360 [42673.290031] [] sched_clock+0x23/0x70 [42673.290038] [] do_page_fault+0x35e/0xe70 [42673.290044] [] schedule+0x26f/0x640 [42673.290051] [] sys_clone+0x36/0x40 [42673.290055] [] do_page_fault+0x0/0xe70 [42673.290060] [] error_code+0x35/0x40 [42673.290065] [] svc_accept+0x280/0x410 [42673.290071] ======================= [42704.311998] BUG: soft lockup - CPU#1 stuck for 11s! [php:24602] [42704.312014] [42704.312017] Pid: 24602, comm: php Tainted: G D (2.6.24-10-xen #1) [42704.312020] EIP: 0061:[] EFLAGS: 00000282 CPU: 1 [42704.312028] EIP is at _spin_lock+0x7/0x10 [42704.312031] EAX: c19c9a8c EBX: 00000000 ECX: 187d4000 EDX: 00000000 [42704.312033] ESI: 040fb067 EDI: c19c9a8c EBP: d87d4938 ESP: d87e7e4c [42704.312036] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069 [42704.312043] CR0: 80050033 CR2: b7f27c65 CR3: 18778000 CR4: 00002660 [42704.312046] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [42704.312049] DR6: ffff0ff0 DR7: 00000000 [42704.312052] [] handle_mm_fault+0x310/0x1360 [42704.312065] [] security_inode_alloc+0x16/0x20 [42704.312073] [] alloc_inode+0x10e/0x1b0 [42704.312079] [] shmem_permission+0x0/0x10 [42704.312090] [] may_open+0xad/0x260 [42704.312097] [] vfs_create+0x11e/0x180 [42704.312103] [] cp_new_stat64+0xf9/0x110 [42704.312109] [] do_page_fault+0x35e/0xe70 [42704.312115] [] exact_lock+0x4/0x10 [42704.312121] [] do_page_fault+0x0/0xe70 [42704.312126] [] error_code+0x35/0x40 [42704.312133] ======================= [42702.244937] BUG: soft lockup - CPU#0 stuck for 11s! [sh:24630] [42702.244951] [42702.244954] Pid: 24630, comm: sh Tainted: G D (2.6.24-10-xen #1) [42702.244957] EIP: 0061:[] EFLAGS: 00000286 CPU: 0 [42702.244965] EIP is at _spin_lock+0xa/0x10 [42702.244968] EAX: c19c81ac EBX: 00000000 ECX: 1870d000 EDX: 00000000 [42702.244970] ESI: 5d803067 EDI: c19c81ac EBP: d870d2f0 ESP: d6521e4c [42702.244973] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069 [42702.244979] CR0: 8005003b CR2: 0805e194 CR3: 18700000 CR4: 00002660 [42702.244983] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [42702.244987] DR6: ffff0ff0 DR7: 00000000 [42702.244990] [] handle_mm_fault+0x310/0x1360 [42702.245004] [] sched_clock+0x23/0x70 [42702.245011] [] do_page_fault+0x35e/0xe70 [42702.245017] [] schedule+0x26f/0x640 [42702.245023] [] sys_clone+0x36/0x40 [42702.245027] [] do_page_fault+0x0/0xe70 [42702.245032] [] error_code+0x35/0x40 [42702.245037] [] svc_accept+0x280/0x410 [42702.245043] ======================= [42733.336619] BUG: soft lockup - CPU#1 stuck for 11s! [php:24602] [42733.336634] [42733.336637] Pid: 24602, comm: php Tainted: G D (2.6.24-10-xen #1) [42733.336641] EIP: 0061:[] EFLAGS: 00000282 CPU: 1 [42733.336650] EIP is at _spin_lock+0x7/0x10 [42733.336652] EAX: c19c9a8c EBX: 00000000 ECX: 187d4000 EDX: 00000000 [42733.336655] ESI: 040fb067 EDI: c19c9a8c EBP: d87d4938 ESP: d87e7e4c [42733.336658] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069 [42733.336664] CR0: 80050033 CR2: b7f27c65 CR3: 18778000 CR4: 00002660 [42733.336668] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [42733.336671] DR6: ffff0ff0 DR7: 00000000 [42733.336675] [] handle_mm_fault+0x310/0x1360 [42733.336688] [] security_inode_alloc+0x16/0x20 [42733.336696] [] alloc_inode+0x10e/0x1b0 [42733.336703] [] shmem_permission+0x0/0x10 [42733.336709] [] may_open+0xad/0x260 [42733.336715] [] vfs_create+0x11e/0x180 [42733.336722] [] cp_new_stat64+0xf9/0x110 [42733.336728] [] do_page_fault+0x35e/0xe70 [42733.336734] [] exact_lock+0x4/0x10 [42733.336740] [] do_page_fault+0x0/0xe70 [42733.336744] [] error_code+0x35/0x40 [42733.336751] ======================= [42731.204356] BUG: soft lockup - CPU#0 stuck for 11s! [sh:24630] [42731.204365] [42731.204368] Pid: 24630, comm: sh Tainted: G D (2.6.24-10-xen #1) [42731.204371] EIP: 0061:[] EFLAGS: 00000286 CPU: 0 [42731.204379] EIP is at _spin_lock+0xa/0x10 [42731.204381] EAX: c19c81ac EBX: 00000000 ECX: 1870d000 EDX: 00000000 [42731.204384] ESI: 5d803067 EDI: c19c81ac EBP: d870d2f0 ESP: d6521e4c [42731.204387] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069 [42731.204392] CR0: 8005003b CR2: 0805e194 CR3: 18700000 CR4: 00002660 [42731.204396] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [42731.204399] DR6: ffff0ff0 DR7: 00000000 [42731.204402] [] handle_mm_fault+0x310/0x1360 [42731.204422] [] sched_clock+0x23/0x70 [42731.204430] [] do_page_fault+0x35e/0xe70 [42731.204435] [] schedule+0x26f/0x640 [42731.204442] [] sys_clone+0x36/0x40 [42731.204446] [] do_page_fault+0x0/0xe70 [42731.204450] [] error_code+0x35/0x40 [42731.204457] [] svc_accept+0x280/0x410 [42731.204463] ======================= [42762.185475] BUG: soft lockup - CPU#1 stuck for 11s! [php:24602] [42762.185491] [42762.185494] Pid: 24602, comm: php Tainted: G D (2.6.24-10-xen #1) [42762.185497] EIP: 0061:[] EFLAGS: 00000282 CPU: 1 [42762.185505] EIP is at _spin_lock+0xa/0x10 [42762.185507] EAX: c19c9a8c EBX: 00000000 ECX: 187d4000 EDX: 00000000 [42762.185510] ESI: 040fb067 EDI: c19c9a8c EBP: d87d4938 ESP: d87e7e4c [42762.185513] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069 [42762.185519] CR0: 80050033 CR2: b7f27c65 CR3: 18778000 CR4: 00002660 [42762.185523] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [42762.185526] DR6: ffff0ff0 DR7: 00000000 [42762.185530] [] handle_mm_fault+0x310/0x1360 [42762.185543] [] security_inode_alloc+0x16/0x20 [42762.185551] [] alloc_inode+0x10e/0x1b0 [42762.185557] [] shmem_permission+0x0/0x10 [42762.185564] [] may_open+0xad/0x260 [42762.185570] [] vfs_create+0x11e/0x180 [42762.185577] [] cp_new_stat64+0xf9/0x110 [42762.185583] [] do_page_fault+0x35e/0xe70 [42762.185590] [] exact_lock+0x4/0x10 [42762.185597] [] do_page_fault+0x0/0xe70 [42762.185602] [] error_code+0x35/0x40 [42762.185609] ======================= [42760.199817] BUG: soft lockup - CPU#0 stuck for 11s! [sh:24630] [42760.199832] [42760.199835] Pid: 24630, comm: sh Tainted: G D (2.6.24-10-xen #1) [42760.199838] EIP: 0061:[] EFLAGS: 00000286 CPU: 0 [42760.199846] EIP is at _spin_lock+0x7/0x10 [42760.199848] EAX: c19c81ac EBX: 00000000 ECX: 1870d000 EDX: 00000000 [42760.199851] ESI: 5d803067 EDI: c19c81ac EBP: d870d2f0 ESP: d6521e4c [42760.199853] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069 [42760.199860] CR0: 8005003b CR2: 0805e194 CR3: 18700000 CR4: 00002660 [42760.199865] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [42760.199868] DR6: ffff0ff0 DR7: 00000000 [42760.199871] [] handle_mm_fault+0x310/0x1360 [42760.199885] [] sched_clock+0x23/0x70 [42760.199892] [] do_page_fault+0x35e/0xe70 [42760.199898] [] schedule+0x26f/0x640 [42760.199904] [] sys_clone+0x36/0x40 [42760.199909] [] do_page_fault+0x0/0xe70 [42760.199913] [] error_code+0x35/0x40 [42760.199918] [] svc_accept+0x280/0x410 [42760.199923] ======================= [42791.189068] BUG: soft lockup - CPU#1 stuck for 11s! [php:24602] [42791.189078] [42791.189082] Pid: 24602, comm: php Tainted: G D (2.6.24-10-xen #1) [42791.189085] EIP: 0061:[] EFLAGS: 00000282 CPU: 1 [42791.189093] EIP is at _spin_lock+0xa/0x10 [42791.189096] EAX: c19c9a8c EBX: 00000000 ECX: 187d4000 EDX: 00000000 [42791.189099] ESI: 040fb067 EDI: c19c9a8c EBP: d87d4938 ESP: d87e7e4c [42791.189101] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069 [42791.189108] CR0: 80050033 CR2: b7f27c65 CR3: 18778000 CR4: 00002660 [42791.189112] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [42791.189115] DR6: ffff0ff0 DR7: 00000000 [42791.189118] [] handle_mm_fault+0x310/0x1360 [42791.189131] [] security_inode_alloc+0x16/0x20 [42791.189138] [] alloc_inode+0x10e/0x1b0 [42791.189150] [] shmem_permission+0x0/0x10 [42791.189156] [] may_open+0xad/0x260 [42791.189163] [] vfs_create+0x11e/0x180 [42791.189169] [] cp_new_stat64+0xf9/0x110 [42791.189175] [] do_page_fault+0x35e/0xe70 [42791.189181] [] exact_lock+0x4/0x10 [42791.189187] [] do_page_fault+0x0/0xe70 [42791.189192] [] error_code+0x35/0x40 [42791.189198] ======================= [42789.055386] BUG: soft lockup - CPU#0 stuck for 11s! [sh:24630] [42789.055396] [42789.055399] Pid: 24630, comm: sh Tainted: G D (2.6.24-10-xen #1) [42789.055403] EIP: 0061:[] EFLAGS: 00000286 CPU: 0 [42789.055411] EIP is at _spin_lock+0x7/0x10 [42789.055414] EAX: c19c81ac EBX: 00000000 ECX: 1870d000 EDX: 00000000 [42789.055416] ESI: 5d803067 EDI: c19c81ac EBP: d870d2f0 ESP: d6521e4c [42789.055419] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069 [42789.055425] CR0: 8005003b CR2: 0805e194 CR3: 18700000 CR4: 00002660 [42789.055430] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [42789.055432] DR6: ffff0ff0 DR7: 00000000 [42789.055436] [] handle_mm_fault+0x310/0x1360 [42789.055451] [] sched_clock+0x23/0x70 [42789.055459] [] do_page_fault+0x35e/0xe70 [42789.055464] [] schedule+0x26f/0x640 [42789.055474] [] sys_clone+0x36/0x40 [42789.055479] [] do_page_fault+0x0/0xe70 [42789.055484] [] error_code+0x35/0x40 [42789.055489] [] svc_accept+0x280/0x410 [42789.055496] ======================= [42820.119533] BUG: soft lockup - CPU#1 stuck for 11s! [php:24602] [42820.119549] [42820.119552] Pid: 24602, comm: php Tainted: G D (2.6.24-10-xen #1) [42820.119556] EIP: 0061:[] EFLAGS: 00000282 CPU: 1 [42820.119563] EIP is at _spin_lock+0x7/0x10 [42820.119566] EAX: c19c9a8c EBX: 00000000 ECX: 187d4000 EDX: 00000000 [42820.119569] ESI: 040fb067 EDI: c19c9a8c EBP: d87d4938 ESP: d87e7e4c [42820.119572] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069 [42820.119578] CR0: 80050033 CR2: b7f27c65 CR3: 18778000 CR4: 00002660 [42820.119582] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [42820.119585] DR6: ffff0ff0 DR7: 00000000 [42820.119589] [] handle_mm_fault+0x310/0x1360 [42820.119603] [] security_inode_alloc+0x16/0x20 [42820.119610] [] alloc_inode+0x10e/0x1b0 [42820.119616] [] shmem_permission+0x0/0x10 [42820.119622] [] may_open+0xad/0x260 [42820.119629] [] vfs_create+0x11e/0x180 [42820.119636] [] cp_new_stat64+0xf9/0x110 [42820.119641] [] do_page_fault+0x35e/0xe70 [42820.119648] [] exact_lock+0x4/0x10 [42820.119653] [] do_page_fault+0x0/0xe70 [42820.119659] [] error_code+0x35/0x40 [42820.119665] ======================= [42817.985394] BUG: soft lockup - CPU#0 stuck for 11s! [sh:24630] [42817.985404] [42817.985408] Pid: 24630, comm: sh Tainted: G D (2.6.24-10-xen #1) [42817.985411] EIP: 0061:[] EFLAGS: 00000286 CPU: 0 [42817.985420] EIP is at _spin_lock+0xa/0x10 [42817.985423] EAX: c19c81ac EBX: 00000000 ECX: 1870d000 EDX: 00000000 [42817.985427] ESI: 5d803067 EDI: c19c81ac EBP: d870d2f0 ESP: d6521e4c [42817.985430] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0069 [42817.985436] CR0: 8005003b CR2: 0805e194 CR3: 18700000 CR4: 00002660 [42817.985441] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 [42817.985444] DR6: ffff0ff0 DR7: 00000000 [42817.985448] [] handle_mm_fault+0x310/0x1360 [42817.985464] [] sched_clock+0x23/0x70 [42817.985473] [] do_page_fault+0x35e/0xe70 [42817.985479] [] schedule+0x26f/0x640 [42817.985486] [] sys_clone+0x36/0x40 [42817.985491] [] do_page_fault+0x0/0xe70 [42817.985496] [] error_code+0x35/0x40 [42817.985502] [] svc_accept+0x280/0x410 [42817.985508] =======================