It happened again on a slave of the original production server during replication. I forgot to set lazy drop there. I was able to capture the stack trace as well as the new error log below. Hope it helps. I am going to set lazy load on the slave as well now. Version: '5.5.27-28.0-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 Percona Server (GPL), Release rel28.0, Revision 291 InnoDB: Warning: a long semaphore wait: --Thread 140567060027136 has waited at buf0flu.c line 1887 for 241.00 seconds the semaphore: Mutex at 0x3e1f128 '&buf_pool->mutex', lock var 1 waiters flag 1 InnoDB: ###### Starts InnoDB Monitor for 30 secs to print diagnostic info: InnoDB: Pending preads 0, pwrites 0 ===================================== 120828 6:24:34 INNODB MONITOR OUTPUT ===================================== Per second averages calculated from the last 33 seconds ----------------- BACKGROUND THREAD ----------------- srv_master_thread loops: 134 1_second, 133 sleeps, 13 10_second, 12 background, 10 flush srv_master_thread log flush and writes: 319 ---------- SEMAPHORES ---------- OS WAIT ARRAY INFO: reservation count 2098, signal count 2086 --Thread 140567060027136 has waited at buf0flu.c line 1887 for 245.00 seconds the semaphore: Mutex at 0x3e1f128 '&buf_pool->mutex', lock var 1 waiters flag 1 --Thread 140569517369088 has waited at buf0lru.c line 1102 for 244.00 seconds the semaphore: Mutex at 0x3e1f128 '&buf_pool->mutex', lock var 1 waiters flag 1 Mutex spin waits 2236, rounds 39111, OS waits 1222 RW-shared spins 80, rounds 1689, OS waits 53 RW-excl spins 8, rounds 24866, OS waits 818 Spin rounds per wait: 17.49 mutex, 21.11 RW-shared, 3108.25 RW-excl -------- FILE I/O -------- I/O thread 0 state: waiting for completed aio requests (insert buffer thread) I/O thread 1 state: waiting for completed aio requests (log thread) I/O thread 2 state: waiting for completed aio requests (read thread) I/O thread 3 state: waiting for completed aio requests (read thread) I/O thread 4 state: waiting for completed aio requests (read thread) I/O thread 5 state: waiting for completed aio requests (read thread) I/O thread 6 state: waiting for completed aio requests (write thread) I/O thread 7 state: waiting for completed aio requests (write thread) I/O thread 8 state: waiting for completed aio requests (write thread) I/O thread 9 state: waiting for completed aio requests (write thread) Pending normal aio reads: 0 [0, 0, 0, 0] , aio writes: 0 [0, 0, 0, 0] , ibuf aio reads: 0, log i/o's: 0, sync i/o's: 0 Pending flushes (fsync) log: 0; buffer pool: 0 10772 OS file reads, 61296 OS file writes, 4293 OS fsyncs 0.00 reads/s, 0 avg bytes/read, 0.00 writes/s, 0.00 fsyncs/s ------------------------------------- INSERT BUFFER AND ADAPTIVE HASH INDEX ------------------------------------- Ibuf: size 23, free list len 83602, seg size 83626, 2759 merges merged operations: insert 5051, delete mark 0, delete 0 discarded operations: insert 0, delete mark 0, delete 0 Hash table size 4425293, node heap has 50 buffer(s) 0.00 hash searches/s, 0.00 non-hash searches/s --- LOG --- Log sequence number 252929934147 Log flushed up to 252929934147 Last checkpoint at 252926047000 Max checkpoint age 7782360 Checkpoint age target 7539162 Modified age 3883175 Checkpoint age 3887147 0 pending log writes, 0 pending chkp writes 1910 log i/o's done, 0.00 log i/o's/second ---------------------- BUFFER POOL AND MEMORY ---------------------- Total memory allocated 2206203904; in additional pool allocated 0 Internal hash tables (constant factor + variable factor) Adaptive hash index 36225760 (35402344 + 823416) Page hash 2213656 (buffer pool 0 only) Dictionary cache 9094499 (8851984 + 242515) File system 106432 (82672 + 23760) Lock system 5313792 (5313416 + 376) Recovery system 0 (0 + 0) Dictionary memory allocated 242515 InnoDB: ###### Diagnostic info printed to the standard error stream InnoDB: Warning: a long semaphore wait: --Thread 140567060027136 has waited at buf0flu.c line 1887 for 272.00 seconds the semaphore: Mutex at 0x3e1f128 '&buf_pool->mutex', lock var 1 waiters flag 1 InnoDB: Warning: a long semaphore wait: --Thread 140569517369088 has waited at buf0lru.c line 1102 for 271.00 seconds the semaphore: Mutex at 0x3e1f128 '&buf_pool->mutex', lock var 1 waiters flag 1 InnoDB: ###### Starts InnoDB Monitor for 30 secs to print diagnostic info: InnoDB: Pending preads 0, pwrites 0 InnoDB: ###### Diagnostic info printed to the standard error stream InnoDB: Warning: a long semaphore wait: --Thread 140567060027136 has waited at buf0flu.c line 1887 for 303.00 seconds the semaphore: Mutex at 0x3e1f128 '&buf_pool->mutex', lock var 1 waiters flag 1 InnoDB: Warning: a long semaphore wait: --Thread 140569517369088 has waited at buf0lru.c line 1102 for 302.00 seconds the semaphore: Mutex at 0x3e1f128 '&buf_pool->mutex', lock var 1 waiters flag 1 InnoDB: ###### Starts InnoDB Monitor for 30 secs to print diagnostic info: InnoDB: Pending preads 0, pwrites 0 InnoDB: ###### Diagnostic info printed to the standard error stream []# []# []# []# gdb -ex "set pagination 0" -ex "thread apply all bt" --batch -p 26737 [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". [New Thread 0x7fd8e41e0700 (LWP 559)] [New Thread 0x7fd8e4221700 (LWP 558)] [New Thread 0x7fd8e4262700 (LWP 26873)] [New Thread 0x7fd8e42a3700 (LWP 26872)] [New Thread 0x7fd8e42e4700 (LWP 26871)] [New Thread 0x7fd8512e0700 (LWP 26758)] [New Thread 0x7fd851ae1700 (LWP 26757)] [New Thread 0x7fd8522e2700 (LWP 26756)] [New Thread 0x7fd85391c700 (LWP 26755)] [New Thread 0x7fd85411d700 (LWP 26754)] [New Thread 0x7fd85491e700 (LWP 26753)] [New Thread 0x7fd855920700 (LWP 26748)] [New Thread 0x7fd856121700 (LWP 26747)] [New Thread 0x7fd856922700 (LWP 26746)] [New Thread 0x7fd857123700 (LWP 26745)] [New Thread 0x7fd857924700 (LWP 26744)] [New Thread 0x7fd858125700 (LWP 26743)] [New Thread 0x7fd858926700 (LWP 26742)] [New Thread 0x7fd859127700 (LWP 26741)] [New Thread 0x7fd859928700 (LWP 26740)] [New Thread 0x7fd8e637b700 (LWP 26739)] 0x000000326e4e8ecf in poll () from /lib64/libc.so.6 Thread 22 (Thread 0x7fd8e637b700 (LWP 26739)): #0 0x000000326e000614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000906203 in os_aio_linux_collect (seg_size=256, segment=, array=0x3dd7e80) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4646 #2 os_aio_linux_handle (global_seg=0, message1=0x7fd8e637ae68, message2=0x7fd8e637ae60, type=0x7fd8e637ae58, space_id=0x7fd8e637ae50) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4791 #3 0x00000000008baad8 in fil_aio_wait (segment=0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/fil/fil0fil.c:5535 #4 0x000000000083b370 in io_handler_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0start.c:483 #5 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #6 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 21 (Thread 0x7fd859928700 (LWP 26740)): #0 0x000000326e000614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000906203 in os_aio_linux_collect (seg_size=256, segment=, array=0x3de6120) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4646 #2 os_aio_linux_handle (global_seg=1, message1=0x7fd859927e68, message2=0x7fd859927e60, type=0x7fd859927e58, space_id=0x7fd859927e50) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4791 #3 0x00000000008baad8 in fil_aio_wait (segment=1) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/fil/fil0fil.c:5535 #4 0x000000000083b370 in io_handler_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0start.c:483 #5 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #6 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 20 (Thread 0x7fd859127700 (LWP 26741)): #0 0x000000326e000614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000906203 in os_aio_linux_collect (seg_size=256, segment=, array=0x3df43e0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4646 #2 os_aio_linux_handle (global_seg=2, message1=0x7fd859126e68, message2=0x7fd859126e60, type=0x7fd859126e58, space_id=0x7fd859126e50) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4791 #3 0x00000000008baad8 in fil_aio_wait (segment=2) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/fil/fil0fil.c:5535 #4 0x000000000083b370 in io_handler_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0start.c:483 #5 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #6 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 19 (Thread 0x7fd858926700 (LWP 26742)): #0 0x000000326e000614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000906203 in os_aio_linux_collect (seg_size=256, segment=, array=0x3df43e0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4646 #2 os_aio_linux_handle (global_seg=3, message1=0x7fd858925e68, message2=0x7fd858925e60, type=0x7fd858925e58, space_id=0x7fd858925e50) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4791 #3 0x00000000008baad8 in fil_aio_wait (segment=3) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/fil/fil0fil.c:5535 #4 0x000000000083b370 in io_handler_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0start.c:483 #5 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #6 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 18 (Thread 0x7fd858125700 (LWP 26743)): #0 0x000000326e000614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000906203 in os_aio_linux_collect (seg_size=256, segment=, array=0x3df43e0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4646 #2 os_aio_linux_handle (global_seg=4, message1=0x7fd858124e68, message2=0x7fd858124e60, type=0x7fd858124e58, space_id=0x7fd858124e50) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4791 #3 0x00000000008baad8 in fil_aio_wait (segment=4) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/fil/fil0fil.c:5535 #4 0x000000000083b370 in io_handler_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0start.c:483 #5 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #6 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 17 (Thread 0x7fd857924700 (LWP 26744)): #0 0x000000326e000614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000906203 in os_aio_linux_collect (seg_size=256, segment=, array=0x3df43e0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4646 #2 os_aio_linux_handle (global_seg=5, message1=0x7fd857923e68, message2=0x7fd857923e60, type=0x7fd857923e58, space_id=0x7fd857923e50) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4791 #3 0x00000000008baad8 in fil_aio_wait (segment=5) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/fil/fil0fil.c:5535 #4 0x000000000083b370 in io_handler_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0start.c:483 #5 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #6 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 16 (Thread 0x7fd857123700 (LWP 26745)): #0 0x000000326e000614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000906203 in os_aio_linux_collect (seg_size=256, segment=, array=0x3dfc6a0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4646 #2 os_aio_linux_handle (global_seg=6, message1=0x7fd857122e68, message2=0x7fd857122e60, type=0x7fd857122e58, space_id=0x7fd857122e50) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4791 #3 0x00000000008baad8 in fil_aio_wait (segment=6) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/fil/fil0fil.c:5535 #4 0x000000000083b370 in io_handler_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0start.c:483 #5 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #6 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 15 (Thread 0x7fd856922700 (LWP 26746)): #0 0x000000326e000614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000906203 in os_aio_linux_collect (seg_size=256, segment=, array=0x3dfc6a0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4646 #2 os_aio_linux_handle (global_seg=7, message1=0x7fd856921e68, message2=0x7fd856921e60, type=0x7fd856921e58, space_id=0x7fd856921e50) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4791 #3 0x00000000008baad8 in fil_aio_wait (segment=7) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/fil/fil0fil.c:5535 #4 0x000000000083b370 in io_handler_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0start.c:483 #5 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #6 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 14 (Thread 0x7fd856121700 (LWP 26747)): #0 0x000000326e000614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000906203 in os_aio_linux_collect (seg_size=256, segment=, array=0x3dfc6a0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4646 #2 os_aio_linux_handle (global_seg=8, message1=0x7fd856120e68, message2=0x7fd856120e60, type=0x7fd856120e58, space_id=0x7fd856120e50) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4791 #3 0x00000000008baad8 in fil_aio_wait (segment=8) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/fil/fil0fil.c:5535 #4 0x000000000083b370 in io_handler_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0start.c:483 #5 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #6 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 13 (Thread 0x7fd855920700 (LWP 26748)): #0 0x000000326e000614 in ?? () from /lib64/libaio.so.1 #1 0x0000000000906203 in os_aio_linux_collect (seg_size=256, segment=, array=0x3dfc6a0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4646 #2 os_aio_linux_handle (global_seg=9, message1=0x7fd85591fe68, message2=0x7fd85591fe60, type=0x7fd85591fe58, space_id=0x7fd85591fe50) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0file.c:4791 #3 0x00000000008baad8 in fil_aio_wait (segment=9) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/fil/fil0fil.c:5535 #4 0x000000000083b370 in io_handler_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0start.c:483 #5 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #6 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 12 (Thread 0x7fd85491e700 (LWP 26753)): #0 0x000000326ec0b902 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000907a53 in os_cond_wait_timed (abstime=0x7fd85491dda0, mutex=0x36de040, cond=0x36de080) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:171 #2 os_event_wait_time_low (event=0x36de040, time_in_usec=, reset_sig_count=1) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:716 #3 0x0000000000836828 in srv_lock_timeout_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0srv.c:2674 #4 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #5 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 11 (Thread 0x7fd85411d700 (LWP 26754)): #0 0x000000326ec0b595 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000907ba1 in os_cond_wait (mutex=0x0, cond=0x2922560) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:207 #2 os_event_wait_low (event=0x2922520, reset_sig_count=1) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:609 #3 0x000000000083f94f in sync_array_wait_event (arr=0x28e17e0, index=3) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/sync/sync0arr.c:458 #4 0x0000000000840b7c in mutex_spin_wait (mutex=0x1088040, file_name=0xa5d2a0 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0srv.c", line=1960) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/sync/sync0sync.c:653 #5 0x00000000008366c7 in mutex_enter_func (line=1960, file_name=0xa5d2a0 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0srv.c", mutex=0x1088040) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/include/sync0sync.ic:222 #6 pfs_mutex_enter_func (line=1960, file_name=0xa5d2a0 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0srv.c", mutex=0x1088040) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/include/sync0sync.ic:251 #7 srv_refresh_innodb_monitor_stats () at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0srv.c:1960 #8 srv_error_monitor_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0srv.c:2814 #9 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #10 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 10 (Thread 0x7fd85391c700 (LWP 26755)): #0 0x000000326ec0b595 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000907ba1 in os_cond_wait (mutex=0x0, cond=0x3e1f6e0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:207 #2 os_event_wait_low (event=0x3e1f6a0, reset_sig_count=5) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:609 #3 0x000000000083f94f in sync_array_wait_event (arr=0x28e17e0, index=2) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/sync/sync0arr.c:458 #4 0x0000000000840b7c in mutex_spin_wait (mutex=0x3e1f128, file_name=0xa66358 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0buf.c", line=4981) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/sync/sync0sync.c:653 #5 0x0000000000880f8e in mutex_enter_func (line=4981, file_name=0xa66358 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0buf.c", mutex=0x3e1f128) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/include/sync0sync.ic:222 #6 pfs_mutex_enter_func (mutex=0x3e1f128, file_name=0xa66358 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0buf.c", line=4981) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/include/sync0sync.ic:251 #7 0x0000000000885159 in buf_stats_get_pool_info (all_pool_info=0x7fd824006928, pool_id=0, buf_pool=0x3e1f128) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0buf.c:4981 #8 buf_print_io (file=0x326e7b1180) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0buf.c:5215 #9 0x0000000000838d79 in srv_printf_innodb_monitor (file=0x326e7b1180, nowait=1, trx_end=0x0, trx_start=0x0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0srv.c:2164 #10 0x0000000000839402 in srv_monitor_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0srv.c:2544 #11 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #12 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 9 (Thread 0x7fd8522e2700 (LWP 26756)): #0 0x000000326e4eace3 in select () from /lib64/libc.so.6 #1 0x00000000009088af in os_thread_sleep (tm=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0thread.c:259 #2 0x000000000083422a in srv_LRU_dump_restore_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0srv.c:2933 #3 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #4 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 8 (Thread 0x7fd851ae1700 (LWP 26757)): #0 0x000000326ec0b595 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000907ba1 in os_cond_wait (mutex=0x0, cond=0x3e1f6e0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:207 #2 os_event_wait_low (event=0x3e1f6a0, reset_sig_count=5) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:609 #3 0x000000000083f94f in sync_array_wait_event (arr=0x28e17e0, index=0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/sync/sync0arr.c:458 #4 0x0000000000840b7c in mutex_spin_wait (mutex=0x3e1f128, file_name=0xa677f0 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0flu.c", line=1887) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/sync/sync0sync.c:653 #5 0x000000000088ffc3 in mutex_enter_func (line=1887, file_name=0xa677f0 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0flu.c", mutex=0x3e1f128) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/include/sync0sync.ic:222 #6 pfs_mutex_enter_func (line=1887, file_name=0xa677f0 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0flu.c", mutex=0x3e1f128) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/include/sync0sync.ic:251 #7 buf_flush_start (flush_type=BUF_FLUSH_LIST, buf_pool=0x3e1f128) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0flu.c:1887 #8 buf_flush_list (min_n=35, lsn_limit=252926225723) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0flu.c:2031 #9 0x0000000000837c04 in srv_master_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0srv.c:3452 #10 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #11 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 7 (Thread 0x7fd8512e0700 (LWP 26758)): #0 0x000000326ec0b595 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000907ba1 in os_cond_wait (mutex=0x0, cond=0x2922680) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:207 #2 os_event_wait_low (event=0x2922640, reset_sig_count=2) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:609 #3 0x000000000083b031 in srv_purge_thread (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/srv/srv0srv.c:3944 #4 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #5 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 6 (Thread 0x7fd8e42e4700 (LWP 26871)): #0 0x000000326ec0ed70 in sigwait () from /lib64/libpthread.so.0 #1 0x00000000005153db in signal_hand (arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/mysqld.cc:2732 #2 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #3 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 5 (Thread 0x7fd8e42a3700 (LWP 26872)): #0 0x000000326ec0e0ad in read () from /lib64/libpthread.so.0 #1 0x0000000000991bf2 in vio_read_buff (vio=0x7fd82c008890, buf=0x7fd82c00ca90 "", size=4) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/vio/viosocket.c:95 #2 0x000000000051e2b2 in my_real_read (net=0x7fd82c008290, complen=0x7fd8e42a2b08) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/net_serv.cc:832 #3 0x000000000051e5bc in my_net_read (net=0x7fd82c008290) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/net_serv.cc:1029 #4 0x000000000066a56a in cli_safe_read (mysql=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql-common/client.c:735 #5 0x0000000000532d1e in read_event (suppress_warnings=0x7fd8e42a2e6f, mi=0x74d6e90, mysql=0x7fd82c008290) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/slave.cc:2234 #6 handle_slave_io (arg=0x74d6e90) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/slave.cc:2956 #7 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #8 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 4 (Thread 0x7fd8e4262700 (LWP 26873)): #0 0x000000326ec0b595 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000907ba1 in os_cond_wait (mutex=0x0, cond=0x3e1f6e0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:207 #2 os_event_wait_low (event=0x3e1f6a0, reset_sig_count=5) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:609 #3 0x000000000083f94f in sync_array_wait_event (arr=0x28e17e0, index=1) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/sync/sync0arr.c:458 #4 0x0000000000840b7c in mutex_spin_wait (mutex=0x3e1f128, file_name=0xa67e30 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0lru.c", line=1102) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/sync/sync0sync.c:653 #5 0x000000000089024e in mutex_enter_func (line=1102, file_name=0xa67e30 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0lru.c", mutex=0x3e1f128) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/include/sync0sync.ic:222 #6 pfs_mutex_enter_func (mutex=0x3e1f128, file_name=0xa67e30 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0lru.c", line=1102) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/include/sync0sync.ic:251 #7 0x0000000000897118 in buf_LRU_try_free_flushed_blocks (buf_pool=0x3e1f128) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0lru.c:1102 #8 0x0000000000897216 in buf_LRU_try_free_flushed_blocks (buf_pool=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0lru.c:1099 #9 0x0000000000875ba8 in ibuf_should_try (ignore_sec_unique=0, index=0x7fd830096408) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/include/ibuf0ibuf.ic:138 #10 btr_cur_search_to_nth_level (index=0x7fd830096408, level=0, tuple=0x7fd8300da920, mode=4, latch_mode=2, cursor=0x7fd8e4260f70, has_search_latch=0, file=0xa7b900 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/row/row0ins.c", line=2025, mtr=0x7fd8e4260480) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/btr/btr0cur.c:609 #11 0x0000000000924a7f in row_ins_index_entry_low (mode=2, index=0x7fd830096408, entry=0x7fd8300da920, n_ext=0, thr=0x7fd8300d9de8) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/row/row0ins.c:2023 #12 0x000000000092702f in row_ins_index_entry (thr=0x7fd8300d9de8, entry=, index=0x7fd830096408, n_ext=, foreign=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/row/row0ins.c:2278 #13 row_ins_index_entry_step (thr=0x7fd8300d9de8, node=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/row/row0ins.c:2363 #14 row_ins (thr=0x7fd8300d9de8, node=0x7fd830096408) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/row/row0ins.c:2495 #15 row_ins_step (thr=0x7fd8300d9de8) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/row/row0ins.c:2612 #16 0x000000000081b8f6 in row_insert_for_mysql (mysql_rec=, prebuilt=0x7fd8300d8ca8) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/row/row0mysql.c:1255 #17 0x0000000000805d31 in ha_innobase::write_row (this=0x7fd8300d51e0, record=0x7fd8300d6e10 "") at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/handler/ha_innodb.cc:5911 #18 0x000000000068c5fd in handler::ha_write_row (this=0x7fd8300d51e0, buf=0x7fd8300d6e10 "") at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/handler.cc:5334 #19 0x0000000000729282 in Rows_log_event::write_row (this=0x7fd8300b8400, rli=0x74d8248, overwrite=false) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/log_event.cc:9143 #20 0x0000000000729562 in Write_rows_log_event::do_exec_row (this=0x7fd8300b8400, rli=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/log_event.cc:9302 #21 0x000000000072b452 in Rows_log_event::do_apply_event (this=0x7fd8300b8400, rli=0x74d8248) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/log_event.cc:7959 #22 0x000000000052abd5 in apply_event (rli=0x74d8248, this=0x7fd8300b8400) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/log_event.h:1143 #23 apply_event_and_update_pos (ev=0x7fd8300b8400, thd=, rli=0x74d8248) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/slave.cc:2400 #24 0x000000000052ef17 in exec_relay_log_event (thd=0x7fd830000990, rli=0x74d8248) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/slave.cc:2560 #25 0x0000000000530349 in handle_slave_sql (arg=0x74d6e90) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/slave.cc:3385 #26 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #27 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 3 (Thread 0x7fd8e4221700 (LWP 558)): #0 0x000000326ec0e0ad in read () from /lib64/libpthread.so.0 #1 0x000000000051e2b2 in my_real_read (net=0x74e4928, complen=0x7fd8e4220db8) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/net_serv.cc:832 #2 0x000000000051e5bc in my_net_read (net=0x74e4928) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/net_serv.cc:1029 #3 0x000000000058f3b8 in do_command (thd=0x74e46e0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_parse.cc:734 #4 0x0000000000629457 in do_handle_one_connection (thd_arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_connect.cc:1484 #5 0x0000000000629591 in handle_one_connection (arg=0x74e46e0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_connect.cc:1391 #6 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #7 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 2 (Thread 0x7fd8e41e0700 (LWP 559)): #0 0x000000326ec0b595 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x0000000000907ba1 in os_cond_wait (mutex=0x0, cond=0x3e1f920) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:207 #2 os_event_wait_low (event=0x3e1f8e0, reset_sig_count=1) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/os/os0sync.c:609 #3 0x000000000083f94f in sync_array_wait_event (arr=0x28e17e0, index=4) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/sync/sync0arr.c:458 #4 0x0000000000840b7c in mutex_spin_wait (mutex=0x3e1f260, file_name=0xa67e30 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0lru.c", line=1169) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/sync/sync0sync.c:653 #5 0x000000000089024e in mutex_enter_func (line=1169, file_name=0xa67e30 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0lru.c", mutex=0x3e1f260) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/include/sync0sync.ic:222 #6 pfs_mutex_enter_func (mutex=0x3e1f260, file_name=0xa67e30 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0lru.c", line=1169) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/include/sync0sync.ic:251 #7 0x0000000000891c69 in buf_LRU_get_free_only (buf_pool=0x3e1f128) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0lru.c:1169 #8 0x00000000008972dc in buf_LRU_get_free_block (buf_pool=0x3e1f128) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0lru.c:1282 #9 0x0000000000889197 in buf_page_init_for_read (err=0x7fd8e41dcc18, mode=132, space=15, zip_size=0, unzip=0, tablespace_version=33, offset=2) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0buf.c:3469 #10 0x0000000000897854 in buf_read_page_low (err=0x7fd8e41dcc18, sync=1, mode=, space=15, zip_size=0, unzip=, tablespace_version=33, offset=2, trx=0x0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0rea.c:165 #11 0x00000000008983c0 in buf_read_page (space=, zip_size=0, offset=2, trx=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0rea.c:452 #12 0x0000000000887d7b in buf_page_get_gen (space=15, zip_size=0, offset=2, rw_latch=2, guess=, mode=10, file=0xa6fb30 "/home/jenkins/workspace/percona-server-5.5-rpms/label_exp/centos6-64/target/BUILD/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/include/fut0fut.ic", line=51, mtr=0x7fd8e41dce90) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/buf/buf0buf.c:2590 #13 0x00000000008cbd35 in fut_get_ptr (mtr=, addr=..., zip_size=, space=, rw_latch=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/include/fut0fut.ic:51 #14 fseg_inode_try_get (header=, space=, zip_size=, mtr=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/fsp/fsp0fsp.c:2098 #15 0x00000000008cbeb8 in fseg_inode_get (mtr=0x7fd8e41dce90, zip_size=0, space=15, header=0x7fd8ddd88054 "") at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/fsp/fsp0fsp.c:2130 #16 fseg_n_reserved_pages (header=0x7fd8ddd88054 "", used=0x7fd8e41dce40, mtr=0x7fd8e41dce90) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/fsp/fsp0fsp.c:2465 #17 0x00000000008622a9 in btr_get_size (index=, flag=, mtr=0x7fd8e41dce90) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/btr/btr0btr.c:1080 #18 0x00000000008a9c16 in dict_update_statistics (table=0x7fd840008928, only_calc_if_missing_stats=, sync=0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/dict/dict0dict.c:4754 #19 0x00000000008adc67 in dict_table_get (table_name=, inc_mysql_count=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/dict/dict0dict.c:761 #20 0x000000000080223b in ha_innobase::open (this=0x7fd81c01c380, name=0x7fd81c018948 "./edm/bounce_event", mode=, test_if_locked=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/storage/innobase/handler/ha_innodb.cc:4537 #21 0x000000000068997e in handler::ha_open (this=0x7fd81c01c380, table_arg=, name=0x7fd81c018948 "./edm/bounce_event", mode=2, test_if_locked=2) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/handler.cc:2320 #22 0x00000000006041ec in open_table_from_share (thd=0x751ba20, share=, alias=, db_stat=39, prgflag=, ha_open_flags=0, outparam=0x7fd81c01baa0, is_create_table=false) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/table.cc:2064 #23 0x0000000000556083 in open_table (thd=0x751ba20, table_list=0x7fd81c00f128, mem_root=0x7fd8e41de230, ot_ctx=0x7fd8e41de270) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_base.cc:3122 #24 0x0000000000556d96 in open_and_process_table (new_frm_mem=0x7fd8e41de230, ot_ctx=0x7fd8e41de270, has_prelocking_list=false, prelocking_strategy=0x7fd8e41de790, flags=0, counter=0x7fd8e41de33c, tables=0x7fd81c00f128, lex=0x751d5f0, thd=0x751ba20) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_base.cc:4484 #25 open_tables (thd=0x751ba20, start=0x7fd8e41de318, counter=0x7fd8e41de33c, flags=0, prelocking_strategy=0x7fd8e41de790) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_base.cc:4932 #26 0x00000000005577e4 in open_and_lock_tables (thd=0x751ba20, tables=0x7fd81c009bc0, derived=true, flags=0, prelocking_strategy=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_base.cc:5529 #27 0x0000000000585964 in open_and_lock_tables (flags=0, derived=true, tables=0x7fd81c009bc0, thd=0x751ba20) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_base.h:475 #28 execute_sqlcom_select (thd=0x751ba20, all_tables=0x7fd81c009bc0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_parse.cc:4698 #29 0x0000000000589ff6 in mysql_execute_command (thd=0x751ba20) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_parse.cc:2284 #30 0x000000000058d9c3 in mysql_parse (thd=0x751ba20, rawbuf=, length=122803696, parser_state=0x7fd8e41dfba0) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_parse.cc:5811 #31 0x000000000058f022 in dispatch_command (command=COM_QUERY, thd=0x751ba20, packet=0x7fd81c004b90 "select\nsend_domain,\n-- email_domain,\n-- SUBSTRING(SUBSTRING_INDEX(template, '_', -1), 1, CHAR_LENGTH(SUBSTRING_INDEX(template, '_', -1))-4) intervaldays,\ndate(se.event_date),\ncount(distinct se.send_ev"..., packet_length=3827170440) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_parse.cc:1061 #32 0x0000000000629457 in do_handle_one_connection (thd_arg=) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_connect.cc:1484 #33 0x0000000000629591 in handle_one_connection (arg=0x751ba20) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/sql_connect.cc:1391 #34 0x000000326ec07d14 in start_thread () from /lib64/libpthread.so.0 #35 0x000000326e4f197d in clone () from /lib64/libc.so.6 Thread 1 (Thread 0x7fd8e637c740 (LWP 26737)): #0 0x000000326e4e8ecf in poll () from /lib64/libc.so.6 #1 0x0000000000516524 in handle_connections_sockets () at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/mysqld.cc:5361 #2 0x000000000051c798 in mysqld_main (argc=32, argv=0x28e1288) at /usr/src/debug/Percona-Server-5.5.27-rel28.0/Percona-Server-5.5.27-rel28.0/sql/mysqld.cc:4800 #3 0x000000326e421735 in __libc_start_main () from /lib64/libc.so.6 #4 0x00000000005118b9 in _start () []#