hakan@perro:~/work/monty_program/randgen> time perl runall.pl --basedir1=/home/hakan/work/monty_program/maria --engine=InnoDB --grammar=conf/optimizer_no_subquery.yy --queries=100000000 --threads=1 --duration=86400 # 20:19:50 Copyright (c) 2008 Sun Microsystems, Inc. All rights reserved. Use is subject to license terms. # 20:19:50 Please see http://forge.mysql.com/wiki/Category:RandomQueryGenerator for more information on this test framework. # 20:19:50 Starting # 20:19:50 # runall.pl \ # 20:19:50 # --basedir1=/home/hakan/work/monty_program/maria \ # 20:19:50 # --engine=InnoDB \ # 20:19:50 # --grammar=conf/optimizer_no_subquery.yy \ # 20:19:50 # --queries=100000000 \ # 20:19:50 # --threads=1 \ # 20:19:50 # --duration=86400 # 20:19:50 master_port : 19300 slave_port : 19302 master_ports : 19300 19302 MTR_BUILD_THREAD : 930 # 20:19:50 Running perl mysql-test-run.pl --start-and-exit --mysqld=--innodb --skip-ndb --mysqld=--core-file --mysqld=--loose-new --mysqld=--sql-mode=no_engine_substitution --mysqld=--relay-log=slave-relay-bin --mysqld=--loose-innodb --mysqld=--loose-falcon-debug-mask=2 --mysqld=--secure-file-priv= --mysqld=--max-allowed-packet=16Mb --mysqld=--loose-innodb-status-file=1 --mysqld=--master-retry-count=65535 --master_port=19300 1st 2>&1 . ======================================================= WARNING: Using mysql-test-run.pl version 1! ======================================================= Logging: lib/v1/mysql-test-run.pl --start-and-exit --mysqld=--innodb --skip-ndb --mysqld=--core-file --mysqld=--loose-new --mysqld=--sql-mode=no_engine_substitution --mysqld=--relay-log=slave-relay-bin --mysqld=--loose-innodb --mysqld=--loose-falcon-debug-mask=2 --mysqld=--secure-file-priv= --mysqld=--max-allowed-packet=16Mb --mysqld=--loose-innodb-status-file=1 --mysqld=--master-retry-count=65535 --master_port=19300 1st MySQL Version 5.1.42 Using dynamic switching of binlog format Skipping ndbcluster Setting mysqld to support SSL connections Using MTR_BUILD_THREAD = 930 Using MASTER_MYPORT = 19300 Using MASTER_MYPORT1 = 19301 Using SLAVE_MYPORT = 19302 Using SLAVE_MYPORT1 = 19303 Using SLAVE_MYPORT2 = 19304 Using IM_PORT = 19307 Using IM_MYSQLD1_PORT = 19308 Using IM_MYSQLD2_PORT = 19309 Killing Possible Leftover Processes Removing Stale Files Creating Directories Installing Master Database ======================================================= TEST RESULT TIME (ms) ------------------------------------------------------- Servers started, exiting # 20:19:54 Starting # 20:19:54 gentest.pl \ # 20:19:54 --gendata= \ # 20:19:54 --engine=InnoDB \ # 20:19:54 --threads=1 \ # 20:19:54 --queries=100000000 \ # 20:19:54 --duration=86400 \ # 20:19:54 --dsn=dbi:mysql:host=127.0.0.1:port=19300:user=root:database=test \ # 20:19:54 --grammar=conf/optimizer_no_subquery.yy # 20:19:54 ------------------------------- # 20:19:54 Configuration # 20:19:54 dsn => ['dbi:mysql:host=127.0.0.1:port=19300:user=root:database=test'] # 20:19:54 duration => 86400 # 20:19:54 engine => InnoDB # 20:19:54 gendata => # 20:19:54 grammar => conf/optimizer_no_subquery.yy # 20:19:54 queries => 100000000 # 20:19:54 reporters => [''] # 20:19:54 seed => 1 # 20:19:54 threads => 1 # 20:19:54 validators => [''] # 20:19:54 Default schema: test # 20:19:54 Creating MySQL table A, size 0 rows, engine InnoDB . # 20:19:54 Creating MySQL table B, size 1 rows, engine InnoDB . # 20:19:54 Creating MySQL table C, size 20 rows, engine InnoDB . # 20:19:54 Creating MySQL table D, size 100 rows, engine InnoDB . # 20:19:54 Creating MySQL table E, size 1000 rows, engine InnoDB . # 20:19:55 Creating MySQL table AA, size 0 rows, engine InnoDB . # 20:19:55 Creating MySQL table BB, size 1 rows, engine InnoDB . # 20:19:55 Creating MySQL table CC, size 20 rows, engine InnoDB . # 20:19:55 Creating MySQL table DD, size 100 rows, engine InnoDB . # 20:19:55 Reporters: ErrorLog, Backtrace # 20:19:55 Validators: ErrorMessageCorruption # 20:19:55 Starting 1 processes, 100000000 queries each, duration 86400 seconds. # 20:19:55 GenTest::ErrorFilter(17278) started # 20:19:55 Default schema: test # 20:19:55 Caching metadata for dbi:mysql:host=127.0.0.1:port=19300:user=root:database=test # 20:19:55 Started periodic reporting process... # 20:22:45 Query: SELECT table2 . `col_varchar_nokey` AS field1 FROM ( CC AS table1 RIGHT OUTER JOIN ( ( B AS table2 LEFT OUTER JOIN C AS table3 ON (table3 . `col_int_key` = table2 . `col_int_key` ) ) ) ON (( table3 . `col_varchar_key` = table2 . `col_varchar_key` ) OR ( table3 . `col_varchar_key` = table2 . `col_varchar_key` ) ) ) GROUP BY field1 HAVING field1 >= 66 failed: 2013 Lost connection to MySQL server during query # 20:22:45 Server crash reported at dsn dbi:mysql:host=127.0.0.1:port=19300:user=root:database=test # 20:22:46 Killing periodic reporting process with pid 17279... # 20:22:46 Kill GenTest::ErrorFilter(17278) # 20:22:46 Server crash reported, initiating post-crash analysis... # 20:22:46 The last 100 lines from /home/hakan/work/monty_program/maria/mysql-test/var/master-data/../log/master.err : CURRENT_TEST: main.1st 100211 21:19:52 [Note] PrimeBase XT (PBXT) Engine 1.0.09g RC loaded... 100211 21:19:52 [Note] Paul McCullagh, PrimeBase Technologies GmbH, http://www.primebase.org InnoDB: The InnoDB memory heap is disabled InnoDB: Mutexes and rw_locks use GCC atomic builtins InnoDB: The first specified data file ./ibdata1 did not exist: InnoDB: a new database to be created! 100211 21:19:52 InnoDB: Setting file ./ibdata1 size to 10 MB InnoDB: Database physically writes the file full: wait... 100211 21:19:53 InnoDB: Log file ./ib_logfile0 did not exist: new to be created InnoDB: Setting log file ./ib_logfile0 size to 5 MB InnoDB: Database physically writes the file full: wait... 100211 21:19:53 InnoDB: Log file ./ib_logfile1 did not exist: new to be created InnoDB: Setting log file ./ib_logfile1 size to 5 MB InnoDB: Database physically writes the file full: wait... InnoDB: Doublewrite buffer not found: creating new InnoDB: Doublewrite buffer created InnoDB: Creating foreign key constraint system tables InnoDB: Foreign key constraint system tables created 100211 21:19:54 InnoDB Plugin 1.0.6-9 started; log sequence number 0 100211 21:19:54 [Warning] /home/hakan/work/monty_program/maria/sql/mysqld: unknown option '--loose-skip-ndbcluster' 100211 21:19:54 [Warning] /home/hakan/work/monty_program/maria/sql/mysqld: unknown variable 'loose-falcon-debug-mask=2' 100211 21:19:54 [Note] Event Scheduler: Loaded 0 events 100211 21:19:54 [Note] /home/hakan/work/monty_program/maria/sql/mysqld: ready for connections. Version: '5.1.42-MariaDB-log' socket: '/home/hakan/work/monty_program/maria/mysql-test/var/tmp/master.sock' port: 19300 Source distribution 100211 21:22:42 - mysqld got signal 11 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. key_buffer_size=1048576 read_buffer_size=131072 max_used_connections=2 max_threads=153 threads_connected=2 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 61350 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. thd: 0x7fd9489089f0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x7fd937a22100 thread_stack 0x48000 /home/hakan/work/monty_program/maria/sql/mysqld(my_print_stacktrace+0x35)[0x9e9cb5] /home/hakan/work/monty_program/maria/sql/mysqld(handle_segfault+0x331)[0x618981] /lib64/libpthread.so.0[0x7fd95b630a90] /home/hakan/work/monty_program/maria/sql/mysqld[0x79a5d2] /home/hakan/work/monty_program/maria/sql/mysqld[0x79ad69] /home/hakan/work/monty_program/maria/sql/mysqld[0x79b07b] /home/hakan/work/monty_program/maria/sql/mysqld[0x68a79a] /home/hakan/work/monty_program/maria/sql/mysqld(_ZN4JOIN8optimizeEv+0x56b)[0x68c95b] /home/hakan/work/monty_program/maria/sql/mysqld(_Z12mysql_selectP3THDPPP4ItemP10TABLE_LISTjR4ListIS1_ES2_jP8st_orderSB_S2_SB_yP13select_resultP18st_select_lex_unitP13st_select_lex+0x94)[0x6950f4] /home/hakan/work/monty_program/maria/sql/mysqld(_Z13handle_selectP3THDP6st_lexP13select_resultm+0x171)[0x695c01] /home/hakan/work/monty_program/maria/sql/mysqld[0x626559] /home/hakan/work/monty_program/maria/sql/mysqld(_Z21mysql_execute_commandP3THD+0x1da0)[0x62b000] /home/hakan/work/monty_program/maria/sql/mysqld(_Z11mysql_parseP3THDPKcjPS2_+0x3b1)[0x62ee91] /home/hakan/work/monty_program/maria/sql/mysqld(_Z16dispatch_command19enum_server_commandP3THDPcj+0xe59)[0x62fcf9] /home/hakan/work/monty_program/maria/sql/mysqld(_Z10do_commandP3THD+0xee)[0x63056e] /home/hakan/work/monty_program/maria/sql/mysqld(handle_one_connection+0x1b9)[0x6221c9] /lib64/libpthread.so.0[0x7fd95b629070] /lib64/libc.so.6(clone+0x6d)[0x7fd95a6cf11d] Trying to get some variables. Some pointers may be invalid and cause the dump to abort... thd->query at 0x1eb9588 = SELECT table2 . `col_varchar_nokey` AS field1 FROM ( CC AS table1 RIGHT OUTER JOIN ( ( B AS table2 LEFT OUTER JOIN C AS table3 ON (table3 . `col_int_key` = table2 . `col_int_key` ) ) ) ON (( table3 . `col_varchar_key` = table2 . `col_varchar_key` ) OR ( table3 . `col_varchar_key` = table2 . `col_varchar_key` ) ) ) GROUP BY field1 HAVING field1 >= 66 thd->thread_id=6 thd->killed=NOT_KILLED The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains information that should help you find out what is causing the crash. Writing a core file # 20:22:46 datadir is /home/hakan/work/monty_program/maria/mysql-test/var/master-data/ # 20:22:46 binary is /home/hakan/work/monty_program/maria/mysql-test//../sql/mysqld # 20:22:46 bindir is /home/hakan/work/monty_program/maria/mysql-test/../sql # 20:22:46 core is /home/hakan/work/monty_program/maria/mysql-test/var/master-data//core.17246 warning: Can't read pathname for load map: Input/output error. Quitting: You can't do that without a process to debug. # 20:22:47 [New Thread 17248] # 20:22:47 [New Thread 17258] # 20:22:47 [New Thread 17256] # 20:22:47 [New Thread 17268] # 20:22:47 [New Thread 17267] # 20:22:47 [New Thread 17265] # 20:22:47 [New Thread 17271] # 20:22:47 [New Thread 17262] # 20:22:47 [New Thread 17269] # 20:22:47 [New Thread 17264] # 20:22:47 [New Thread 17266] # 20:22:47 [New Thread 17263] # 20:22:47 [New Thread 17261] # 20:22:47 [New Thread 17259] # 20:22:47 [New Thread 17260] # 20:22:47 [New Thread 17255] # 20:22:47 [New Thread 17257] # 20:22:47 [New Thread 17254] # 20:22:47 [New Thread 17246] # 20:22:47 [New Thread 17253] # 20:22:47 [New Thread 17249] # 20:22:47 [New Thread 17252] # 20:22:47 [New Thread 17251] # 20:22:47 Core was generated by `/home/hakan/work/monty_program/maria/sql/mysqld --no-defaults --basedir=/home/h'. # 20:22:47 Program terminated with signal 11, Segmentation fault. # 20:22:47 #0 0x00007fd95b62dc66 in pthread_kill () from /lib64/libpthread.so.0 # 20:22:47 #0 0x00007fd95b62dc66 in pthread_kill () from /lib64/libpthread.so.0 # 20:22:47 #1 0x00000000006189b5 in handle_segfault (sig=11) at mysqld.cc:2654 # 20:22:47 #2 # 20:22:47 #3 0x000000000079a5d2 in build_eq_mods_for_cond (ctx=0x7fd937a1f360, eq_mod=0x7fd937a1f5c0, and_level=0x7fd937a1f5cc, # 20:22:47 cond=0x1f391c8) at opt_table_elimination.cc:1315 # 20:22:47 #4 0x000000000079ad69 in check_func_dependency (join=, dep_tables=1, it=0x6, oj_tbl=0x1f51160, # 20:22:47 cond=0x1f391c8) at opt_table_elimination.cc:815 # 20:22:47 #5 0x000000000079b07b in eliminate_tables_for_list (join=0x1f47058, join_list=, list_tables=7, # 20:22:47 on_expr=0x0, tables_used_elsewhere=2) at opt_table_elimination.cc:715 # 20:22:47 #6 0x000000000068a79a in make_join_statistics (join=0x1f47058, tables_arg=0x1eb9df0, conds=0x0, keyuse_array=0x1f48620) # 20:22:47 at sql_select.cc:2708 # 20:22:47 #7 0x000000000068c95b in JOIN::optimize (this=0x1f47058) at sql_select.cc:988 # 20:22:47 #8 0x00000000006950f4 in mysql_select (thd=0x7fd9489089f0, rref_pointer_array=0x7fd94890aab8, tables=0x1eb9df0, # 20:22:47 wild_num=0, fields=@0x0, conds=0x0, og_num=1, order=0x0, group=0x1f39780, having=0x1f39928, proc_param=0x0, # 20:22:47 select_options=1, result=0x1f39b38, unit=0x7fd94890a4c0, select_lex=0x7fd94890a8e8) at sql_select.cc:2453 # 20:22:47 #9 0x0000000000695c01 in handle_select (thd=0x7fd9489089f0, lex=0x7fd94890a420, result=0x1f39b38, # 20:22:47 setup_tables_done_option=0) at sql_select.cc:279 # 20:22:47 #10 0x0000000000626559 in execute_sqlcom_select (thd=0x7fd9489089f0, all_tables=0x1eb9df0) at sql_parse.cc:5112 # 20:22:47 #11 0x000000000062b000 in mysql_execute_command (thd=0x7fd9489089f0) at sql_parse.cc:2297 # 20:22:47 #12 0x000000000062ee91 in mysql_parse (thd=0x7fd9489089f0, # 20:22:47 inBuf=0x1eb9588 "SELECT table2 . `col_varchar_nokey` AS field1 FROM ( CC AS table1 RIGHT OUTER JOIN ( ( B AS table2 LEFT OUTER JOIN C AS table3 ON (table3 . `col_int_key` = table2 . `col_int_key` ) ) ) ON (( table3"..., length=356, # 20:22:47 found_semicolon=0x7fd937a22060) at sql_parse.cc:6033 # 20:22:47 #13 0x000000000062fcf9 in dispatch_command (command=COM_QUERY, thd=0x7fd9489089f0, # 20:22:47 packet=0x7fd94890b371 " SELECT table2 . `col_varchar_nokey` AS field1 FROM ( CC AS table1 RIGHT OUTER JOIN ( ( B AS table2 LEFT OUTER JOIN C AS table3 ON (table3 . `col_int_key` = table2 . `col_int_key` ) ) ) ON (( table"..., # 20:22:47 packet_length=) at sql_parse.cc:1245 # 20:22:47 #14 0x000000000063056e in do_command (thd=0x7fd9489089f0) at sql_parse.cc:884 # 20:22:47 #15 0x00000000006221c9 in handle_one_connection (arg=) at sql_connect.cc:1131 # 20:22:47 #16 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:47 #17 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:47 #18 0x0000000000000000 in ?? () warning: Can't read pathname for load map: Input/output error. Quitting: You can't do that without a process to debug. # 20:22:48 [New Thread 17248] # 20:22:48 [New Thread 17258] # 20:22:48 [New Thread 17256] # 20:22:48 [New Thread 17268] # 20:22:48 [New Thread 17267] # 20:22:48 [New Thread 17265] # 20:22:48 [New Thread 17271] # 20:22:48 [New Thread 17262] # 20:22:48 [New Thread 17269] # 20:22:48 [New Thread 17264] # 20:22:48 [New Thread 17266] # 20:22:48 [New Thread 17263] # 20:22:48 [New Thread 17261] # 20:22:48 [New Thread 17259] # 20:22:48 [New Thread 17260] # 20:22:48 [New Thread 17255] # 20:22:48 [New Thread 17257] # 20:22:48 [New Thread 17254] # 20:22:48 [New Thread 17246] # 20:22:48 [New Thread 17253] # 20:22:48 [New Thread 17249] # 20:22:48 [New Thread 17252] # 20:22:48 [New Thread 17251] # 20:22:48 Core was generated by `/home/hakan/work/monty_program/maria/sql/mysqld --no-defaults --basedir=/home/h'. # 20:22:48 Program terminated with signal 11, Segmentation fault. # 20:22:48 #0 0x00007fd95b62dc66 in pthread_kill () from /lib64/libpthread.so.0 # 20:22:48 # 20:22:48 Thread 24 (Thread 17251): # 20:22:48 #0 0x00007fd95b62cfdd in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x00000000008a543e in xt_timed_wait_cond (self=0x1ba0250, cond=0x180df80, mutex=0xffffffffffffff92, milli_sec=100) # 20:22:48 at thread_xt.cc:1982 # 20:22:48 #2 0x00000000008af561 in xn_sw_main (self=0x1ba0250) at xaction_xt.cc:2779 # 20:22:48 #3 0x00000000008afba9 in xn_sw_run_thread (self=0x1ba0250) at xaction_xt.cc:2723 # 20:22:48 #4 0x00000000008a51e1 in thr_main_pbxt (data=) at thread_xt.cc:1037 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 23 (Thread 17252): # 20:22:48 #0 0x00007fd95b62cfdd in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x00000000008a543e in xt_timed_wait_cond (self=0x7fd9542034f0, cond=0x180e088, mutex=0xffffffffffffff92, # 20:22:48 milli_sec=120000) at thread_xt.cc:1982 # 20:22:48 #2 0x00000000008cb2b6 in dl_co_main (self=0x7fd9542034f0, once_off=0) at datalog_xt.cc:1709 # 20:22:48 #3 0x00000000008cb454 in dl_run_co_thread (self=0x7fd9542034f0) at datalog_xt.cc:2046 # 20:22:48 #4 0x00000000008a51e1 in thr_main_pbxt (data=) at thread_xt.cc:1037 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 22 (Thread 17249): # 20:22:48 #0 0x00007fd95b62cfdd in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x00000000008a543e in xt_timed_wait_cond (self=0x0, cond=0x176c218, mutex=0xffffffffffffff92, milli_sec=500) # 20:22:48 at thread_xt.cc:1982 # 20:22:48 #2 0x000000000089458e in tabc_fr_main (self=0x7fd954018970) at tabcache_xt.cc:844 # 20:22:48 #3 0x00000000008946dc in tabc_fr_run_thread (self=0x7fd954018970) at tabcache_xt.cc:1159 # 20:22:48 #4 0x00000000008a51e1 in thr_main_pbxt (data=) at thread_xt.cc:1037 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 21 (Thread 17253): # 20:22:48 #0 0x00007fd95b62cfdd in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x00000000008a543e in xt_timed_wait_cond (self=0x7fd954207870, cond=0x180e008, mutex=0xffffffffffffff92, # 20:22:48 milli_sec=500) at thread_xt.cc:1982 # 20:22:48 #2 0x00000000008b41ba in xlog_wr_wait_for_log_flush (self=0x7fd954207870, db=0x17cbed0) at xactlog_xt.cc:2386 # 20:22:48 #3 0x00000000008b46a6 in xlog_wr_main (self=0x7fd954207870) at xactlog_xt.cc:2583 # 20:22:48 #4 0x00000000008b4919 in xlog_wr_run_thread (self=0x7fd954207870) at xactlog_xt.cc:2608 # 20:22:48 #5 0x00000000008a51e1 in thr_main_pbxt (data=) at thread_xt.cc:1037 # 20:22:48 #6 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #7 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #8 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 20 (Thread 17246): # 20:22:48 #0 0x00007fd95a6c8672 in select () from /lib64/libc.so.6 # 20:22:48 #1 0x000000000061d14c in handle_connections_sockets (arg=) at mysqld.cc:5196 # 20:22:48 #2 0x000000000061dd7c in main (argc=, argv=) at mysqld.cc:4667 # 20:22:48 # 20:22:48 Thread 19 (Thread 17254): # 20:22:48 #0 0x00007fd95b62cfdd in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x00000000008a543e in xt_timed_wait_cond (self=0x7fd95420bbf0, cond=0x1821d70, mutex=0xffffffffffffff92, # 20:22:48 milli_sec=400) at thread_xt.cc:1982 # 20:22:48 #2 0x000000000088c454 in xres_cp_wait_for_log_writer (self=0x7fd95420bbf0, db=0x17cbed0, milli_secs=400) # 20:22:48 at restart_xt.cc:2513 # 20:22:48 #3 0x0000000000890421 in xres_cp_main (self=0x7fd95420bbf0) at restart_xt.cc:2590 # 20:22:48 #4 0x0000000000890632 in xres_cp_run_thread (self=0x7fd95420bbf0) at restart_xt.cc:2618 # 20:22:48 #5 0x00000000008a51e1 in thr_main_pbxt (data=) at thread_xt.cc:1037 # 20:22:48 #6 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #7 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #8 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 18 (Thread 17257): # 20:22:48 #0 0x00007fd95b62cd59 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x0000000000907685 in os_event_wait_low (event=0x7fd948423a60, reset_sig_count=1) at os/os0sync.c:399 # 20:22:48 #2 0x00000000009052ba in os_aio_simulated_handle (global_segment=2, message1=0x7fd93dcca0f0, message2=0x7fd93dcca0e8, # 20:22:48 type=0x7fd93dcca0e0) at os/os0file.c:4318 # 20:22:48 #3 0x00000000009ab658 in fil_aio_wait (segment=2) at fil/fil0fil.c:4852 # 20:22:48 #4 0x0000000000948195 in io_handler_thread (arg=) at srv/srv0start.c:492 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 17 (Thread 17255): # 20:22:48 #0 0x00007fd95b62cd59 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x0000000000907685 in os_event_wait_low (event=0x7fd948423960, reset_sig_count=1) at os/os0sync.c:399 # 20:22:48 #2 0x00000000009052ba in os_aio_simulated_handle (global_segment=0, message1=0x7fd93eccc0f0, message2=0x7fd93eccc0e8, # 20:22:48 type=0x7fd93eccc0e0) at os/os0file.c:4318 # 20:22:48 #3 0x00000000009ab658 in fil_aio_wait (segment=0) at fil/fil0fil.c:4852 # 20:22:48 #4 0x0000000000948195 in io_handler_thread (arg=) at srv/srv0start.c:492 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 16 (Thread 17260): # 20:22:48 #0 0x00007fd95b62cd59 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x0000000000907685 in os_event_wait_low (event=0x7fd948423be0, reset_sig_count=1) at os/os0sync.c:399 # 20:22:48 #2 0x00000000009052ba in os_aio_simulated_handle (global_segment=5, message1=0x7fd93c4c70f0, message2=0x7fd93c4c70e8, # 20:22:48 type=0x7fd93c4c70e0) at os/os0file.c:4318 # 20:22:48 #3 0x00000000009ab658 in fil_aio_wait (segment=5) at fil/fil0fil.c:4852 # 20:22:48 #4 0x0000000000948195 in io_handler_thread (arg=) at srv/srv0start.c:492 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 15 (Thread 17259): # 20:22:48 #0 0x00007fd95b62cd59 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x0000000000907685 in os_event_wait_low (event=0x7fd948423b60, reset_sig_count=1) at os/os0sync.c:399 # 20:22:48 #2 0x00000000009052ba in os_aio_simulated_handle (global_segment=4, message1=0x7fd93ccc80f0, message2=0x7fd93ccc80e8, # 20:22:48 type=0x7fd93ccc80e0) at os/os0file.c:4318 # 20:22:48 #3 0x00000000009ab658 in fil_aio_wait (segment=4) at fil/fil0fil.c:4852 # 20:22:48 #4 0x0000000000948195 in io_handler_thread (arg=) at srv/srv0start.c:492 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 14 (Thread 17261): # 20:22:48 #0 0x00007fd95b62cd59 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x0000000000907685 in os_event_wait_low (event=0x7fd948423c60, reset_sig_count=18) at os/os0sync.c:399 # 20:22:48 #2 0x00000000009052ba in os_aio_simulated_handle (global_segment=6, message1=0x7fd93bcc60f0, message2=0x7fd93bcc60e8, # 20:22:48 type=0x7fd93bcc60e0) at os/os0file.c:4318 # 20:22:48 #3 0x00000000009ab658 in fil_aio_wait (segment=6) at fil/fil0fil.c:4852 # 20:22:48 #4 0x0000000000948195 in io_handler_thread (arg=) at srv/srv0start.c:492 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 13 (Thread 17263): # 20:22:48 #0 0x00007fd95b62cd59 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x0000000000907685 in os_event_wait_low (event=0x7fd948423d60, reset_sig_count=18) at os/os0sync.c:399 # 20:22:48 #2 0x00000000009052ba in os_aio_simulated_handle (global_segment=8, message1=0x7fd93acc40f0, message2=0x7fd93acc40e8, # 20:22:48 type=0x7fd93acc40e0) at os/os0file.c:4318 # 20:22:48 #3 0x00000000009ab658 in fil_aio_wait (segment=8) at fil/fil0fil.c:4852 # 20:22:48 #4 0x0000000000948195 in io_handler_thread (arg=) at srv/srv0start.c:492 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 12 (Thread 17266): # 20:22:48 #0 0x00007fd95a6c8672 in select () from /lib64/libc.so.6 # 20:22:48 #1 0x000000000090823f in os_thread_sleep (tm=) at os/os0thread.c:295 # 20:22:48 #2 0x0000000000942e67 in srv_error_monitor_thread (arg=) at srv/srv0srv.c:2450 # 20:22:48 #3 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #4 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #5 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 11 (Thread 17264): # 20:22:48 #0 0x00007fd95b62cd59 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x0000000000907685 in os_event_wait_low (event=0x7fd948423de0, reset_sig_count=18) at os/os0sync.c:399 # 20:22:48 #2 0x00000000009052ba in os_aio_simulated_handle (global_segment=9, message1=0x7fd93a4c30f0, message2=0x7fd93a4c30e8, # 20:22:48 type=0x7fd93a4c30e0) at os/os0file.c:4318 # 20:22:48 #3 0x00000000009ab658 in fil_aio_wait (segment=9) at fil/fil0fil.c:4852 # 20:22:48 #4 0x0000000000948195 in io_handler_thread (arg=) at srv/srv0start.c:492 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 10 (Thread 17269): # 20:22:48 #0 0x00007fd95b630767 in do_sigwait () from /lib64/libpthread.so.0 # 20:22:48 #1 0x00007fd95b63080d in sigwait () from /lib64/libpthread.so.0 # 20:22:48 #2 0x0000000000618433 in signal_hand (arg=) at mysqld.cc:2858 # 20:22:48 #3 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #4 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #5 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 9 (Thread 17262): # 20:22:48 #0 0x00007fd95b62cd59 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x0000000000907685 in os_event_wait_low (event=0x7fd948423ce0, reset_sig_count=18) at os/os0sync.c:399 # 20:22:48 #2 0x00000000009052ba in os_aio_simulated_handle (global_segment=7, message1=0x7fd93b4c50f0, message2=0x7fd93b4c50e8, # 20:22:48 type=0x7fd93b4c50e0) at os/os0file.c:4318 # 20:22:48 #3 0x00000000009ab658 in fil_aio_wait (segment=7) at fil/fil0fil.c:4852 # 20:22:48 #4 0x0000000000948195 in io_handler_thread (arg=) at srv/srv0start.c:492 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 8 (Thread 17271): # 20:22:48 #0 0x00007fd95b62f87b in read () from /lib64/libpthread.so.0 # 20:22:48 #1 0x000000000060c2a7 in my_real_read (net=0x7fd9488be3e8, complen=0x7fd937a6a070) at net_serv.cc:822 # 20:22:48 #2 0x000000000060c8d4 in my_net_read (net=0x24) at net_serv.cc:1010 # 20:22:48 #3 0x0000000000630500 in do_command (thd=0x7fd9488be300) at sql_parse.cc:826 # 20:22:48 #4 0x00000000006221c9 in handle_one_connection (arg=) at sql_connect.cc:1131 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 7 (Thread 17265): # 20:22:48 #0 0x00007fd95a6c8672 in select () from /lib64/libc.so.6 # 20:22:48 #1 0x000000000090823f in os_thread_sleep (tm=) at os/os0thread.c:295 # 20:22:48 #2 0x0000000000945645 in srv_lock_timeout_and_monitor_thread (arg=) at srv/srv0srv.c:2214 # 20:22:48 #3 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #4 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #5 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 6 (Thread 17267): # 20:22:48 #0 0x00007fd95a6c8672 in select () from /lib64/libc.so.6 # 20:22:48 #1 0x000000000090823f in os_thread_sleep (tm=) at os/os0thread.c:295 # 20:22:48 #2 0x000000000094422a in srv_master_thread (arg=) at srv/srv0srv.c:2607 # 20:22:48 #3 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #4 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #5 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 5 (Thread 17268): # 20:22:48 #0 0x00007fd95a6c8672 in select () from /lib64/libc.so.6 # 20:22:48 #1 0x000000000090823f in os_thread_sleep (tm=) at os/os0thread.c:295 # 20:22:48 #2 0x0000000000945b01 in srv_purge_thread (arg=) at srv/srv0srv.c:3192 # 20:22:48 #3 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #4 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #5 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 4 (Thread 17256): # 20:22:48 #0 0x00007fd95b62cd59 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x0000000000907685 in os_event_wait_low (event=0x7fd9484239e0, reset_sig_count=23) at os/os0sync.c:399 # 20:22:48 #2 0x00000000009052ba in os_aio_simulated_handle (global_segment=1, message1=0x7fd93e4cb0f0, message2=0x7fd93e4cb0e8, # 20:22:48 type=0x7fd93e4cb0e0) at os/os0file.c:4318 # 20:22:48 #3 0x00000000009ab658 in fil_aio_wait (segment=1) at fil/fil0fil.c:4852 # 20:22:48 #4 0x0000000000948195 in io_handler_thread (arg=) at srv/srv0start.c:492 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 3 (Thread 17258): # 20:22:48 #0 0x00007fd95b62cd59 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x0000000000907685 in os_event_wait_low (event=0x7fd948423ae0, reset_sig_count=1) at os/os0sync.c:399 # 20:22:48 #2 0x00000000009052ba in os_aio_simulated_handle (global_segment=3, message1=0x7fd93d4c90f0, message2=0x7fd93d4c90e8, # 20:22:48 type=0x7fd93d4c90e0) at os/os0file.c:4318 # 20:22:48 #3 0x00000000009ab658 in fil_aio_wait (segment=3) at fil/fil0fil.c:4852 # 20:22:48 #4 0x0000000000948195 in io_handler_thread (arg=) at srv/srv0start.c:492 # 20:22:48 #5 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #6 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #7 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 2 (Thread 17248): # 20:22:48 #0 0x00007fd95b62cfdd in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 # 20:22:48 #1 0x0000000000865673 in ma_checkpoint_background (arg=) at ma_checkpoint.c:715 # 20:22:48 #2 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #3 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #4 0x0000000000000000 in ?? () # 20:22:48 # 20:22:48 Thread 1 (Thread 17281): # 20:22:48 #0 0x00007fd95b62dc66 in pthread_kill () from /lib64/libpthread.so.0 # 20:22:48 #1 0x00000000006189b5 in handle_segfault (sig=11) at mysqld.cc:2654 # 20:22:48 #2 # 20:22:48 #3 0x000000000079a5d2 in build_eq_mods_for_cond (ctx=0x7fd937a1f360, eq_mod=0x7fd937a1f5c0, and_level=0x7fd937a1f5cc, # 20:22:48 cond=0x1f391c8) at opt_table_elimination.cc:1315 # 20:22:48 #4 0x000000000079ad69 in check_func_dependency (join=, dep_tables=1, it=0x6, oj_tbl=0x1f51160, # 20:22:48 cond=0x1f391c8) at opt_table_elimination.cc:815 # 20:22:48 #5 0x000000000079b07b in eliminate_tables_for_list (join=0x1f47058, join_list=, list_tables=7, # 20:22:48 on_expr=0x0, tables_used_elsewhere=2) at opt_table_elimination.cc:715 # 20:22:48 #6 0x000000000068a79a in make_join_statistics (join=0x1f47058, tables_arg=0x1eb9df0, conds=0x0, keyuse_array=0x1f48620) # 20:22:48 at sql_select.cc:2708 # 20:22:48 #7 0x000000000068c95b in JOIN::optimize (this=0x1f47058) at sql_select.cc:988 # 20:22:48 #8 0x00000000006950f4 in mysql_select (thd=0x7fd9489089f0, rref_pointer_array=0x7fd94890aab8, tables=0x1eb9df0, # 20:22:48 wild_num=0, fields=@0x0, conds=0x0, og_num=1, order=0x0, group=0x1f39780, having=0x1f39928, proc_param=0x0, # 20:22:48 select_options=1, result=0x1f39b38, unit=0x7fd94890a4c0, select_lex=0x7fd94890a8e8) at sql_select.cc:2453 # 20:22:48 #9 0x0000000000695c01 in handle_select (thd=0x7fd9489089f0, lex=0x7fd94890a420, result=0x1f39b38, # 20:22:48 setup_tables_done_option=0) at sql_select.cc:279 # 20:22:48 #10 0x0000000000626559 in execute_sqlcom_select (thd=0x7fd9489089f0, all_tables=0x1eb9df0) at sql_parse.cc:5112 # 20:22:48 #11 0x000000000062b000 in mysql_execute_command (thd=0x7fd9489089f0) at sql_parse.cc:2297 # 20:22:48 #12 0x000000000062ee91 in mysql_parse (thd=0x7fd9489089f0, # 20:22:48 inBuf=0x1eb9588 "SELECT table2 . `col_varchar_nokey` AS field1 FROM ( CC AS table1 RIGHT OUTER JOIN ( ( B AS table2 LEFT OUTER JOIN C AS table3 ON (table3 . `col_int_key` = table2 . `col_int_key` ) ) ) ON (( table3"..., length=356, # 20:22:48 found_semicolon=0x7fd937a22060) at sql_parse.cc:6033 # 20:22:48 #13 0x000000000062fcf9 in dispatch_command (command=COM_QUERY, thd=0x7fd9489089f0, # 20:22:48 packet=0x7fd94890b371 " SELECT table2 . `col_varchar_nokey` AS field1 FROM ( CC AS table1 RIGHT OUTER JOIN ( ( B AS table2 LEFT OUTER JOIN C AS table3 ON (table3 . `col_int_key` = table2 . `col_int_key` ) ) ) ON (( table"..., # 20:22:48 packet_length=) at sql_parse.cc:1245 # 20:22:48 #14 0x000000000063056e in do_command (thd=0x7fd9489089f0) at sql_parse.cc:884 # 20:22:48 #15 0x00000000006221c9 in handle_one_connection (arg=) at sql_connect.cc:1131 # 20:22:48 #16 0x00007fd95b629070 in start_thread () from /lib64/libpthread.so.0 # 20:22:48 #17 0x00007fd95a6cf11d in clone () from /lib64/libc.so.6 # 20:22:48 #18 0x0000000000000000 in ?? () # 20:22:48 Test completed with failure status 101. # 20:22:48 gentest.pl exited with exit status 101 Thu Feb 11 20:22:48 2010 [17221] runall.pl will exit with exit status 101