Failing assertion: (len % OS_FILE_LOG_BLOCK_SIZE) == 0 in file fil0fil.c line 5390

[Roel Van de Paar]

========================= Error log:
130202 6:26:25 [Note] /ssd/Percona-Server-5.5.28-rel29.3-422.Linux.x86_64/bin/mysqld: ready for connections.
Version: '5.5.29-rel29.3-log' socket: '/ssd/683176/current1_1/tmp/master.sock' port: 13000 Percona Server with XtraDB (GPL), Release rel29.3, Revision 422
130202 6:26:27 InnoDB: Assertion failure in thread 140313290897152 in file fil0fil.c line 5390
InnoDB: Failing assertion: (len % OS_FILE_LOG_BLOCK_SIZE) == 0

========================= gdb :
Thread 1 (LWP 14886):
+bt
#0 0x00007f9d5474469c in pthread_kill () from /lib64/libpthread.so.0
#1 0x000000000068836e in handle_fatal_signal (sig=6) at /ssd/QA-16724-5.5-2/Percona-Server-5.5.28-rel29.3/sql/signal_handler.cc:249
#2 <signal handler called>
#3 0x00007f9d5390f8a5 in raise () from /lib64/libc.so.6
#4 0x00007f9d53911085 in abort () from /lib64/libc.so.6
#5 0x000000000089db4a in _fil_io (type=11, sync=<optimized out>, space_id=11, zip_size=8192, block_offset=<optimized out>, byte_offset=0, len=8192, buf=0x7f9d4abc6000, message=0x7f9d43f72400, trx=0x0) at /ssd/QA-16724-5.5-2/Percona-Server-5.5.28-rel29.3/storage/innobase/fil/fil0fil.c:5390
#6 0x000000000086ceeb in buf_flush_buffered_writes () at /ssd/QA-16724-5.5-2/Percona-Server-5.5.28-rel29.3/storage/innobase/buf/buf0flu.c:926
#7 0x000000000086e802 in buf_flush_post_to_doublewrite_buf (bpage=<optimized out>) at /ssd/QA-16724-5.5-2/Percona-Server-5.5.28-rel29.3/storage/innobase/buf/buf0flu.c:999
#8 buf_flush_write_block_low (bpage=0x7f9d43f710c0) at /ssd/QA-16724-5.5-2/Percona-Server-5.5.28-rel29.3/storage/innobase/buf/buf0flu.c:1181
#9 buf_flush_page (flush_type=BUF_FLUSH_LIST, bpage=0x7f9d43f710c0, buf_pool=0x2a18538) at /ssd/QA-16724-5.5-2/Percona-Server-5.5.28-rel29.3/storage/innobase/buf/buf0flu.c:1391
#10 buf_flush_try_neighbors (n_to_flush=490, n_flushed=127, flush_type=BUF_FLUSH_LIST, offset=8, space=<optimized out>) at /ssd/QA-16724-5.5-2/Percona-Server-5.5.28-rel29.3/storage/innobase/buf/buf0flu.c:1538
#11 buf_flush_page_and_try_neighbors (bpage=0x7f9d3bdc6408, flush_type=BUF_FLUSH_LIST, n_to_flush=490, count=0x7f9d3bdc65e8) at /ssd/QA-16724-5.5-2/Percona-Server-5.5.28-rel29.3/storage/innobase/buf/buf0flu.c:1625
#12 0x000000000086ee47 in buf_flush_flush_list_batch (lsn_limit=25344115, min_n=490, buf_pool=0x2a18538) at /ssd/QA-16724-5.5-2/Percona-Server-5.5.28-rel29.3/storage/innobase/buf/buf0flu.c:1765
#13 buf_flush_batch (buf_pool=0x2a18538, flush_type=<optimized out>, min_n=490, lsn_limit=25344115) at /ssd/QA-16724-5.5-2/Percona-Server-5.5.28-rel29.3/storage/innobase/buf/buf0flu.c:1856
#14 0x000000000086f23d in buf_flush_list (min_n=490, lsn_limit=25344115) at /ssd/QA-16724-5.5-2/Percona-Server-5.5.28-rel29.3/storage/innobase/buf/buf0flu.c:2073
#15 0x00000000008189b2 in srv_master_thread (arg=<optimized out>) at /ssd/QA-16724-5.5-2/Percona-Server-5.5.28-rel29.3/storage/innobase/srv/srv0srv.c:3520
#16 0x00007f9d5473f851 in start_thread () from /lib64/libpthread.so.0
#17 0x00007f9d539c511d in clone () from /lib64/libc.so.6

========================= Run details:
[roel@macpro1 683176]$ cat cmd97
ps -ef | grep 'cmdrun_97' | grep -v grep | awk '{print $2}' | xargs sudo kill -9
rm -Rf /ssd/683176/cmdrun_97
mkdir /ssd/683176/cmdrun_97
cd /ssd/randgen
bash -c "set -o pipefail; perl runall.pl --queries=100000000 --seed=29268 --duration=200 --querytimeout=60 --short_column_names --reporter=Shutdown,Backtrace,QueryTimeout,ErrorLog,ErrorLogAlarm --mysqld=--log-output=none --mysqld=--sql_mode=ONLY_FULL_GROUP_BY --grammar=conf/percona_qa/percona_qa.yy --gendata=conf/percona_qa/percona_qa.zz --basedir=/ssd/Percona-Server-5.5.28-rel29.3-422.Linux.x86_64 --threads=25 --views --notnull --mysqld=--innodb_track_changed_pages=0 --mysqld=--innodb_changed_pages=FORCE --mysqld=--innodb_max_changed_pages=1000 --mysqld=--innodb_log_file_size=1048576 --mysqld=--innodb_log_files_in_group=10 --mysqld=--innodb_log_buffer_size=10485761 --mysqld=--innodb_log_block_size=16384 --mysqld=--innodb_file_per_table=1 --mysqld=--innodb_file_format=barracuda --mtr-build-thread=715 --mask=42783 --vardir1=/ssd/683176/cmdrun_97 > /ssd/683176/cmdrun97.log 2>&1"

========================= Notes:
QA Blocking; seen very regularly in optimized build (and only in optimized so far!)

[Roel Van de Paar (roel11)]

--innodb_log_block_size=16384 related?