InnoDB: Failing assertion: bitmap_files->files[0].seq_num == first_file_seq_num in file log0online.cc line 1423 | abort in log_online_setup_bitmap_file_range
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
| Percona Server moved to https://jira.percona.com/projects/PS |
Fix Released
|
Medium
|
Laurynas Biveinis | |
| 5.1 |
Fix Released
|
Medium
|
Laurynas Biveinis | |
| 5.5 |
Fix Released
|
Medium
|
Laurynas Biveinis | |
| 5.6 |
Fix Released
|
Medium
|
Laurynas Biveinis |
Bug Description
Thread 22 (LWP 19785):
+bt
#0 0x0000003fde20c69c in pthread_kill () from /lib64/
#1 0x00000000006e711d in handle_fatal_signal (sig=6) at /bzr/5.
#2 <signal handler called>
#3 0x0000003fdde328a5 in raise () from /lib64/libc.so.6
#4 0x0000003fdde34085 in abort () from /lib64/libc.so.6
#5 0x0000000000a33032 in log_online_
#6 0x0000000000a338de in log_online_
#7 0x00000000009ff958 in i_s_innodb_
#8 0x000000000079af4d in do_fill_table (thd=0x1ff69950, table_list=
#9 0x000000000079b236 in get_schema_
#10 0x0000000000793135 in JOIN::prepare_
#11 0x000000000074b6aa in JOIN::exec (this=0x1944ac20) at /bzr/5.
#12 0x0000000000793548 in mysql_execute_
#13 0x0000000000793ca4 in mysql_select (thd=0x1ff69950, tables=0x1944a080, wild_num=0, fields=..., conds=<optimized out>, order=0x1ff6c5e0, group=0x1ff6c518, having=0x0, select_
#14 0x0000000000793e78 in handle_select (thd=0x1ff69950, result=0x1944abf8, setup_tables_
#15 0x0000000000768dad in execute_
#16 0x000000000076b307 in mysql_execute_
#17 0x0000000000770408 in mysql_parse (thd=0x1ff69950, rawbuf=0x1ff69958 "\240\244?\001", length=<optimized out>, parser_
#18 0x0000000000770ede in dispatch_command (command=<optimized out>, thd=0x1ff69950, packet=<optimized out>, packet_
#19 0x0000000000771b60 in do_command (thd=0x1ff69950) at /bzr/5.
#20 0x000000000073c48f in do_handle_
#21 0x000000000073c550 in handle_
#22 0x00000000009c8e59 in pfs_spawn_thread (arg=0x1fd35270) at /bzr/5.
#23 0x0000003fde207851 in start_thread () from /lib64/
#24 0x0000003fddee890d in clone () from /lib64/libc.so.6
Related branches
- Vlad Lesin (community): Approve (g2) on 2013-09-26
- Registry Administrators: Pending requested 2013-09-25
-
Diff: 158 lines (+73/-7)4 files modifiedPercona-Server/mysql-test/suite/innodb_plugin/r/percona_changed_page_bmp_debug.result (+6/-0)
Percona-Server/mysql-test/suite/innodb_plugin/t/percona_changed_page_bmp_debug.test (+31/-0)
Percona-Server/storage/innodb_plugin/handler/i_s.cc (+2/-0)
Percona-Server/storage/innodb_plugin/log/log0online.c (+34/-7)
- Vlad Lesin (community): Approve (g2) on 2013-09-26
- Registry Administrators: Pending requested 2013-09-25
-
Diff: 158 lines (+73/-7)4 files modifiedPercona-Server/mysql-test/suite/innodb/r/percona_changed_page_bmp_debug.result (+6/-0)
Percona-Server/mysql-test/suite/innodb/t/percona_changed_page_bmp_debug.test (+31/-0)
Percona-Server/storage/innobase/handler/i_s.cc (+2/-0)
Percona-Server/storage/innobase/log/log0online.c (+34/-7)
- Vlad Lesin (community): Approve on 2013-09-26
- Registry Administrators: Pending requested 2013-09-25
-
Diff: 158 lines (+73/-7)4 files modifiedPercona-Server/mysql-test/suite/innodb/r/percona_changed_page_bmp_debug.result (+6/-0)
Percona-Server/mysql-test/suite/innodb/t/percona_changed_page_bmp_debug.test (+31/-0)
Percona-Server/storage/innobase/handler/i_s.cc (+2/-0)
Percona-Server/storage/innobase/log/log0online.cc (+34/-7)
Roel Van de Paar (roel11) wrote : | #1 |
Roel Van de Paar (roel11) wrote : | #2 |
Roel Van de Paar (roel11) wrote : | #3 |
Roel Van de Paar (roel11) wrote : | #4 |
Will probably push a diagnostic branch for this one.
tags: | added: xtradb |
Roel Van de Paar (roel11) wrote : | #6 |
Ack. Alexey; scripts to try and reproduce from original trials which produces this:
[roel@qaserver 980213]$ cat cmd50
ps -ef | grep 'cmdrun_50' | grep -v grep | awk '{print $2}' | xargs sudo kill -9
rm -Rf /ssd/980213/
mkdir /ssd/980213/
cd /ssd/randgen
bash -c "set -o pipefail; perl runall.pl --queries=100000000 --seed=13641 --duration=120 --querytimeout=60 --short_
[roel@qaserver 980213]$ cat cmd501
ps -ef | grep 'cmdrun_501' | grep -v grep | awk '{print $2}' | xargs sudo kill -9
rm -Rf /ssd/980213/
mkdir /ssd/980213/
cd /ssd/randgen
bash -c "set -o pipefail; perl runall.pl --queries=100000000 --seed=9892 --duration=120 --querytimeout=60 --short_
tags: | added: 56qual |
Roel Van de Paar (roel11) wrote : | #12 |
Seen in 5.6-QA tree @ 18/9/13 also.
Roel Van de Paar (roel11) wrote : | #14 |
PS @ Percona-
RQG @ 911 <email address hidden>
Roel Van de Paar (roel11) wrote : | #15 |
Roel Van de Paar (roel11) wrote : | #16 |
Roel Van de Paar (roel11) wrote : | #17 |
Roel Van de Paar (roel11) wrote : | #18 |
Roel Van de Paar (roel11) wrote : | #19 |
Roel Van de Paar (roel11) wrote : | #20 |
Roel Van de Paar (roel11) wrote : | #21 |
This is caused by a race condition between the two bitmap file enumeration passes in log_online_
For release builds this is not an issue as missing bitmap files will be detected and diagnosed on their open attempts, as fixed by bug 1179974. The current bug shows that the fix for the latter was incomplete.
This code is shared with XtraBackup thus at least theoretically (haven't checked) the issue might appear there as well.
Err, in the above s/(haven't checked)/(haven't checked whether the debug build actually crashes)
I had completely forgotten about bug 1204075, which is exact same issue and was fixed in XtraBackup first. Funnily when I checked XB sources five days ago, I forgot to update them first too.
Thus now there are two different fixes for this issue in the source shared between XB and PS, one merged to XB in 1204075, and one proposed for PS here. I am not sure how to best handle this situation. The current fix seems to be better and suitable for XB eventually as well. Thus if nobody objects I will remove XB from this bug and PS from bug 1204075.
no longer affects: | percona-xtrabackup |
Roel Van de Paar (roel11) wrote : | #25 |
See bug 1234477
Percona now uses JIRA for bug reports so this bug report is migrated to: https:/
Ignore the Valgrind error, this is dealt with in bug 1191582