Failing assertion: byte_offset % OS_MIN_LOG_BLOCK_SIZE == 0, lsn_offset = 18446744073709551615

Bug #1464608 reported by Nickolay Ihalainen
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Percona XtraBackup moved to https://jira.percona.com/projects/PXB
Fix Released
High
Sergei Glushchenko
2.2
Fix Released
High
Sergei Glushchenko
2.3
Fix Released
High
Sergei Glushchenko

Bug Description

Innodb crashed with byte_offset assertion.
The problem happens frequently, on production system on different servers.
Stack traces for all crashes looks the same.

>> log scanned up to (42328340833337)
.....
>> log scanned up to (42330971311766)
2015-05-28 17:19:19 7fd277a56700 InnoDB: Assertion failure in thread 140541927188224 in file fil0fil.cc line 5708
InnoDB: Failing assertion: byte_offset % OS_MIN_LOG_BLOCK_SIZE == 0
InnoDB: We intentionally generate a memory trap.
InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
InnoDB: If you get repeated assertion failures or crashes, even
InnoDB: immediately after the mysqld startup, there may be
InnoDB: corruption in the InnoDB tablespace. Please refer to
InnoDB: http://dev.mysql.com/doc/refman/5.6/en/forcing-innodb-recovery.html
InnoDB: about forcing recovery.
17:19:19 UTC - xtrabackup got signal 6 ;
This could be because you hit a bug or data is corrupted.
This error can also be caused by malfunctioning hardware.
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed,
something is definitely wrong and this may fail.

Thread pointer: 0x7fd2700008c0
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 0 thread_stack 0x10000
xtrabackup(my_print_stacktrace+0x24) [0x8ee674]
xtrabackup(handle_fatal_signal+0x254) [0x72ff34]
/lib/x86_64-linux-gnu/libpthread.so.0(+0xfcb0) [0x7fd27d625cb0]
/lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7fd27bb9a0d5]
/lib/x86_64-linux-gnu/libc.so.6(abort+0x17b) [0x7fd27bb9d83b]
xtrabackup(fil_io(unsigned long, bool, unsigned long, unsigned long, unsigned long, unsigned long, unsigned long, void*, void*)+0x6d5) [0x671a15]
xtrabackup(log_group_read_log_seg(unsigned long, unsigned char*, log_group_t*, unsigned long, unsigned long)+0xd4) [0x6bc544]
xtrabackup() [0x5a2513]
xtrabackup() [0x5a2963]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a) [0x7fd27d61de9a]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7fd27bc578bd]

(gdb) p *group
$5 = {id = 0, n_files = 4, file_size = 1572864000, space_id = 4294967280, state = 301, lsn = 42719209766745, lsn_offset = 18446744073709551615,
lsn_offset_alt = 18446744073709551615, alt_offset_chosen = 1, n_pending_writes = 0, file_header_bufs_ptr = 0x2cd0ef8, file_header_bufs = 0x2cd0f88,
archive_file_header_bufs_ptr = 0x2cd1018, archive_file_header_bufs = 0x2cd10a8, archive_space_id = 4294967281, archived_file_no = 65536,
archived_offset = 0, next_archived_file_no = 0, next_archived_offset = 0, scanned_lsn = 42721970977879, checkpoint_buf_ptr = 0x2cf94b8 "",
checkpoint_buf = 0x2cfa000 "", log_groups = {prev = 0x0, next = 0x0}}

Tags: i54822 i56050
Revision history for this message
Nickolay Ihalainen (ihanick) wrote :

(gdb) bt
#0 0x00007f53050b9f8c in pthread_kill () from ./lib/x86_64-linux-gnu/libpthread.so.0
#1 0x000000000072fedc in handle_fatal_signal (sig=6)
    at /mnt/workspace/percona-xtrabackup-2.2-debian-binary/label_exp/ubuntu-precise-64bit/percona-xtrabackup-2.2.11/sql/signal_handler.cc:151
#2 <signal handler called>
#3 0x00007f53036310d5 in raise () from ./lib/x86_64-linux-gnu/libc.so.6
#4 0x00007f530363483b in abort () from ./lib/x86_64-linux-gnu/libc.so.6
#5 0x0000000000671a15 in fil_io (type=10, sync=<optimized out>, space_id=4294967280, zip_size=0, block_offset=<optimized out>, byte_offset=12454, len=65536,
    buf=0x7f52ff5fa000, message=0x0)
    at /mnt/workspace/percona-xtrabackup-2.2-debian-binary/label_exp/ubuntu-precise-64bit/percona-xtrabackup-2.2.11/storage/innobase/fil/fil0fil.cc:5708
#6 0x00000000006bc544 in log_group_read_log_seg (type=98887331, buf=<optimized out>, group=0x2cd0dc8, start_lsn=<optimized out>, end_lsn=42721971367936)
    at /mnt/workspace/percona-xtrabackup-2.2-debian-binary/label_exp/ubuntu-precise-64bit/percona-xtrabackup-2.2.11/storage/innobase/log/log0log.cc:2344
#7 0x00000000005a2513 in xtrabackup_copy_logfile (from_lsn=<optimized out>, is_last=0 '\000')
    at /mnt/workspace/percona-xtrabackup-2.2-debian-binary/label_exp/ubuntu-precise-64bit/percona-xtrabackup-2.2.11/storage/innobase/xtrabackup/src/xtrabackup.cc:2100
#8 0x00000000005a2963 in log_copying_thread (arg=<optimized out>)
    at /mnt/workspace/percona-xtrabackup-2.2-debian-binary/label_exp/ubuntu-precise-64bit/percona-xtrabackup-2.2.11/storage/innobase/xtrabackup/src/xtrabackup.cc:2315
#9 0x00007f53050b4e9a in start_thread () from ./lib/x86_64-linux-gnu/libpthread.so.0
#10 0x00007f53036ee8bd in clone () from ./lib/x86_64-linux-gnu/libc.so.6
#11 0x0000000000000000 in ?? ()

tags: added: i56050
Changed in percona-xtrabackup:
assignee: nobody → Sergei Glushchenko (sergei.glushchenko)
Revision history for this message
Sergei Glushchenko (sergei.glushchenko) wrote :
Revision history for this message
Shahriyar Rzayev (rzayev-sehriyar) wrote :

Percona now uses JIRA for bug reports so this bug report is migrated to: https://jira.percona.com/browse/PXB-433

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.