bool mts_checkpoint_routine(Relay_log_info*, ulonglong, bool, bool): Assertion `!rli->gaq->full() || ((rli->checkpoint_seqno == rli->checkpoint_group -1 && rli->mts_group_status == Relay_log_info::MTS_IN_GROUP) || rli->checkpoint_seqno == rli->checkpoint_group)' failed.

[Laurynas Biveinis]

On 5.6 trunk, intermittently:

rpl.rpl_parallel_switch_sequential 'mix' w1 [ fail ]
        Test ended at 2017-05-03 09:25:23

CURRENT_TEST: rpl.rpl_parallel_switch_sequential
mysqltest: At line 139: query 'STOP SLAVE' failed: 2013: Lost connection to MySQL server during query
...
mysqld-debug: /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/rpl_slave.cc:5781: bool mts_checkpoint_routine(Relay_log_info*, ulonglong, bool, bool): Assertion `!rli->gaq->full() || ((rli->checkpoint_seqno == rli->checkpoint_group -1 && rli->mts_group_status == Relay_log_info::MTS_IN_GROUP) || rli->checkpoint_seqno == rli->checkpoint_group)' failed.
13:23:11 UTC - mysqld got signal 6 ;
...
Thread 8 (Thread 0x9d4fbb40 (LWP 30532)):
#0 0xb7794cf9 in __kernel_vsyscall ()
#1 0xb74aa026 in pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/i386/i686/../pthread_cond_timedwait.S:245
#2 0x08745c0e in safe_cond_timedwait (cond=0xb1299c4, mp=0xb1298d4, abstime=0x9d4f9ed4, file=0x8c7d424 "/mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/include/mysql/psi/mysql_thread.h", line=1188) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/mysys/thr_mutex.c:278
#3 0x086e3a89 in inline_mysql_cond_timedwait (that=0xb1299c4, mutex=0xb1298d4, abstime=0x9d4f9ed4, src_file=0x8c7e18c "/mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/rpl_slave.cc", src_line=1431) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/include/mysql/psi/mysql_thread.h:1188
#4 0x086e7035 in terminate_slave_thread (thd=0x9d364260, term_lock=0xb1298d4, term_cond=0xb1299c4, slave_running=0xb129a50, need_lock_term=false) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/rpl_slave.cc:1431
#5 0x086e686e in terminate_slave_threads (mi=0xb0d3d68, thread_mask=3, need_lock_term=false) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/rpl_slave.cc:1257
#6 0x086ff9ba in stop_slave (thd=0xb1ebfb8, mi=0xb0d3d68, net_report=true) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/rpl_slave.cc:8816
#7 0x08424b82 in mysql_execute_command (thd=0xb1ebfb8) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/sql_parse.cc:3664
#8 0x0842f77b in mysql_parse (thd=0xb1ebfb8, rawbuf=0xb1f6510 "STOP SLAVE", length=10, parser_state=0x9d4fad20) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/sql_parse.cc:7058
#9 0x0841eb08 in dispatch_command (command=COM_QUERY, thd=0xb1ebfb8, packet=0xb1ee4e1 "STOP SLAVE", packet_length=10) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/sql_parse.cc:1485
#10 0x0841d6f3 in do_command (thd=0xb1ebfb8) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/sql_parse.cc:1062
#11 0x083e1558 in do_handle_one_connection (thd_arg=0xb1ebfb8) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/sql_connect.cc:1550
#12 0x083e1228 in handle_one_connection (arg=0xb1ebfb8) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/sql_connect.cc:1454
#13 0x08b05a8b in pfs_spawn_thread (arg=0xb0ebc18) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/storage/perfschema/pfs.cc:1860
#14 0xb74a42f5 in start_thread (arg=0x9d4fbb40) at pthread_create.c:456
#15 0xb71d76de in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:113
...
Thread 1 (Thread 0xa2845b40 (LWP 32367)):
#0 0xb7794cf9 in __kernel_vsyscall ()
#1 0xb74aaea1 in __pthread_kill (threadid=2726583104, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:58
#2 0x08741af2 in my_write_core (sig=6) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/mysys/stacktrace.c:424
#3 0x08360fc1 in handle_fatal_signal (sig=6) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/signal_handler.cc:236
#4 <signal handler called>
#5 0xb7794cf9 in __kernel_vsyscall ()
#6 0xb711a050 in __libc_signal_restore_set (set=0xa2844a10) at ../sysdeps/unix/sysv/linux/nptl-signals.h:79
#7 __GI_raise (sig=6) at ../sysdeps/unix/sysv/linux/raise.c:55
#8 0xb711b577 in __GI_abort () at abort.c:89
#9 0xb7112b47 in __assert_fail_base (fmt=0xb725109c "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", assertion=0x8c82fac "!rli->gaq->full() || ((rli->checkpoint_seqno == rli->checkpoint_group -1 && rli->mts_group_status == Relay_log_info::MTS_IN_GROUP) || rli->checkpoint_seqno == rli->checkpoint_group)", file=0x8c7e18c "/mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/rpl_slave.cc", line=5781, function=0x8c85d20 <mts_checkpoint_routine(Relay_log_info*, unsigned long long, bool, bool)::__PRETTY_FUNCTION__> "bool mts_checkpoint_routine(Relay_log_info*, ulonglong, bool, bool)") at assert.c:92
#10 0xb7112bcb in __GI___assert_fail (assertion=0x8c82fac "!rli->gaq->full() || ((rli->checkpoint_seqno == rli->checkpoint_group -1 && rli->mts_group_status == Relay_log_info::MTS_IN_GROUP) || rli->checkpoint_seqno == rli->checkpoint_group)", file=0x8c7e18c "/mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/rpl_slave.cc", line=5781, function=0x8c85d20 <mts_checkpoint_routine(Relay_log_info*, unsigned long long, bool, bool)::__PRETTY_FUNCTION__> "bool mts_checkpoint_routine(Relay_log_info*, ulonglong, bool, bool)") at assert.c:101
#11 0x086f63b7 in mts_checkpoint_routine (rli=0xb129430, period=0, force=false, need_data_lock=true) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/rpl_slave.cc:5778
#12 0x086f77fb in slave_stop_workers (rli=0xb129430, mts_inited=0xa2844e85) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/rpl_slave.cc:6168
#13 0x086f8c9d in handle_slave_sql (arg=0xb0d3d68) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/sql/rpl_slave.cc:6533
#14 0x08b05a8b in pfs_spawn_thread (arg=0xb2632b8) at /mnt/workspace/percona-server-5.6-trunk/BUILD_TYPE/debug/Host/ubuntu-zesty-32bit/storage/perfschema/pfs.cc:1860
#15 0xb74a42f5 in start_thread (arg=0xa2845b40) at pthread_create.c:456
#16 0xb71d76de in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:113

[Laurynas Biveinis (laurynas-biveinis)]

Added diagnostics in
     https://github.com/percona/percona-server/pull/1719
     https://github.com/percona/percona-server/pull/1720,
waiting for them to trigger

[Shahriyar Rzayev (rzayev-sehriyar)]

Percona now uses JIRA for bug reports so this bug report is migrated to: https://jira.percona.com/browse/PS-1092