Bug #1431699 “TokuDB crashes the server” : Bugs : Percona Server moved to https://jira.percona.com/projects/PS

Laurynas Biveinis (laurynas-biveinis) on 2015-03-13

tags:

added: tokudb

Revision history for this message

Nilnandan Joshi (nilnandan-joshi) wrote on 2015-03-17:

#1

Unable to reproduce the same. Can you provide table structure? "SHOW CREATE TABLE table \G".
Also if possible provide full error log.

Created on table on Master,

mysql> show create table test \G
*************************** 1. row ***************************
       Table: test
Create Table: CREATE TABLE `test` (
  `id` int(11) DEFAULT NULL,
  `name` varchar(10) DEFAULT NULL,
  `br_date` date DEFAULT NULL
) ENGINE=MyISAM DEFAULT CHARSET=latin1
/*!50100 PARTITION BY HASH ( MONTH(br_date))
PARTITIONS 6 */
1 row in set (0.02 sec)

On slave,

mysql> show create table test \G
*************************** 1. row ***************************
       Table: test
Create Table: CREATE TABLE `test` (
  `id` int(11) DEFAULT NULL,
  `name` varchar(10) DEFAULT NULL,
  `br_date` date DEFAULT NULL
) ENGINE=TokuDB DEFAULT CHARSET=latin1 ROW_FORMAT=TOKUDB_QUICKLZ
/*!50100 PARTITION BY HASH ( MONTH(br_date))
PARTITIONS 6 */
1 row in set (0.00 sec)

then insert records on master (MyISAM table) but didn't see crash on slave with TokuDB table.

Changed in percona-server:
status:	New → Incomplete

Revision history for this message

Vojtech Kurka (vojtech-kurka) wrote on 2015-03-17:

#2

Download full text (4.1 KiB)

CREATE TABLE `TrackItemVisibility` (
  `trackItemVisibilityId` bigint(20) unsigned NOT NULL AUTO_INCREMENT,
  `itemId` int(10) unsigned NOT NULL,
  `tagId` int(10) unsigned DEFAULT NULL,
  `guestId` int(10) unsigned NOT NULL,
  `userId` int(10) unsigned DEFAULT NULL,
  `format` tinyint(3) unsigned NOT NULL DEFAULT '1',
  `page` tinyint(3) unsigned NOT NULL,
  `order` int(10) unsigned DEFAULT NULL,
  `timestamp` timestamp NOT NULL DEFAULT '0000-00-00 00:00:00',
  `dataProviderId` int(10) unsigned DEFAULT NULL,
  PRIMARY KEY (`trackItemVisibilityId`),
  KEY `itemId_tagId` (`itemId`,`tagId`),
  KEY `itemId_timestamp` (`itemId`,`timestamp`),
  KEY `timestamp` (`timestamp`)
) ENGINE=MyISAM AUTO_INCREMENT=3525157439 DEFAULT CHARSET=utf8
/*!50100 PARTITION BY RANGE (trackItemVisibilityId)
(PARTITION p21 VALUES LESS THAN (2100000000) ENGINE = MyISAM,
PARTITION p22 VALUES LESS THAN (2200000000) ENGINE = MyISAM,
PARTITION p23 VALUES LESS THAN (2300000000) ENGINE = MyISAM,
PARTITION p24 VALUES LESS THAN (2400000000) ENGINE = MyISAM,
PARTITION p25 VALUES LESS THAN (2500000000) ENGINE = MyISAM,
PARTITION p26 VALUES LESS THAN (2600000000) ENGINE = MyISAM,
PARTITION p27 VALUES LESS THAN (2700000000) ENGINE = MyISAM,
PARTITION p28 VALUES LESS THAN (2800000000) ENGINE = MyISAM,
PARTITION p29 VALUES LESS THAN (2900000000) ENGINE = MyISAM,
PARTITION p30 VALUES LESS THAN (3000000000) ENGINE = MyISAM,
PARTITION p31 VALUES LESS THAN (3100000000) ENGINE = MyISAM,
PARTITION p32 VALUES LESS THAN (3200000000) ENGINE = MyISAM,
PARTITION p33 VALUES LESS THAN (3300000000) ENGINE = MyISAM,
PARTITION p34 VALUES LESS THAN (3400000000) ENGINE = MyISAM,
PARTITION p35 VALUES LESS THAN (3500000000) ENGINE = MyISAM,
PARTITION p36 VALUES LESS THAN (3600000000) ENGINE = MyISAM,
PARTITION p37 VALUES LESS THAN (3700000000) ENGINE = MyISAM,
PARTITION p38 VALUES LESS THAN (3800000000) ENGINE = MyISAM,
PARTITION p39 VALUES LESS THAN (3900000000) ENGINE = MyISAM,
PARTITION p40 VALUES LESS THAN (4000000000) ENGINE = MyISAM) */

CREATE TABLE `TrackItemVisibility` (
  `trackItemVisibilityId` bigint(20) unsigned NOT NULL AUTO_INCREMENT,
  `itemId` int(10) unsigned NOT NULL,
  `tagId` int(10) unsigned DEFAULT NULL,
  `guestId` int(10) unsigned NOT NULL,
  `userId` int(10) unsigned DEFAULT NULL,
  `format` tinyint(3) unsigned NOT NULL DEFAULT '1',
  `page` tinyint(3) unsigned NOT NULL COMMENT '1 - category, 2 - homepage, 3 - user profile',
  `order` int(10) unsigned DEFAULT NULL,
  `timestamp` timestamp NOT NULL DEFAULT '0000-00-00 00:00:00',
  `dataProviderId` int(10) unsigned DEFAULT NULL,
  PRIMARY KEY (`trackItemVisibilityId`),
  KEY `timestamp` (`timestamp`),
  KEY `itemId_tagId` (`itemId`,`tagId`),
  KEY `itemId_timestamp` (`itemId`,`timestamp`)
) ENGINE=TokuDB AUTO_INCREMENT=3525157439 DEFAULT CHARSET=utf8 ROW_FORMAT=TOKUDB_QUICKLZ
/*!50100 PARTITION BY RANGE (trackItemVisibilityId)
(PARTITION p21 VALUES LESS THAN (2100000000) ENGINE = TokuDB,
PARTITION p22 VALUES LESS THAN (2200000000) ENGINE = TokuDB,
PARTITION p23 VALUES LESS THAN (2300000000) ENGINE = TokuDB,
PARTITION p24 VALUES LESS THAN (2400000000) ENGINE = TokuDB,
PARTITION p25 VALUES LESS THAN (2500000...

Update: redumping the database didn't help, the server still crashes:

01:30:52 UTC - mysqld got signal 11 ;
This could be because you hit a bug. It is also possible that this binary
or one of the libraries it was linked against is corrupt, improperly built,
or misconfigured. This error can also be caused by malfunctioning hardware.
We will try our best to scrape up some info that will hopefully help
diagnose the problem, but since we have already crashed, 
something is definitely wrong and this may fail.
Please help us make Percona Server better by reporting any
bugs at http://bugs.percona.com/

key_buffer_size=1073741824
read_buffer_size=131072
max_used_connections=5
max_threads=1002
thread_count=4
connection_count=1
It is possible that mysqld could use up to 
key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 1448100 K  bytes of memory
Hope that's ok; if not, decrease some variables in the equation.

Thread pointer: 0x7f474fc13000
Attempting backtrace. You can use the following information to find out
where mysqld died. If you see no messages after this, something went
terribly wrong...
stack_bottom = 7f68769e1840 thread_stack 0x40000
/usr/sbin/mysqld(my_print_stacktrace+0x2c)[0x8cc59c]
/usr/sbin/mysqld(handle_fatal_signal+0x461)[0x654f11]
/lib64/libpthread.so.0[0x39cde0f710]
/usr/lib64/mysql/plugin/ha_tokudb.so(_Z22toku_xids_get_num_xidsP6XIDS_S+0x1)[0x7f6835cdf041]
/usr/lib64/mysql/plugin/ha_tokudb.so(+0xdbb3b)[0x7f6835d2eb3b]
/usr/lib64/mysql/plugin/ha_tokudb.so(_Z17toku_le_apply_msgRK6ft_msgP9leafentryP7bn_datajjP11txn_gc_infoPS3_Pl+0xbd)[0x7f6835d26f1d]
/usr/lib64/mysql/plugin/ha_tokudb.so(_Z25toku_ft_bn_apply_msg_onceP25ftnode_leaf_basement_nodeRK6ft_msgjjP9leafentryP11txn_gc_infoPmP12STAT64INFO_S+0x8e)[0x7f6835d274de]
/usr/lib64/mysql/plugin/ha_tokudb.so(_Z20toku_ft_bn_apply_msgRKN4toku10comparatorEPFiP9__toku_dbPK10__toku_dbtS7_S7_PFvS7_PvES8_EP25ftnode_leaf_basement_nodeRK6ft_msgP11txn_gc_infoPmP12STAT64INFO_S+0x145)[0x7f6835d276b5]
/usr/lib64/mysql/plugin/ha_tokudb.so(+0xe049c)[0x7f6835d3349c]
/usr/lib64/mysql/plugin/ha_tokudb.so(+0xe09dd)[0x7f6835d339dd]
/usr/lib64/mysql/plugin/ha_tokudb.so(_Z21toku_ft_insert_uniqueP9ft_handleP10__toku_dbtS2_P7tokutxnb+0x110)[0x7f6835d42ad0]
/usr/lib64/mysql/plugin/ha_tokudb.so(+0x3df83)[0x7f6835c90f83]
/usr/lib64/mysql/plugin/ha_tokudb.so(_Z16env_put_multipleP13__toku_db_envP9__toku_dbP13__toku_db_txnPK10__toku_dbtS7_jPS2_P9DBT_ARRAYSA_Pj+0x4af)[0x7f6835d43faf]
/usr/lib64/mysql/plugin/ha_tokudb.so(_ZN9ha_tokudb32insert_rows_to_dictionaries_multEP10__toku_dbtS1_P13__toku_db_txnP3THD+0x4d8)[0x7f6835cabda8]
/usr/lib64/mysql/plugin/ha_tokudb.so(_ZN9ha_tokudb9write_rowEPh+0x681)[0x7f6835cba231]
/usr/sbin/mysqld(_ZN7handler12ha_write_rowEPh+0xef)[0x59f8bf]
/usr/sbin/mysqld(_ZN12ha_partition9write_rowEPh+0x103)[0xb44ab3]
/usr/sbin/mysqld(_ZN7handler12ha_write_rowEPh+0x9e)[0x59f86e]
/usr/sbin/mysqld(_ZN20Write_rows_log_event9write_rowEPK14Relay_log_infob+0x135)[0x864fd5]
/usr/sbin/mysqld(_ZN20Write_rows_log_event11do_exec_rowEPK14Relay_log_info+0x19)[0x8652f9]
/usr/sbin/mysqld(_ZN14Rows_log_event12do_apply_rowEPK14Relay_log_info+0x26)[0x8551d6]
/usr/sbin/mysqld(_ZN14Rows_log_event14do_apply_eventEPK14Relay_log_info+0x526)[0x863256]
/usr/sbin/mysqld(_ZN9Log_event11apply_eventEP14Relay_log_info+0x6d)[0x85c90d]
/usr/sbin/mysqld(_Z26apply_event_and_update_posPP9Log_eventP3THDP14Relay_log_info+0x25e)[0x8936de]
/usr/sbin/mysqld(handle_slave_sql+0xbbb)[0x896a8b]
/usr/sbin/mysqld(pfs_spawn_thread+0x143)[0xadc113]
/lib64/libpthread.so.0[0x39cde079d1]
/lib64/libc.so.6(clone+0x6d)[0x39cdae88fd]

Trying to get some variables.
Some pointers may be invalid and cause the dump to abort.
Query (0): is an invalid pointer
Connection ID (thread ID): 2
Status: NOT_KILLED

Revision history for this message

Vojtech Kurka (vojtech-kurka) wrote on 2015-03-18:

#5

mysql> show global variables like '%toku%';
+---------------------------------+-------------------+
| Variable_name | Value |
+---------------------------------+-------------------+
| tokudb_alter_print_error | OFF |
| tokudb_analyze_delete_fraction | 1.000000 |
| tokudb_analyze_time | 5 |
| tokudb_block_size | 4194304 |
| tokudb_bulk_fetch | ON |
| tokudb_cache_size | 10737418240 |
| tokudb_check_jemalloc | 1 |
| tokudb_checkpoint_lock | OFF |
| tokudb_checkpoint_on_flush_logs | OFF |
| tokudb_checkpointing_period | 60 |
| tokudb_cleaner_iterations | 5 |
| tokudb_cleaner_period | 1 |
| tokudb_commit_sync | ON |
| tokudb_create_index_online | ON |
| tokudb_data_dir | /ssd/mysql/tokudb |
| tokudb_debug | 0 |
| tokudb_directio | ON |
| tokudb_disable_hot_alter | OFF |
| tokudb_disable_prefetching | OFF |
| tokudb_disable_slow_alter | OFF |
| tokudb_disable_slow_update | OFF |
| tokudb_disable_slow_upsert | OFF |
| tokudb_empty_scan | rl |
| tokudb_fs_reserve_percent | 5 |
| tokudb_fsync_log_period | 0 |
| tokudb_hide_default_row_format | ON |
| tokudb_killed_time | 4000 |
| tokudb_last_lock_timeout | |
| tokudb_load_save_space | ON |
| tokudb_loader_memory_size | 100000000 |
| tokudb_lock_timeout | 4000 |
| tokudb_lock_timeout_debug | 1 |
| tokudb_log_dir | |
| tokudb_max_lock_memory | 1342177280 |
| tokudb_optimize_index_fraction | 1.000000 |
| tokudb_optimize_index_name | |
| tokudb_optimize_throttle | 0 |
| tokudb_pk_insert_mode | 1 |
| tokudb_prelock_empty | ON |
| tokudb_read_block_size | 65536 |
| tokudb_read_buf_size | 131072 |
| tokudb_read_status_frequency | 10000 |
| tokudb_row_format | tokudb_zlib |
| tokudb_rpl_check_readonly | ON |
| tokudb_rpl_lookup_rows | ON |
| tokudb_rpl_lookup_rows_delay | 0 |
| tokudb_rpl_unique_checks | ON |
| tokudb_rpl_unique_checks_delay | 0 |
| tokudb_support_xa | ON |
| tokudb_tmp_dir | |
| tokudb_version | tokudb-7.5.6 |
| tokudb_write_status_frequency | 1000 |
+---------------------------------+-------------------+

mysql> show global variables like '%toku%';
+---------------------------------+-------------------+
| Variable_name                   | Value             |
+---------------------------------+-------------------+
| tokudb_alter_print_error        | OFF               |
| tokudb_analyze_delete_fraction  | 1.000000          |
| tokudb_analyze_time             | 5                 |
| tokudb_block_size               | 4194304           |
| tokudb_bulk_fetch               | ON                |
| tokudb_cache_size               | 10737418240       |
| tokudb_check_jemalloc           | 1                 |
| tokudb_checkpoint_lock          | OFF               |
| tokudb_checkpoint_on_flush_logs | OFF               |
| tokudb_checkpointing_period     | 60                |
| tokudb_cleaner_iterations       | 5                 |
| tokudb_cleaner_period           | 1                 |
| tokudb_commit_sync              | ON                |
| tokudb_create_index_online      | ON                |
| tokudb_data_dir                 | /ssd/mysql/tokudb |
| tokudb_debug                    | 0                 |
| tokudb_directio                 | ON                |
| tokudb_disable_hot_alter        | OFF               |
| tokudb_disable_prefetching      | OFF               |
| tokudb_disable_slow_alter       | OFF               |
| tokudb_disable_slow_update      | OFF               |
| tokudb_disable_slow_upsert      | OFF               |
| tokudb_empty_scan               | rl                |
| tokudb_fs_reserve_percent       | 5                 |
| tokudb_fsync_log_period         | 0                 |
| tokudb_hide_default_row_format  | ON                |
| tokudb_killed_time              | 4000              |
| tokudb_last_lock_timeout        |                   |
| tokudb_load_save_space          | ON                |
| tokudb_loader_memory_size       | 100000000         |
| tokudb_lock_timeout             | 4000              |
| tokudb_lock_timeout_debug       | 1                 |
| tokudb_log_dir                  |                   |
| tokudb_max_lock_memory          | 1342177280        |
| tokudb_optimize_index_fraction  | 1.000000          |
| tokudb_optimize_index_name      |                   |
| tokudb_optimize_throttle        | 0                 |
| tokudb_pk_insert_mode           | 1                 |
| tokudb_prelock_empty            | ON                |
| tokudb_read_block_size          | 65536             |
| tokudb_read_buf_size            | 131072            |
| tokudb_read_status_frequency    | 10000             |
| tokudb_row_format               | tokudb_zlib       |
| tokudb_rpl_check_readonly       | ON                |
| tokudb_rpl_lookup_rows          | ON                |
| tokudb_rpl_lookup_rows_delay    | 0                 |
| tokudb_rpl_unique_checks        | ON                |
| tokudb_rpl_unique_checks_delay  | 0                 |
| tokudb_support_xa               | ON                |
| tokudb_tmp_dir                  |                   |
| tokudb_version                  | tokudb-7.5.6      |
| tokudb_write_status_frequency   | 1000              |
+---------------------------------+-------------------+

Valerii Kravchuk (valerii-kravchuk) on 2015-03-18

Changed in percona-server:
status:	Incomplete → New

Revision history for this message

Muhammad Irfan (muhammad-irfan) wrote on 2015-05-08:

#6

Download full text (15.2 KiB)

I tired to reproduce with your provided table definition but no luck so far. Can you please provide master/slave my.cnf file, slave error log and enable general log on slave side to check which queries caused the crash may be.

mysql> show create table TrackItemVisibility\G
*************************** 1. row ***************************
       Table: TrackItemVisibility
Create Table: CREATE TABLE `TrackItemVisibility` (
  `trackItemVisibilityId` bigint(20) unsigned NOT NULL AUTO_INCREMENT,
  `itemId` int(10) unsigned NOT NULL,
  `tagId` int(10) unsigned DEFAULT NULL,
  `guestId` int(10) unsigned NOT NULL,
  `userId` int(10) unsigned DEFAULT NULL,
  `format` tinyint(3) unsigned NOT NULL DEFAULT '1',
  `page` tinyint(3) unsigned NOT NULL,
  `order` int(10) unsigned DEFAULT NULL,
  `timestamp` timestamp NOT NULL DEFAULT '0000-00-00 00:00:00',
  `dataProviderId` int(10) unsigned DEFAULT NULL,
  PRIMARY KEY (`trackItemVisibilityId`),
  KEY `itemId_tagId` (`itemId`,`tagId`),
  KEY `itemId_timestamp` (`itemId`,`timestamp`),
  KEY `timestamp` (`timestamp`)
) ENGINE=MyISAM AUTO_INCREMENT=3900000002 DEFAULT CHARSET=utf8
/*!50100 PARTITION BY RANGE (trackItemVisibilityId)
(PARTITION p21 VALUES LESS THAN (2100000000) ENGINE = MyISAM,
PARTITION p22 VALUES LESS THAN (2200000000) ENGINE = MyISAM,
PARTITION p23 VALUES LESS THAN (2300000000) ENGINE = MyISAM,
PARTITION p24 VALUES LESS THAN (2400000000) ENGINE = MyISAM,
PARTITION p25 VALUES LESS THAN (2500000000) ENGINE = MyISAM,
PARTITION p26 VALUES LESS THAN (2600000000) ENGINE = MyISAM,
PARTITION p27 VALUES LESS THAN (2700000000) ENGINE = MyISAM,
PARTITION p28 VALUES LESS THAN (2800000000) ENGINE = MyISAM,
PARTITION p29 VALUES LESS THAN (2900000000) ENGINE = MyISAM,
PARTITION p30 VALUES LESS THAN (3000000000) ENGINE = MyISAM,
PARTITION p31 VALUES LESS THAN (3100000000) ENGINE = MyISAM,
PARTITION p32 VALUES LESS THAN (3200000000) ENGINE = MyISAM,
PARTITION p33 VALUES LESS THAN (3300000000) ENGINE = MyISAM,
PARTITION p34 VALUES LESS THAN (3400000000) ENGINE = MyISAM,
PARTITION p35 VALUES LESS THAN (3500000000) ENGINE = MyISAM,
PARTITION p36 VALUES LESS THAN (360000...

I tired to reproduce with your provided table definition but no luck so far. Can you please provide master/slave my.cnf file, slave error log and enable general log on slave side to check which queries caused the crash may be.

mysql> show create table TrackItemVisibility\G
*************************** 1. row ***************************
       Table: TrackItemVisibility
Create Table: CREATE TABLE `TrackItemVisibility` (
  `trackItemVisibilityId` bigint(20) unsigned NOT NULL AUTO_INCREMENT,
  `itemId` int(10) unsigned NOT NULL,
  `tagId` int(10) unsigned DEFAULT NULL,
  `guestId` int(10) unsigned NOT NULL,
  `userId` int(10) unsigned DEFAULT NULL,
  `format` tinyint(3) unsigned NOT NULL DEFAULT '1',
  `page` tinyint(3) unsigned NOT NULL,
  `order` int(10) unsigned DEFAULT NULL,
  `timestamp` timestamp NOT NULL DEFAULT '0000-00-00 00:00:00',
  `dataProviderId` int(10) unsigned DEFAULT NULL,
  PRIMARY KEY (`trackItemVisibilityId`),
  KEY `itemId_tagId` (`itemId`,`tagId`),
  KEY `itemId_timestamp` (`itemId`,`timestamp`),
  KEY `timestamp` (`timestamp`)
) ENGINE=MyISAM AUTO_INCREMENT=3900000002 DEFAULT CHARSET=utf8
/*!50100 PARTITION BY RANGE (trackItemVisibilityId)
(PARTITION p21 VALUES LESS THAN (2100000000) ENGINE = MyISAM,
 PARTITION p22 VALUES LESS THAN (2200000000) ENGINE = MyISAM,
 PARTITION p23 VALUES LESS THAN (2300000000) ENGINE = MyISAM,
 PARTITION p24 VALUES LESS THAN (2400000000) ENGINE = MyISAM,
 PARTITION p25 VALUES LESS THAN (2500000000) ENGINE = MyISAM,
 PARTITION p26 VALUES LESS THAN (2600000000) ENGINE = MyISAM,
 PARTITION p27 VALUES LESS THAN (2700000000) ENGINE = MyISAM,
 PARTITION p28 VALUES LESS THAN (2800000000) ENGINE = MyISAM,
 PARTITION p29 VALUES LESS THAN (2900000000) ENGINE = MyISAM,
 PARTITION p30 VALUES LESS THAN (3000000000) ENGINE = MyISAM,
 PARTITION p31 VALUES LESS THAN (3100000000) ENGINE = MyISAM,
 PARTITION p32 VALUES LESS THAN (3200000000) ENGINE = MyISAM,
 PARTITION p33 VALUES LESS THAN (3300000000) ENGINE = MyISAM,
 PARTITION p34 VALUES LESS THAN (3400000000) ENGINE = MyISAM,
 PARTITION p35 VALUES LESS THAN (3500000000) ENGINE = MyISAM,
 PARTITION p36 VALUES LESS THAN (3600000000) ENGINE = MyISAM,
 PARTITION p37 VALUES LESS THAN (3700000000) ENGINE = MyISAM,
 PARTITION p38 VALUES LESS THAN (3800000000) ENGINE = MyISAM,
 PARTITION p39 VALUES LESS THAN (3900000000) ENGINE = MyISAM,
 PARTITION p40 VALUES LESS THAN (4000000000) ENGINE = MyISAM) */

mysql> SELECT * FROM TrackItemVisibility;
+-----------------------+--------+-------+---------+--------+--------+------+-------+---------------------+----------------+
| trackItemVisibilityId | itemId | tagId | guestId | userId | format | page | order | timestamp           | dataProviderId |
+-----------------------+--------+-------+---------+--------+--------+------+-------+---------------------+----------------+
|            2100000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2200000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2300000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2400000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2500000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2600000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2700000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2800000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2900000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3000000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3100000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3200000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3300000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3400000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3500000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3600000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3700000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3800000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3900000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
+-----------------------+--------+-------+---------+--------+--------+------+-------+---------------------+----------------+

mysql> show create table TrackItemVisibility\G
*************************** 1. row ***************************
       Table: TrackItemVisibility
Create Table: CREATE TABLE `TrackItemVisibility` (
  `trackItemVisibilityId` bigint(20) unsigned NOT NULL AUTO_INCREMENT,
  `itemId` int(10) unsigned NOT NULL,
  `tagId` int(10) unsigned DEFAULT NULL,
  `guestId` int(10) unsigned NOT NULL,
  `userId` int(10) unsigned DEFAULT NULL,
  `format` tinyint(3) unsigned NOT NULL DEFAULT '1',
  `page` tinyint(3) unsigned NOT NULL COMMENT '1 - category, 2 - homepage, 3 - user profile',
  `order` int(10) unsigned DEFAULT NULL,
  `timestamp` timestamp NOT NULL DEFAULT '0000-00-00 00:00:00',
  `dataProviderId` int(10) unsigned DEFAULT NULL,
  PRIMARY KEY (`trackItemVisibilityId`),
  KEY `timestamp` (`timestamp`),
  KEY `itemId_tagId` (`itemId`,`tagId`),
  KEY `itemId_timestamp` (`itemId`,`timestamp`)
) ENGINE=TokuDB AUTO_INCREMENT=3900000002 DEFAULT CHARSET=utf8 ROW_FORMAT=TOKUDB_QUICKLZ
/*!50100 PARTITION BY RANGE (trackItemVisibilityId)
(PARTITION p21 VALUES LESS THAN (2100000000) ENGINE = TokuDB,
 PARTITION p22 VALUES LESS THAN (2200000000) ENGINE = TokuDB,
 PARTITION p23 VALUES LESS THAN (2300000000) ENGINE = TokuDB,
 PARTITION p24 VALUES LESS THAN (2400000000) ENGINE = TokuDB,
 PARTITION p25 VALUES LESS THAN (2500000000) ENGINE = TokuDB,
 PARTITION p26 VALUES LESS THAN (2600000000) ENGINE = TokuDB,
 PARTITION p27 VALUES LESS THAN (2700000000) ENGINE = TokuDB,
 PARTITION p28 VALUES LESS THAN (2800000000) ENGINE = TokuDB,
 PARTITION p29 VALUES LESS THAN (2900000000) ENGINE = TokuDB,
 PARTITION p30 VALUES LESS THAN (3000000000) ENGINE = TokuDB,
 PARTITION p31 VALUES LESS THAN (3100000000) ENGINE = TokuDB,
 PARTITION p32 VALUES LESS THAN (3200000000) ENGINE = TokuDB,
 PARTITION p33 VALUES LESS THAN (3300000000) ENGINE = TokuDB,
 PARTITION p34 VALUES LESS THAN (3400000000) ENGINE = TokuDB,
 PARTITION p35 VALUES LESS THAN (3500000000) ENGINE = TokuDB,
 PARTITION p36 VALUES LESS THAN (3600000000) ENGINE = TokuDB,
 PARTITION p37 VALUES LESS THAN (3700000000) ENGINE = TokuDB,
 PARTITION p38 VALUES LESS THAN (3800000000) ENGINE = TokuDB,
 PARTITION p39 VALUES LESS THAN (3900000000) ENGINE = TokuDB,
 PARTITION p40 VALUES LESS THAN (4000000000) ENGINE = TokuDB) */

mysql> SELECT * FROM TrackItemVisibility;
+-----------------------+--------+-------+---------+--------+--------+------+-------+---------------------+----------------+
| trackItemVisibilityId | itemId | tagId | guestId | userId | format | page | order | timestamp           | dataProviderId |
+-----------------------+--------+-------+---------+--------+--------+------+-------+---------------------+----------------+
|            2100000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2200000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2300000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2400000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2500000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2600000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2700000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2800000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            2900000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3000000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3100000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3200000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3300000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3400000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3500000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3600000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3700000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3800000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
|            3900000001 |    123 |  NULL |     123 |   NULL |      1 |    1 |  NULL | 0000-00-00 00:00:00 |           NULL |
+-----------------------+--------+-------+---------+--------+--------+------+-------+---------------------+----------------+
19 rows in set (0.00 sec)

mysql> show global variables like '%toku%';
+---------------------------------+--------------+
| Variable_name                   | Value        |
+---------------------------------+--------------+
| tokudb_alter_print_error        | OFF          |
| tokudb_analyze_delete_fraction  | 1.000000     |
| tokudb_analyze_time             | 5            |
| tokudb_block_size               | 4194304      |
| tokudb_bulk_fetch               | ON           |
| tokudb_cache_size               | 522596352    |
| tokudb_check_jemalloc           | 1            |
| tokudb_checkpoint_lock          | OFF          |
| tokudb_checkpoint_on_flush_logs | OFF          |
| tokudb_checkpointing_period     | 60           |
| tokudb_cleaner_iterations       | 5            |
| tokudb_cleaner_period           | 1            |
| tokudb_commit_sync              | ON           |
| tokudb_create_index_online      | ON           |
| tokudb_data_dir                 |              |
| tokudb_debug                    | 0            |
| tokudb_directio                 | OFF          |
| tokudb_disable_hot_alter        | OFF          |
| tokudb_disable_prefetching      | OFF          |
| tokudb_disable_slow_alter       | OFF          |
| tokudb_disable_slow_update      | OFF          |
| tokudb_disable_slow_upsert      | OFF          |
| tokudb_empty_scan               | rl           |
| tokudb_fs_reserve_percent       | 5            |
| tokudb_fsync_log_period         | 0            |
| tokudb_hide_default_row_format  | ON           |
| tokudb_killed_time              | 4000         |
| tokudb_last_lock_timeout        |              |
| tokudb_load_save_space          | ON           |
| tokudb_loader_memory_size       | 100000000    |
| tokudb_lock_timeout             | 4000         |
| tokudb_lock_timeout_debug       | 1            |
| tokudb_log_dir                  |              |
| tokudb_max_lock_memory          | 65324544     |
| tokudb_optimize_index_fraction  | 1.000000     |
| tokudb_optimize_index_name      |              |
| tokudb_optimize_throttle        | 0            |
| tokudb_pk_insert_mode           | 1            |
| tokudb_prelock_empty            | ON           |
| tokudb_read_block_size          | 65536        |
| tokudb_read_buf_size            | 131072       |
| tokudb_read_status_frequency    | 10000        |
| tokudb_row_format               | tokudb_zlib  |
| tokudb_rpl_check_readonly       | ON           |
| tokudb_rpl_lookup_rows          | ON           |
| tokudb_rpl_lookup_rows_delay    | 0            |
| tokudb_rpl_unique_checks        | ON           |
| tokudb_rpl_unique_checks_delay  | 0            |
| tokudb_support_xa               | ON           |
| tokudb_tmp_dir                  |              |
| tokudb_version                  | tokudb-7.5.6 |
| tokudb_write_status_frequency   | 1000         |
+---------------------------------+--------------+
52 rows in set (0.00 sec)

Changed in percona-server:
status:	New → Incomplete

Revision history for this message

Vojtech Kurka (vojtech-kurka) wrote on 2015-05-11:

#7

I'm sorry, I had to revert all tables to MyISAM to prevent the crashes.
The query was a batch insert, inserting 10K rows on each query.

When I will evaluate TokuDB for this table again, I'll let you know how it works.

Revision history for this message

Launchpad Janitor (janitor) wrote on 2015-07-11:

#8

[Expired for Percona Server because there has been no activity for 60 days.]

Changed in percona-server:
status:	Incomplete → Expired

Revision history for this message

Shahriyar Rzayev (rzayev-sehriyar) wrote on 2018-01-25:

#9

Percona now uses JIRA for bug reports so this bug report is migrated to: https://jira.percona.com/browse/PS-3273

Percona Server moved to https://jira.percona.com/projects/PS

TokuDB crashes the server

Bug Description

Other bug subscribers

Remote bug watches