Comment 3 for bug 1193474

Revision history for this message
Steven (libby-steven) wrote :

We are also having this issue. We have 6 different tables containing syslog data from numerous network devices.
All tables are affected by this behavior, the smallest containing about 4M rows, the largest containing about 2B rows.
During most of the process, we average anywhere between 300K-450K rows archived per minute. It seems that once
the last block of rows is reached, pt-archiver just stalls during the final SELECT and basically spins its wheels
for hours and hours on end.

Complete command-line used to run the tool:
pt-archiver --commit-each --bulk-insert --bulk-delete --limit 1000 --progress 10000 --no-check-charset \
--source h=localhost,S=$liveSock,D=$database,t=$table,u=$user,p=$pass \
--dest h=localhost,S=$archiveSock,D=$database,t=$table,u=$user,p=$pass \
--where "deviceReportedTime < DATE_SUB(NOW(), INTERVAL 35 DAY)"

Tool --version:
pt-archiver 2.2.16

MySQL version of all servers involved:
Percona Server using TokuDB storage engine (tokudb_lzma compression) version 5.6.28-76.1

Output from the tool including STDERR:
TIME ELAPSED COUNT
2016-04-07T03:00:02 0 0
2016-04-07T03:00:07 5 10000
2016-04-07T03:00:09 7 20000
2016-04-07T03:00:11 9 30000
2016-04-07T03:00:13 11 40000
2016-04-07T03:00:15 13 50000
2016-04-07T03:00:16 14 60000
2016-04-07T03:00:18 16 70000
2016-04-07T03:00:19 17 80000
2016-04-07T03:00:21 19 90000
2016-04-07T03:00:23 21 100000
2016-04-07T03:00:24 22 110000
2016-04-07T03:00:26 24 120000
2016-04-07T03:00:28 26 130000
2016-04-07T03:00:29 27 140000
2016-04-07T03:00:31 29 150000
2016-04-07T03:00:32 30 160000
2016-04-07T03:00:34 31 170000
2016-04-07T03:00:35 33 180000
2016-04-07T03:00:36 34 190000
2016-04-07T03:00:38 36 200000
2016-04-07T03:00:39 37 210000
2016-04-07T03:00:41 39 220000
2016-04-07T03:00:42 40 230000
2016-04-07T03:00:44 42 240000
2016-04-07T03:00:46 43 250000
2016-04-07T03:00:47 45 260000
2016-04-07T03:00:49 46 270000
2016-04-07T03:00:50 48 280000
2016-04-07T03:00:52 49 290000
2016-04-07T03:00:53 51 300000
2016-04-07T03:00:54 52 310000
2016-04-07T03:00:56 54 320000
2016-04-07T03:00:57 55 330000
2016-04-07T07:12:17 15135 340000
2016-04-07T10:39:44 27582 345581

Input files (log/dump/config files, etc.):
N/A