pt-table-checksum reports false errors and misses real errors
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Percona Toolkit moved to https://jira.percona.com/projects/PT |
Incomplete
|
Undecided
|
Daniel Nichter |
Bug Description
Tool version = pt-table-checksum 2.1.5
Command line = pt-table-checksum --user=$USER --password=$PASS --chunk-
vsp_jira_current --no-check-
MySQL versions:
Master = Server version: 5.5.9-enterpris
Slave = Server version: 5.5.28-log MySQL Community Server (GPL)
Output:
TS ERRORS DIFFS ROWS CHUNKS SKIPPED TIME TABLE
11-19T10:58:01 0 0 0 1 0 0.265 vsp_jira_
11-19T10:58:02 0 0 0 1 0 0.264 vsp_jira_
11-19T10:58:02 0 0 0 1 0 0.261 vsp_jira_
11-19T10:58:02 0 0 0 1 0 0.263 vsp_jira_
11-19T10:58:02 0 0 0 1 0 0.298 vsp_jira_
11-19T10:58:03 0 0 134732 4 0 0.418 vsp_jira_
11-19T10:58:03 0 0 254319 1 0 0.157 vsp_jira_
11-19T10:58:04 0 0 298507 1 0 0.688 vsp_jira_
11-19T10:58:04 0 0 168484 1 0 0.119 vsp_jira_
11-19T10:58:04 0 0 180960 1 0 0.189 vsp_jira_
11-19T10:58:04 0 0 87 1 0 0.010 vsp_jira_
11-19T10:58:04 0 0 491 1 0 0.011 vsp_jira_
11-19T10:58:05 0 0 907274 1 0 1.079 vsp_jira_
11-19T10:58:08 0 0 1244909 1 0 2.878 vsp_jira_
11-19T10:58:08 0 0 180 1 0 0.009 vsp_jira_
11-19T10:58:08 0 0 2216 1 0 0.013 vsp_jira_
11-19T10:58:08 0 0 252 1 0 0.009 vsp_jira_
11-19T10:58:08 0 0 1777 1 0 0.013 vsp_jira_
11-19T10:58:08 0 0 636 1 0 0.013 vsp_jira_
11-19T10:58:08 0 0 1721 1 0 0.013 vsp_jira_
11-19T10:58:09 0 0 405238 1 0 0.826 vsp_jira_
11-19T10:58:09 0 0 1 1 0 0.010 vsp_jira_
11-19T10:58:09 0 0 0 1 0 0.009 vsp_jira_
11-19T10:58:09 0 0 2 1 0 0.011 vsp_jira_
11-19T10:58:09 0 0 48 1 0 0.010 vsp_jira_
11-19T10:58:09 0 0 14 1 0 0.011 vsp_jira_
11-19T10:58:09 0 0 1561 1 0 0.018 vsp_jira_
11-19T10:58:09 0 0 0 1 0 0.010 vsp_jira_
11-19T10:58:09 0 0 38285 1 0 0.106 vsp_jira_
11-19T10:58:09 0 0 6331 1 0 0.041 vsp_jira_
11-19T10:58:09 0 0 18889 1 0 0.049 vsp_jira_
11-19T10:58:09 0 0 5834 1 0 0.017 vsp_jira_
11-19T10:58:09 0 0 0 1 0 0.010 vsp_jira_
11-19T10:58:09 0 0 3475 1 0 0.016 vsp_jira_
11-19T10:58:09 0 0 719 1 0 0.012 vsp_jira_
11-19T10:58:09 0 0 1301 1 0 0.011 vsp_jira_
11-19T10:58:09 0 0 721 1 0 0.009 vsp_jira_
11-19T10:58:09 0 0 41 1 0 0.008 vsp_jira_
11-19T10:58:09 0 0 25081 1 0 0.081 vsp_jira_
11-19T10:58:09 0 0 23 1 0 0.011 vsp_jira_
11-19T10:58:09 0 0 0 1 0 0.011 vsp_jira_
11-19T10:58:09 0 0 245 1 0 0.009 vsp_jira_
11-19T10:58:09 0 0 9 1 0 0.010 vsp_jira_
11-19T10:58:09 0 0 1039 1 0 0.011 vsp_jira_
11-19T10:58:09 0 0 12 1 0 0.010 vsp_jira_
11-19T10:58:09 0 0 35 1 0 0.012 vsp_jira_
11-19T10:58:09 0 0 9 1 0 0.010 vsp_jira_
11-19T10:58:15 0 0 53065 1 0 5.154 vsp_jira_
11-19T10:58:15 0 0 105 1 0 0.010 vsp_jira_
11-19T10:58:15 0 0 13882 1 0 0.035 vsp_jira_
11-19T10:58:15 0 0 97 1 0 0.009 vsp_jira_
11-19T10:58:15 0 0 0 1 0 0.011 vsp_jira_
11-19T10:58:15 0 0 59163 1 0 0.089 vsp_jira_
11-19T10:58:15 0 0 7 1 0 0.011 vsp_jira_
11-19T10:58:15 0 0 2 1 0 0.010 vsp_jira_
11-19T10:58:15 0 0 55 1 0 0.008 vsp_jira_
11-19T10:58:15 0 0 85 1 0 0.008 vsp_jira_
11-19T10:58:15 0 0 9 1 0 0.010 vsp_jira_
11-19T10:58:15 0 0 50 1 0 0.011 vsp_jira_
11-19T10:58:22 0 0 805395 1 0 7.054 vsp_jira_
11-19T10:58:22 0 0 3 1 0 0.265 vsp_jira_
11-19T10:58:22 0 0 16 1 0 0.262 vsp_jira_
11-19T10:58:23 0 0 134754 1 0 0.976 vsp_jira_
11-19T10:58:23 0 0 0 1 0 0.011 vsp_jira_
11-19T10:58:23 0 0 11 1 0 0.013 vsp_jira_
11-19T10:58:23 0 0 2158 1 0 0.014 vsp_jira_
11-19T10:58:23 0 0 3 1 0 0.009 vsp_jira_
11-19T10:58:23 0 0 9 1 0 0.012 vsp_jira_
11-19T10:58:24 0 0 0 1 0 0.010 vsp_jira_
11-19T10:58:26 0 0 25566 1 0 2.090 vsp_jira_
11-19T10:58:26 0 0 166 1 0 0.267 vsp_jira_
11-19T10:58:39 0 0 3914219 1 0 13.089 vsp_jira_
11-19T10:58:39 0 0 3 1 0 0.265 vsp_jira_
11-19T10:58:39 0 0 1 1 0 0.011 vsp_jira_
11-19T10:58:39 0 0 0 1 0 0.264 vsp_jira_
11-19T10:58:40 0 0 1 1 0 0.264 vsp_jira_
11-19T10:58:40 0 0 0 1 0 0.012 vsp_jira_
11-19T10:58:40 0 0 624 1 0 0.264 vsp_jira_
11-19T10:58:40 0 0 287 1 0 0.263 vsp_jira_
11-19T10:58:41 0 0 107 1 0 0.265 vsp_jira_
11-19T10:58:41 0 0 620 1 0 0.266 vsp_jira_
11-19T10:58:41 0 0 3862 1 0 0.022 vsp_jira_
11-19T10:58:41 0 0 5 1 0 0.011 vsp_jira_
11-19T10:58:41 0 0 402 1 0 0.011 vsp_jira_
11-19T10:58:41 0 0 19 1 0 0.011 vsp_jira_
11-19T10:58:41 0 0 7 1 0 0.010 vsp_jira_
11-19T10:58:41 0 1 1207 1 0 0.012 vsp_jira_
11-19T10:58:41 0 0 715 1 0 0.267 vsp_jira_
11-19T10:58:41 0 0 0 1 0 0.012 vsp_jira_
11-19T10:58:41 0 0 1 1 0 0.010 vsp_jira_
11-19T10:58:41 0 0 0 1 0 0.010 vsp_jira_
11-19T10:58:41 0 0 6216 1 0 0.021 vsp_jira_
11-19T10:58:41 0 0 3110 1 0 0.013 vsp_jira_
11-19T10:58:41 0 1 1186 1 0 0.013 vsp_jira_
11-19T10:58:42 0 0 1919 1 0 0.269 vsp_jira_
11-19T10:58:42 0 0 0 1 0 0.011 vsp_jira_
11-19T10:58:42 0 0 105 1 0 0.011 vsp_jira_
11-19T10:58:42 0 0 0 1 0 0.264 vsp_jira_
11-19T10:58:42 0 0 1 1 0 0.266 vsp_jira_
11-19T10:58:42 0 0 0 1 0 0.265 vsp_jira_
11-19T10:58:43 0 0 0 1 0 0.264 vsp_jira_
11-19T10:58:43 0 0 0 1 0 0.260 vsp_jira_
11-19T10:58:43 0 0 105 1 0 0.010 vsp_jira_
11-19T10:58:43 0 0 4438 1 0 0.017 vsp_jira_
11-19T10:58:43 0 0 9 1 0 0.264 vsp_jira_
11-19T10:58:43 0 0 7 1 0 0.264 vsp_jira_
11-19T10:58:44 0 0 9 1 0 0.263 vsp_jira_
11-19T10:58:44 0 0 6 1 0 0.011 vsp_jira_
11-19T10:58:44 0 0 15430 1 0 0.034 vsp_jira_
11-19T10:58:44 0 0 2769 1 0 0.019 vsp_jira_
11-19T10:58:44 0 0 15 1 0 0.010 vsp_jira_
11-19T10:58:44 0 0 934 1 0 0.011 vsp_jira_
11-19T10:58:44 0 0 0 1 0 0.010 vsp_jira_
11-19T10:58:44 0 0 1 1 0 0.009 vsp_jira_
11-19T10:58:44 0 0 100 1 0 0.011 vsp_jira_
11-19T10:58:44 0 0 7 1 0 0.010 vsp_jira_
11-19T10:58:44 0 0 209552 1 0 0.327 vsp_jira_
11-19T10:58:44 0 0 0 1 0 0.010 vsp_jira_
11-19T10:58:44 0 0 74590 1 0 0.131 vsp_jira_
11-19T10:58:44 0 0 0 1 0 0.010 vsp_jira_
11-19T10:58:44 0 0 0 1 0 0.009 vsp_jira_
11-19T10:58:44 0 0 9 1 0 0.010 vsp_jira_
11-19T10:58:44 0 0 44 1 0 0.010 vsp_jira_
11-19T10:58:44 0 0 2 1 0 0.010 vsp_jira_
However, there are no differences between master and slave for vsp_jira_
Relevant contents of checksum table:
mysql> select * from checksums_ssodb03 where tbl in ('projectroleac
+------
| db | tbl | chunk | chunk_time | chunk_index | lower_boundary | upper_boundary | this_crc | this_cnt | master_crc | master_cnt | ts |
+------
| vsp_jira_current | projectroleactor | 1 | 0.002638 | NULL | NULL | NULL | 4cea971 | 1207 | 4cea971 | 1207 | 2012-11-19 10:58:41 |
| vsp_jira_current | propertystring | 1 | 0.002029 | NULL | NULL | NULL | d4d91c61 | 1186 | d4d91c61 | 1186 | 2012-11-19 10:58:41 |
| vsp_jira_current | votehistory | 1 | 0.000531 | NULL | NULL | NULL | bf83ed3d | 1 | 0 | 0 | 2012-11-19 10:58:44 |
+------
3 rows in set (0.00 sec)
I will try to reproduce with PTDEBUG=1.
Changed in percona-toolkit: | |
assignee: | nobody → Daniel Nichter (daniel-nichter) |
Changed in percona-toolkit: | |
status: | Confirmed → In Progress |
Changed in percona-toolkit: | |
milestone: | 2.1.8 → 2.2.1 |
Changed in percona-toolkit: | |
status: | Confirmed → In Progress |
tags: | added: 54898 |
tags: |
added: i54898 removed: 54898 |
Changed in percona-toolkit: | |
status: | In Progress → Incomplete |
Reproduced part of the bug with PTDEBUG=1. This time, pt-table-checksum outputs differences for vsp_jira_ current. external_ entities, vsp_jira_ current. fieldscreensche me, and vsp_jira_ current. remembermetoken , but no differences are actually present in the checksum table. pt-table-checksum also detected a difference in vsp_jira_ current. votehistory, which is correct.
Attaching debug output and contents of checksum table from slave.