| 2012-08-28 20:42:10 |
Mike Siekkinen |
bug |
|
|
added bug |
| 2012-08-28 20:45:21 |
Mike Siekkinen |
description |
I have recently been upgrading various MySQL instances to 5.5.25a. I have one specific machine that experiencing a memory leak. I fear this report may lack any actionable meat but here's what I can tell you:
* The machine that is leaking is replicating an all innodb stream. It has been doing so for years on previous versions with out issue.
* While there are several databases in the binary logs feeding it, it is only capturing about a dozen specific tables from a single database using Replicate_Do_Table
* No other Replicate_* options are filled in
* This machines master also has other slaves that are not using any of the aforementioned filtering and none of them are experiencing this leak.
* No applications talk to this instance. It's role is just to replicate with log-slave-updates in order to generate a smaller bin log to push over the wire to slaves in remote datacenters
* I've read over http://www.mysqlperformanceblog.com/2012/03/21/troubleshooting-mysql-memory-usage/ but none of the suggestions there lead to any likely culprits (no temporary tables or stored procedures are in use)
* It has an innodb_buffer_pool_size of 2200M. On startup it shows memory footprint close to this. Over time top reports a memory footprint growth of about .1G/6 hours. Nagios graphs show this rate is very linear and consistent.
* I have attempted to kill the replication threads going in and out to see if this might indicate something session related to one of those. This had no effect in deterring freeing any memory. The event scheduler thread is running, however there are no actual events to be run here. Similarly stopping that thread does not free any memory.
* My only current recourse is the periodically restart the mysql process :(
Please let me know if there's anything else that would be of use to actually track down the root cause of this bug. |
I have recently been upgrading various MySQL instances to 5.5.25a. I have one specific machine that experiencing a memory leak. I fear this report may lack any actionable meat but here's what I can tell you:
* The machine that is leaking is replicating an all innodb stream. It has been doing so for years on previous versions with out issue.
* While there are several databases in the binary logs feeding it, it is only capturing about a dozen specific tables from a single database using Replicate_Do_Table
* No other Replicate_* options are filled in
* This machines master also has other slaves that are not using any of the aforementioned filtering and none of them are experiencing this leak.
* No applications talk to this instance. It's role is just to replicate with log-slave-updates in order to generate a smaller bin log to push over the wire to slaves in remote datacenters
* I've read over http://www.mysqlperformanceblog.com/2012/03/21/troubleshooting-mysql-memory-usage/ but none of the suggestions there lead to any likely culprits (no temporary tables or stored procedures are in use)
* It has an innodb_buffer_pool_size of 2200M. On startup it shows memory footprint close to this. Over time top reports a memory footprint growth of about .1G/6 hours. Nagios graphs show this rate is very linear and consistent.
* I have attempted to kill the replication threads going in and out to see if this might indicate something session related to one of those. This had no effect in freeing any memory. The event scheduler thread is running, however there are no actual events to be run here. Similarly stopping that thread does not free any memory.
* My only current recourse is the periodically restart the mysql process :(
Please let me know if there's anything else that would be of use to actually track down the root cause of this bug. |
|
| 2012-08-29 03:47:37 |
Laurynas Biveinis |
nominated for series |
|
percona-server/5.5 |
|
| 2012-08-29 03:47:37 |
Laurynas Biveinis |
bug task added |
|
percona-server/5.5 |
|
| 2012-08-31 16:42:32 |
Alex Elman |
attachment added |
|
Percona Leak Summary from Valgrind https://bugs.launchpad.net/percona-server/+bug/1042946/+attachment/3286051/+files/percona_5.5.25a_valgrind_leak_summary_2012-08-30 |
|
| 2012-08-31 16:54:22 |
Alex Elman |
attachment added |
|
percona_5.5.25a_valgrind_leak_summary_2012-08-31 https://bugs.launchpad.net/percona-server/+bug/1042946/+attachment/3286054/+files/percona_5.5.25a_valgrind_leak_summary_2012-08-31 |
|
| 2012-09-03 11:34:14 |
Laurynas Biveinis |
percona-server/5.5: status |
New |
Incomplete |
|
| 2012-10-02 13:34:42 |
Aleksandr Khomyakov |
attachment added |
|
valgrind result from Alexander( 5.5.27) https://bugs.launchpad.net/percona-server/+bug/1042946/+attachment/3365044/+files/valgrind_log.p13638.20120928.log |
|
| 2012-10-02 13:43:44 |
Aleksandr Khomyakov |
bug |
|
|
added subscriber Aleksandr Khomyakov |
| 2012-10-03 09:04:05 |
Laurynas Biveinis |
percona-server/5.5: status |
Incomplete |
New |
|
| 2012-10-08 16:32:14 |
Aleksandr Khomyakov |
attachment added |
|
2smaps_from_small_instance.zip https://bugs.launchpad.net/percona-server/+bug/1042946/+attachment/3387034/+files/2smaps_from_small_instance.zip |
|
| 2012-10-19 12:03:24 |
Ovais Tariq |
bug watch added |
|
http://bugs.mysql.com/bug.php?id=67259 |
|
| 2012-10-19 12:03:24 |
Ovais Tariq |
attachment added |
|
ps-test.tar.gz https://bugs.launchpad.net/percona-server/+bug/1042946/+attachment/3404066/+files/ps-test.tar.gz |
|
| 2012-10-20 13:00:09 |
Ovais Tariq |
attachment added |
|
memory_usage.tar.gz https://bugs.launchpad.net/percona-server/+bug/1042946/+attachment/3405880/+files/memory_usage.tar.gz |
|
| 2012-11-12 18:32:05 |
George Ormond Lorch III |
percona-server/5.5: assignee |
|
George Ormond Lorch III (gl-az) |
|
| 2012-11-12 20:09:37 |
George Ormond Lorch III |
percona-server/5.5: status |
New |
In Progress |
|
| 2012-11-14 19:46:30 |
Rob Starkey |
bug |
|
|
added subscriber Rob Starkey |
| 2012-11-27 09:40:18 |
Roel Van de Paar |
summary |
Memory leak on a filtered slave |
Memory leak on a filtered slave (Valgrind: malloc in Log_event::read_log_event) |
|
| 2012-11-29 16:38:41 |
George Ormond Lorch III |
percona-server/5.5: assignee |
George Ormond Lorch III (gl-az) |
|
|
| 2012-11-29 16:39:10 |
George Ormond Lorch III |
percona-server/5.5: status |
In Progress |
Incomplete |
|
| 2012-12-05 07:03:25 |
Roel Van de Paar |
percona-server/5.5: importance |
Undecided |
Critical |
|
| 2012-12-05 07:03:31 |
Roel Van de Paar |
percona-server/5.5: status |
Incomplete |
Confirmed |
|
| 2012-12-10 04:29:21 |
Stewart Smith |
percona-server/5.5: importance |
Critical |
High |
|
| 2012-12-10 04:29:23 |
Stewart Smith |
percona-server/5.5: status |
Confirmed |
Triaged |
|
| 2012-12-12 00:00:01 |
Vadim Tkachenko |
percona-server/5.5: status |
Triaged |
New |
|
| 2012-12-12 00:00:05 |
Vadim Tkachenko |
percona-server/5.5: importance |
High |
Undecided |
|
| 2012-12-19 17:31:37 |
Sergei Glushchenko |
percona-server/5.5: assignee |
|
Sergei Glushchenko (sergei.glushchenko) |
|
| 2012-12-19 17:35:06 |
Sergei Glushchenko |
percona-server/5.5: status |
New |
Confirmed |
|
| 2012-12-24 11:42:10 |
Sergei Glushchenko |
branch linked |
|
lp:~sergei.glushchenko/percona-server/ST-27220-bug1042946 |
|
| 2012-12-27 05:58:42 |
Vadim Tkachenko |
percona-server/5.5: status |
Confirmed |
In Progress |
|
| 2012-12-27 05:58:44 |
Vadim Tkachenko |
percona-server/5.5: importance |
Undecided |
High |
|
| 2012-12-28 16:42:57 |
Sergei Glushchenko |
bug watch added |
|
http://bugs.mysql.com/bug.php?id=67983 |
|
| 2012-12-28 16:42:57 |
Sergei Glushchenko |
bug task added |
|
mysql-server |
|
| 2012-12-28 16:44:40 |
Sergei Glushchenko |
percona-server/5.5: status |
In Progress |
Fix Committed |
|
| 2012-12-28 16:45:30 |
Sergei Glushchenko |
percona-server/5.5: milestone |
|
5.5.29-30.0 |
|
| 2013-01-03 08:44:35 |
Sergei Glushchenko |
branch linked |
|
lp:~sergei.glushchenko/percona-server/51-ST-27220-bug1042946 |
|
| 2013-01-03 08:44:59 |
Sergei Glushchenko |
nominated for series |
|
percona-server/5.1 |
|
| 2013-01-03 08:44:59 |
Sergei Glushchenko |
bug task added |
|
percona-server/5.1 |
|
| 2013-01-03 08:45:09 |
Sergei Glushchenko |
percona-server/5.1: status |
New |
Fix Committed |
|
| 2013-01-03 08:45:14 |
Sergei Glushchenko |
percona-server/5.1: importance |
Undecided |
High |
|
| 2013-01-03 08:45:18 |
Sergei Glushchenko |
percona-server/5.1: assignee |
|
Sergei Glushchenko (sergei.glushchenko) |
|
| 2013-01-19 00:59:46 |
Stewart Smith |
percona-server/5.5: status |
Fix Committed |
Fix Released |
|
| 2013-01-19 09:00:40 |
Stewart Smith |
percona-server/5.1: milestone |
|
5.1.67-14.4 |
|
| 2013-01-19 09:00:44 |
Stewart Smith |
percona-server/5.1: status |
Fix Committed |
Fix Released |
|
| 2013-03-20 23:21:57 |
Andrew Shieh |
bug |
|
|
added subscriber Andrew Shieh |
| 2013-06-26 08:40:47 |
Laurynas Biveinis |
tags |
leak memory replication |
leak memory replication upstream |
|
