Activity log for bug #1592749

Date Who What changed Old value New value Message
2016-06-15 10:29:21 Kern Sibbald bug added bug
2016-06-17 11:06:24 Robie Basak tags mysql-5.7-transition
2016-06-17 11:06:34 Robie Basak mysql-5.7 (Ubuntu): assignee Lars Tangvald (lars-tangvald)
2016-06-17 11:06:36 Robie Basak bug added subscriber Robie Basak
2016-07-03 19:23:07 Kern Sibbald attachment added Fixes broken Bacula batch mode for MySQL 5.7 -- applies to Bacula version 7.4.1 https://bugs.launchpad.net/ubuntu/+source/mysql-5.7/+bug/1592749/+attachment/4694835/+files/mysql_thread_safe.patch
2016-07-03 20:25:35 Ubuntu Foundations Team Bug Bot tags mysql-5.7-transition mysql-5.7-transition patch
2016-07-03 20:25:43 Ubuntu Foundations Team Bug Bot bug added subscriber Ubuntu Review Team
2016-07-04 08:47:50 Launchpad Janitor mysql-5.7 (Ubuntu): status New Confirmed
2016-07-04 08:48:08 Robin Pronk bug added subscriber Robin Pronk
2016-07-04 12:08:08 Sander van Schie bug added subscriber Sander van Schie
2016-07-06 13:39:35 Robie Basak affects mysql-5.7 (Ubuntu) bacula (Ubuntu)
2016-07-06 13:39:35 Robie Basak bacula (Ubuntu): status Confirmed Triaged
2016-07-06 13:39:35 Robie Basak bacula (Ubuntu): assignee Lars Tangvald (lars-tangvald) Nish Aravamudan (nacc)
2016-07-06 16:02:15 Nish Aravamudan nominated for series Ubuntu Xenial
2016-07-06 16:10:09 Nish Aravamudan bacula (Ubuntu): status Triaged In Progress
2016-07-20 19:21:52 Nish Aravamudan bacula (Ubuntu): status In Progress Fix Released
2016-07-20 19:29:06 Nish Aravamudan description This is not really a bug report, rather it is a performance concern. I am running a standard Ubuntu 16.04 64 bit desktop installation. On this system, I have built a Bacula 7.4 and I have installed PostgreSQL and MySQL both are "out of the box". PostgreSQL performs as expected with Bacula. MySQL 5.7, however, is 10 times slower than PostgreSQL and *possibly* 100% slower than prior versions of MySQL. When MySQL is running, the disk is making a typical thrashing sound (i.e. lots of accesses). This is as if MySQL has by default fsync enabled after every database update. Below, I show the first two Bacula regression tests for MySQL then for PostgreSQL. The point here is that MySQL out of the box does not perform "well". Comparison between the two different versions run on different machines so may not be totally valid. On the other hand, a difference in speed of a factor of 10 between MySQL and Postgres is remarkable. Note only a part of the time is actually consumed by the database thus the real difference in the database speeds is larger. I suggest that we cannot expect most users to be able to tune MySQL and that the out of the box performance ideally would be somewhat equivalent to PostgreSQL. Ubuntu 16.04: For MySQL 5.7 the tests take: 239 seconds and 822 seconds to run. For Postgres 9.5 the tests take: 23 seconds and 81 seconds to run Ubuntu 14.04 (a different machine from the above) For MySQL 5.5 the tests take: 115 seconds and 393 seconds to run. For Postgres 9.3 the tests take: 23 seconds and 76 seconds to run MySQL 5.7 tests for Ubuntu 16.04: Start non-root disk tests === Starting acl-xattr-test at 09:52:46 === ===== acl-xattr-test OK 09:56:46 00:03:59 239s ===== === Starting action-on-purge-test at 09:57:23 === ===== action-on-purge-test OK 10:11:05 00:13:42 822s ===== PostgreSQL tests: Start non-root disk tests === Starting acl-xattr-test at 10:13:21 === ===== acl-xattr-test OK 10:13:45 00:00:23 23s ===== === Starting action-on-purge-test at 10:13:56 === ===== action-on-purge-test OK 10:15:18 00:01:21 81s ===== [Impact] * Bacula users migrating from earlier versions of MySQL e.g. 14.04 -> 16.04 experience a significant performance degradation if using the MySQL backend. * The fix (from upstream) is to build bacula with the knowledge that MySQL is thread-safe. [Test Case] * Run the acl-xattr-test and action-on-purge-test tests from the bacula source. [Regression Potential] * This fix is a performance consideration, and should not lead to any change in functionality. --- This is not really a bug report, rather it is a performance concern. I am running a standard Ubuntu 16.04 64 bit desktop installation. On this system, I have built a Bacula 7.4 and I have installed PostgreSQL and MySQL both are "out of the box". PostgreSQL performs as expected with Bacula. MySQL 5.7, however, is 10 times slower than PostgreSQL and *possibly* 100% slower than prior versions of MySQL. When MySQL is running, the disk is making a typical thrashing sound (i.e. lots of accesses). This is as if MySQL has by default fsync enabled after every database update. Below, I show the first two Bacula regression tests for MySQL then for PostgreSQL. The point here is that MySQL out of the box does not perform "well". Comparison between the two different versions run on different machines so may not be totally valid. On the other hand, a difference in speed of a factor of 10 between MySQL and Postgres is remarkable. Note only a part of the time is actually consumed by the database thus the real difference in the database speeds is larger. I suggest that we cannot expect most users to be able to tune MySQL and that the out of the box performance ideally would be somewhat equivalent to PostgreSQL. Ubuntu 16.04: For MySQL 5.7 the tests take: 239 seconds and 822 seconds to run. For Postgres 9.5 the tests take: 23 seconds and 81 seconds to run Ubuntu 14.04 (a different machine from the above) For MySQL 5.5 the tests take: 115 seconds and 393 seconds to run. For Postgres 9.3 the tests take: 23 seconds and 76 seconds to run MySQL 5.7 tests for Ubuntu 16.04: Start non-root disk tests  === Starting acl-xattr-test at 09:52:46 ===    ===== acl-xattr-test OK 09:56:46 00:03:59 239s =====   === Starting action-on-purge-test at 09:57:23 ===    ===== action-on-purge-test OK 10:11:05 00:13:42 822s ===== PostgreSQL tests: Start non-root disk tests  === Starting acl-xattr-test at 10:13:21 ===   ===== acl-xattr-test OK 10:13:45 00:00:23 23s =====   === Starting action-on-purge-test at 10:13:56 ===    ===== action-on-purge-test OK 10:15:18 00:01:21 81s =====
2016-07-20 19:42:17 C de-Avillez bug task added bacula (Ubuntu Xenial)
2016-09-07 22:00:04 Nish Aravamudan bacula (Ubuntu): assignee Nish Aravamudan (nacc)
2016-09-07 22:00:07 Nish Aravamudan bacula (Ubuntu Xenial): assignee Nish Aravamudan (nacc)
2016-09-07 22:00:52 Nish Aravamudan bacula (Ubuntu Xenial): status New In Progress
2016-09-08 17:52:23 Brian Murray bacula (Ubuntu Xenial): status In Progress Fix Committed
2016-09-08 17:52:26 Brian Murray bug added subscriber Ubuntu Stable Release Updates Team
2016-09-08 17:52:33 Brian Murray bug added subscriber SRU Verification
2016-09-08 17:52:40 Brian Murray tags mysql-5.7-transition patch mysql-5.7-transition patch verification-needed
2016-09-08 23:50:07 Mathew Hodson bacula (Ubuntu): importance Undecided Medium
2016-09-08 23:50:09 Mathew Hodson bacula (Ubuntu Xenial): importance Undecided Medium
2016-10-21 16:48:38 Nish Aravamudan tags mysql-5.7-transition patch verification-needed mysql-5.7-transition patch verification-done
2016-10-26 12:33:12 Launchpad Janitor bacula (Ubuntu Xenial): status Fix Committed Fix Released
2016-10-26 12:33:43 Chris J Arges removed subscriber Ubuntu Stable Release Updates Team