On the question of wild instability of results on Linux: I've tried doing 10 runs on Fedora 16, x8_64:
MariaDB 5.2: sysbench 0.5: multi-threaded system evaluation benchmark
Running the test with following options: Number of threads: 10 Random number generator seed is 0 and will be ignored
Threads started!
OLTP test statistics: queries performed: read: 1454781 read: 1445217 read: 1486174 read: 1541128 read: 1510506 read: 1484820 read: 1520778 read: 1472821 read: 1377681 read: 1498271 response time: avg: 1.24ms avg: 1.24ms avg: 1.21ms avg: 1.17ms avg: 1.19ms avg: 1.21ms avg: 1.18ms avg: 1.22ms avg: 1.31ms avg: 1.20ms
approx. 95 percentile: 2.72ms approx. 95 percentile: 2.71ms approx. 95 percentile: 2.68ms approx. 95 percentile: 2.60ms approx. 95 percentile: 2.65ms approx. 95 percentile: 2.68ms approx. 95 percentile: 2.64ms approx. 95 percentile: 2.68ms approx. 95 percentile: 2.79ms approx. 95 percentile: 2.66ms ------------------------------ MariaDB 5.3.5: queries performed: read: 1503817 read: 1531896 read: 1637580 read: 1570776 read: 1517940 read: 1600717 read: 1585504 read: 1477577 read: 1543501 read: 1504005 response time: avg: 1.20ms avg: 1.17ms avg: 1.10ms avg: 1.14ms avg: 1.18ms avg: 1.12ms avg: 1.13ms avg: 1.22ms avg: 1.16ms avg: 1.20ms
approx. 95 percentile: 2.67ms approx. 95 percentile: 2.63ms approx. 95 percentile: 2.49ms approx. 95 percentile: 2.57ms approx. 95 percentile: 2.65ms approx. 95 percentile: 2.54ms approx. 95 percentile: 2.56ms approx. 95 percentile: 2.70ms approx. 95 percentile: 2.63ms approx. 95 percentile: 2.67ms
.. as one can see, there is not much variety.
On the question of wild instability of results on Linux: I've tried doing 10 runs on Fedora 16, x8_64:
MariaDB 5.2:
sysbench 0.5: multi-threaded system evaluation benchmark
Running the test with following options:
Number of threads: 10
Random number generator seed is 0 and will be ignored
Threads started!
OLTP test statistics:
queries performed:
read: 1454781
read: 1445217
read: 1486174
read: 1541128
read: 1510506
read: 1484820
read: 1520778
read: 1472821
read: 1377681
read: 1498271
response time:
avg: 1.24ms
avg: 1.24ms
avg: 1.21ms
avg: 1.17ms
avg: 1.19ms
avg: 1.21ms
avg: 1.18ms
avg: 1.22ms
avg: 1.31ms
avg: 1.20ms
approx. 95 percentile: 2.72ms ------- ------- ------- --
approx. 95 percentile: 2.71ms
approx. 95 percentile: 2.68ms
approx. 95 percentile: 2.60ms
approx. 95 percentile: 2.65ms
approx. 95 percentile: 2.68ms
approx. 95 percentile: 2.64ms
approx. 95 percentile: 2.68ms
approx. 95 percentile: 2.79ms
approx. 95 percentile: 2.66ms
-------
MariaDB 5.3.5:
queries performed:
read: 1503817
read: 1531896
read: 1637580
read: 1570776
read: 1517940
read: 1600717
read: 1585504
read: 1477577
read: 1543501
read: 1504005
response time:
avg: 1.20ms
avg: 1.17ms
avg: 1.10ms
avg: 1.14ms
avg: 1.18ms
avg: 1.12ms
avg: 1.13ms
avg: 1.22ms
avg: 1.16ms
avg: 1.20ms
approx. 95 percentile: 2.67ms
approx. 95 percentile: 2.63ms
approx. 95 percentile: 2.49ms
approx. 95 percentile: 2.57ms
approx. 95 percentile: 2.65ms
approx. 95 percentile: 2.54ms
approx. 95 percentile: 2.56ms
approx. 95 percentile: 2.70ms
approx. 95 percentile: 2.63ms
approx. 95 percentile: 2.67ms
.. as one can see, there is not much variety.