Comment 9 for bug 941889

Revision history for this message
Sergey Petrunia (sergefp) wrote :

On the question of wild instability of results on Linux: I've tried doing 10 runs on Fedora 16, x8_64:

MariaDB 5.2:
sysbench 0.5: multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 10
Random number generator seed is 0 and will be ignored

Threads started!

OLTP test statistics:
    queries performed:
            read: 1454781
            read: 1445217
            read: 1486174
            read: 1541128
            read: 1510506
            read: 1484820
            read: 1520778
            read: 1472821
            read: 1377681
            read: 1498271
    response time:
         avg: 1.24ms
         avg: 1.24ms
         avg: 1.21ms
         avg: 1.17ms
         avg: 1.19ms
         avg: 1.21ms
         avg: 1.18ms
         avg: 1.22ms
         avg: 1.31ms
         avg: 1.20ms

         approx. 95 percentile: 2.72ms
         approx. 95 percentile: 2.71ms
         approx. 95 percentile: 2.68ms
         approx. 95 percentile: 2.60ms
         approx. 95 percentile: 2.65ms
         approx. 95 percentile: 2.68ms
         approx. 95 percentile: 2.64ms
         approx. 95 percentile: 2.68ms
         approx. 95 percentile: 2.79ms
         approx. 95 percentile: 2.66ms
------------------------------
MariaDB 5.3.5:
    queries performed:
        read: 1503817
        read: 1531896
        read: 1637580
        read: 1570776
        read: 1517940
        read: 1600717
        read: 1585504
        read: 1477577
        read: 1543501
        read: 1504005
    response time:
         avg: 1.20ms
         avg: 1.17ms
         avg: 1.10ms
         avg: 1.14ms
         avg: 1.18ms
         avg: 1.12ms
         avg: 1.13ms
         avg: 1.22ms
         avg: 1.16ms
         avg: 1.20ms

         approx. 95 percentile: 2.67ms
         approx. 95 percentile: 2.63ms
         approx. 95 percentile: 2.49ms
         approx. 95 percentile: 2.57ms
         approx. 95 percentile: 2.65ms
         approx. 95 percentile: 2.54ms
         approx. 95 percentile: 2.56ms
         approx. 95 percentile: 2.70ms
         approx. 95 percentile: 2.63ms
         approx. 95 percentile: 2.67ms

.. as one can see, there is not much variety.