I ran some fio benchmarks.
random writes
fio_test_file: (groupid=0, jobs=16): err= 0: pid=28006: Thu Jul 31 20:08:44 2014 write: io=2513.7MB, bw=14296KB/s, iops=893 , runt=180007msec clat (usec): min=905 , max=3779.3K, avg=17898.56, stdev=113343.28 lat (usec): min=906 , max=3779.3K, avg=17902.24, stdev=113343.22 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1064], 10.00th=[ 1096], 20.00th=[ 1176], | 30.00th=[ 1288], 40.00th=[ 1432], 50.00th=[ 1704], 60.00th=[ 2192], | 70.00th=[ 3344], 80.00th=[ 6944], 90.00th=[18816], 95.00th=[38656], | 99.00th=[460800], 99.50th=[749568], 99.90th=[1744896], 99.95th=[2244608], | 99.99th=[2768896] bw (KB/s) : min= 4, max= 4672, per=8.70%, avg=1244.28, stdev=1276.62 lat (usec) : 1000=1.38% lat (msec) : 2=55.66%, 4=15.81%, 10=11.21%, 20=6.51%, 50=5.33% lat (msec) : 100=1.80%, 250=0.95%, 500=0.48%, 750=0.37%, 1000=0.18% lat (msec) : 2000=0.25%, >=2000=0.07% cpu : usr=0.03%, sys=0.25%, ctx=162974, majf=0, minf=432 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued : total=r=0/w=160836/d=0, short=r=0/w=0/d=0
Run status group 0 (all jobs): WRITE: io=2513.7MB, aggrb=14295KB/s, minb=14295KB/s, maxb=14295KB/s, mint=180007msec, maxt=180007msec
Disk stats (read/write): md0: ios=3/161372, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/40637, aggrmerge=0/76, aggrticks=4/733975, aggrin_queue=733976, aggrutil=86.50% xvdg: ios=0/47767, merge=0/74, ticks=0/2029021, in_queue=2029018, util=86.50% xvdh: ios=0/38299, merge=0/80, ticks=0/158279, in_queue=158277, util=27.64% xvdi: ios=3/38293, merge=0/60, ticks=16/74085, in_queue=74099, util=20.61% xvdf: ios=0/38190, merge=0/92, ticks=0/674515, in_queue=674510, util=47.29%
I ran some fio benchmarks.
random writes
fio_test_file: (groupid=0, jobs=16): err= 0: pid=28006: Thu Jul 31 20:08:44 2014 0/w=160836/ d=0, short=r=0/w=0/d=0
write: io=2513.7MB, bw=14296KB/s, iops=893 , runt=180007msec
clat (usec): min=905 , max=3779.3K, avg=17898.56, stdev=113343.28
lat (usec): min=906 , max=3779.3K, avg=17902.24, stdev=113343.22
clat percentiles (usec):
| 1.00th=[ 988], 5.00th=[ 1064], 10.00th=[ 1096], 20.00th=[ 1176],
| 30.00th=[ 1288], 40.00th=[ 1432], 50.00th=[ 1704], 60.00th=[ 2192],
| 70.00th=[ 3344], 80.00th=[ 6944], 90.00th=[18816], 95.00th=[38656],
| 99.00th=[460800], 99.50th=[749568], 99.90th=[1744896], 99.95th=[2244608],
| 99.99th=[2768896]
bw (KB/s) : min= 4, max= 4672, per=8.70%, avg=1244.28, stdev=1276.62
lat (usec) : 1000=1.38%
lat (msec) : 2=55.66%, 4=15.81%, 10=11.21%, 20=6.51%, 50=5.33%
lat (msec) : 100=1.80%, 250=0.95%, 500=0.48%, 750=0.37%, 1000=0.18%
lat (msec) : 2000=0.25%, >=2000=0.07%
cpu : usr=0.03%, sys=0.25%, ctx=162974, majf=0, minf=432
IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=
Run status group 0 (all jobs):
WRITE: io=2513.7MB, aggrb=14295KB/s, minb=14295KB/s, maxb=14295KB/s, mint=180007msec, maxt=180007msec
Disk stats (read/write): queue=733976, aggrutil=86.50%
md0: ios=3/161372, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/40637, aggrmerge=0/76, aggrticks=4/733975, aggrin_
xvdg: ios=0/47767, merge=0/74, ticks=0/2029021, in_queue=2029018, util=86.50%
xvdh: ios=0/38299, merge=0/80, ticks=0/158279, in_queue=158277, util=27.64%
xvdi: ios=3/38293, merge=0/60, ticks=16/74085, in_queue=74099, util=20.61%
xvdf: ios=0/38190, merge=0/92, ticks=0/674515, in_queue=674510, util=47.29%