申威下单盘SSD与四块盘RAID5的性能测试结果

背景

背景不在说了 申威服务器..

结论

天坑
做了raid写入性能下降明显. 
充分怀疑驱动不行. 

四快盘的raid5 跟单盘的读几乎没区别. 
感觉这个设置太失败了. 
总体的结果为:
读的情况合计都为 70k
但是写入的情况  RAID卡不足30K的IOPS
单盘可以达到 66k.  

另外也加急验证了一把sysbench: 
单盘比raid卡要好.

读的测试结果

测试项目

Raid卡

单SSD盘

read128k

8801

3914

randread128k

2575

2768

read16k

13800

13600

randread16k

5331

6272

read8k

13300

14600

randread8k

6556

7411

read1k

14400

14400

randread1k

7425

8366

写的测试结果

测试项目

Raid卡

单SSD盘

write128k

1530

2586

randwrite128k

1172

2670

write16k

3528

8607

randwrite16k

2991

8623

write8k

4413

10500

randwrite8k

3729

10100

write1k

5692

11900

randwrite1k

4189

11200

sysbench的测试结果

硬盘方式

测试结果

Raid卡

1040

单盘SSD

1114

性能测试-单盘SSD验证

write128k
  write: IOPS=2586, BW=323MiB/s (339MB/s)(4096MiB/12669msec)
read128k
   read: IOPS=3914, BW=489MiB/s (513MB/s)(4096MiB/8371msec)
randwrite128k
  write: IOPS=2670, BW=334MiB/s (350MB/s)(4096MiB/12272msec)
randread128k
   read: IOPS=2768, BW=346MiB/s (363MB/s)(4096MiB/11835msec)
write16k
  write: IOPS=8607, BW=134MiB/s (141MB/s)(4035MiB/30001msec)
read16k
   read: IOPS=13.6k, BW=213MiB/s (223MB/s)(4096MiB/19265msec)
randwrite16k
  write: IOPS=8623, BW=135MiB/s (141MB/s)(4042MiB/30001msec)
randread16k
   read: IOPS=6272, BW=98.0MiB/s (103MB/s)(2940MiB/30001msec)
write8k
  write: IOPS=10.5k, BW=81.0MiB/s (85.0MB/s)(2460MiB/30001msec)
read8k
   read: IOPS=14.6k, BW=114MiB/s (119MB/s)(3414MiB/30001msec)
randwrite8k
  write: IOPS=10.1k, BW=78.9MiB/s (82.7MB/s)(2366MiB/30001msec)
randread8k
   read: IOPS=7411, BW=57.9MiB/s (60.7MB/s)(1737MiB/30001msec)
write1k
  write: IOPS=11.9k, BW=11.6MiB/s (12.1MB/s)(348MiB/30001msec)
read1k
   read: IOPS=14.4k, BW=14.1MiB/s (14.8MB/s)(423MiB/30001msec)
randwrite1k
  write: IOPS=11.2k, BW=10.9MiB/s (11.4MB/s)(327MiB/30001msec)
randread1k
   read: IOPS=8366, BW=8366KiB/s (8567kB/s)(245MiB/30001msec)

性能测试-四SSD 9361 8i Raid5验证

write128k
  write: IOPS=1530, BW=191MiB/s (201MB/s)(4096MiB/21414msec)
read128k
   read: IOPS=8801, BW=1100MiB/s (1154MB/s)(4096MiB/3723msec)
randwrite128k
  write: IOPS=1172, BW=147MiB/s (154MB/s)(4096MiB/27944msec)
randread128k
   read: IOPS=2575, BW=322MiB/s (338MB/s)(4096MiB/12725msec)
write16k
  write: IOPS=3528, BW=55.1MiB/s (57.8MB/s)(1654MiB/30001msec)
read16k
   read: IOPS=13.8k, BW=215MiB/s (225MB/s)(4096MiB/19056msec)
randwrite16k
  write: IOPS=2991, BW=46.7MiB/s (49.0MB/s)(1402MiB/30001msec)
randread16k
   read: IOPS=5331, BW=83.3MiB/s (87.4MB/s)(2499MiB/30001msec)
write8k
  write: IOPS=4413, BW=34.5MiB/s (36.2MB/s)(1034MiB/30001msec)
read8k
   read: IOPS=13.3k, BW=104MiB/s (109MB/s)(3124MiB/30001msec)
randwrite8k
  write: IOPS=3729, BW=29.1MiB/s (30.6MB/s)(874MiB/30001msec)
randread8k
   read: IOPS=6556, BW=51.2MiB/s (53.7MB/s)(1537MiB/30001msec)
write1k
  write: IOPS=5692, BW=5692KiB/s (5829kB/s)(167MiB/30001msec)
read1k
   read: IOPS=14.4k, BW=14.1MiB/s (14.8MB/s)(423MiB/30001msec)
randwrite1k
  write: IOPS=4189, BW=4189KiB/s (4290kB/s)(123MiB/30001msec)
randread1k
   read: IOPS=7425, BW=7426KiB/s (7604kB/s)(218MiB/30001msec)

单盘SSD的sysbench

SQL statistics:
    queries performed:
        read:                            936796
        write:                           267656
        other:                           133828
        total:                           1338280
    transactions:                        66914  (1114.91 per sec.)
    queries:                             1338280 (22298.23 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)

General statistics:
    total time:                          60.0116s
    total number of events:              66914

Latency (ms):
         min:                                    7.76
         avg:                                    8.96
         max:                                  160.74
         99th percentile:                       14.21
         sum:                               599690.88

Threads fairness:
    events (avg/stddev):           6691.4000/68.50
    execution time (avg/stddev):   59.9691/0.00

Raid卡 四块SSD的 sysbench

SQL statistics:
    queries performed:
        read:                            1748964
        write:                           499698
        other:                           249854
        total:                           2498516
    transactions:                        124924 (1040.88 per sec.)
    queries:                             2498516 (20817.94 per sec.)
    ignored errors:                      2      (0.02 per sec.)
    reconnects:                          0      (0.00 per sec.)

General statistics:
    total time:                          120.0118s
    total number of events:              124924

Latency (ms):
         min:                                    8.02
         avg:                                    9.60
         max:                                  176.96
         99th percentile:                       19.29
         sum:                              1199283.15

Threads fairness:
    events (avg/stddev):           12492.4000/82.12
    execution time (avg/stddev):   119.9283/0.00