Reran performance measurements

git-svn-id: http://svn.code.sf.net/p/scst/svn/trunk@3892 d57e44dd-8a1f-0410-8b47-8ef2f437770f
This commit is contained in:
Bart Van Assche
2011-10-08 11:08:55 +00:00
parent 58a2b2ece8
commit d9658fcda4

View File

@@ -2,117 +2,70 @@ Setup details
=============
Initiator system hardware:
* IB HCA: QDR Mellanox ConnectX MT26428
* CPU: Intel Core2 Duo E6750 @ 2.66 GHz.
* IB HCA: QDR Mellanox ConnectX MT26428.
* CPU: Intel Core2 Duo E8400 @ 3.00 GHz.
Initiator system hardware configuration:
* CPU frequency scaling was disabled.
* IRQ affinity for mlx4_core: not bound to a CPU core (smp_affinity=3).
Initiator system software:
* Kernel 2.6.34.1
* Kernel 2.6.34.10
* fio version fio-1.59-2-g5efce23
Initiator system software configuration:
* Runlevel: 3.
* SRP initiator was loaded with parameter srp_sg_tablesize=128.
* SRP initiator was loaded with parameter srp_sg_tablesize=255.
* SRP initiator block device I/O scheduler: noop.
Target system hardware:
* IB HCA: QDR Mellanox ConnectX MT26428
* CPU: Intel Core2 Duo E8400 @ 3.00 GHz.
* IB HCA: QDR Mellanox ConnectX MT26428.
* CPU: Intel Core i5-2400 @ 3.10 GHz.
Target system hardware configuration:
* CPU frequency scaling was disabled.
* IRQ affinity for mlx4-comp-0: not bound to a CPU core (smp_affinity=3).
* IRQ affinity for mlx4-comp-0: not bound to a CPU core (smp_affinity=f).
Target system software:
* 2.6.34 kernel with SCST patches applied and with kernel debugging disabled.
* 2.6.34.10 kernel with SCST patches applied and with kernel debugging disabled.
* Mainstream kernel InfiniBand drivers (no OFED).
* SCST revision 1857 built in release mode (make debug2release) and
with SCST_MAX_TGT_DEV_COMMANDS equal to 48.
* SCST revision 3883 built in performance mode (make 2perf) and with
SCST_MAX_TGT_DEV_COMMANDS equal to 64.
Target system software configuration:
* Runlevel: 3.
* ib_srpt kernel module was loaded with the parameter thread=0.
* ib_srpt kernel module was loaded with the parameter srp_max_req_size=4200.
* A 1 GB file residing on a tmpfs filesystem was exported towards the
initiator system.
initiator system. From scst.conf:
HANDLER vdisk_fileio {
DEVICE disk01 {
filename /dev/vdisk
nv_cache 1
threads_num 1
}
}
Measurement results
===================
+ blockdev-perftest -f -d -s 30 -m 12 /dev/sdb
blocksize W W W W(avg, W(std, W R R R R(avg, R(std, R
(bytes) (s) (s) (s) MB/s) MB/s) (IOPS) (s) (s) (s) MB/s) MB/s) (IOPS)
67108864 1.250 1.251 1.252 818.484 0.471 12.789 0.602 0.601 0.603 1701.977 2.425 26.593
33554432 1.221 1.222 1.220 838.449 0.483 26.202 0.610 0.610 0.608 1680.218 2.441 52.507
16777216 1.200 1.208 1.200 851.360 2.694 53.210 0.624 0.624 0.623 1642.135 1.226 102.633
8388608 1.154 1.153 1.155 887.313 0.716 110.914 0.676 0.670 0.651 1539.438 24.668 192.430
4194304 1.085 1.094 1.089 940.192 3.360 235.048 0.699 0.727 0.702 1444.004 25.142 361.001
2097152 1.127 1.130 1.130 906.980 0.975 453.490 0.795 0.783 0.783 1301.447 9.198 650.724
1048576 1.221 1.225 1.219 837.981 1.744 837.981 0.891 0.891 0.895 1147.564 2.127 1147.564
524288 1.449 1.450 1.449 706.579 0.141 1413.158 1.045 1.040 1.038 983.418 2.570 1966.836
262144 1.585 1.581 1.585 646.580 0.803 2586.320 1.110 1.109 1.110 922.567 0.557 3690.269
131072 1.751 1.753 1.763 583.286 1.783 4666.290 1.244 1.239 1.240 825.115 1.416 6600.917
65536 2.180 2.185 2.174 469.835 0.961 7517.363 1.592 1.562 1.563 651.305 5.637 10420.879
32768 2.924 2.959 2.918 349.049 2.165 11169.563 2.221 2.227 2.215 461.049 0.970 14753.581
16384 4.374 4.395 4.396 233.338 0.533 14933.643 3.437 3.409 3.416 299.369 1.022 19159.585
8192 7.400 7.436 7.445 137.874 0.360 17647.884 5.913 5.932 5.930 172.820 0.247 22120.931
4096 13.079 13.268 13.207 77.670 0.464 19883.400 10.686 10.648 10.656 96.028 0.148 24583.280
+ blockdev-perftest -f -a -s 30 -m 12 /dev/sdb
blocksize W W W W(avg, W(std, W R R R R(avg, R(std, R
(bytes) (s) (s) (s) MB/s) MB/s) (IOPS) (s) (s) (s) MB/s) MB/s) (IOPS)
67108864 2.018 2.046 2.006 506.134 4.091 7.908 1.515 1.511 1.516 676.438 0.814 10.569
33554432 1.998 2.022 1.997 510.577 2.933 15.956 1.508 1.512 1.511 678.075 0.823 21.190
16777216 2.011 1.997 1.998 511.558 1.636 31.972 1.515 1.510 1.517 676.415 1.280 42.276
8388608 1.998 2.019 2.003 510.279 2.266 63.785 1.489 1.497 1.486 687.019 2.047 85.877
4194304 1.948 1.979 1.949 522.812 3.882 130.703 1.382 1.385 1.385 739.782 0.823 184.945
2097152 1.707 1.695 1.696 602.627 1.853 301.313 1.274 1.270 1.284 802.520 3.848 401.260
1048576 1.385 1.411 1.401 731.984 5.613 731.984 1.148 1.190 1.175 874.622 12.953 874.622
524288 1.319 1.308 1.338 774.982 7.152 1549.965 1.136 1.139 1.140 899.357 1.243 1798.714
262144 1.310 1.305 1.324 779.899 4.803 3119.597 1.132 1.129 1.129 906.074 1.313 3624.295
131072 1.324 1.323 1.333 771.847 2.702 6174.780 1.135 1.132 1.132 903.715 1.237 7229.716
65536 1.304 1.316 1.302 783.338 3.731 12533.402 1.145 1.143 1.132 898.495 4.641 14375.927
32768 1.316 1.351 1.316 771.388 9.403 24684.407 1.139 1.141 1.135 899.459 1.842 28782.694
16384 1.349 1.314 1.312 772.877 9.936 49464.155 1.149 1.152 1.144 891.722 2.721 57070.239
8192 1.332 1.320 1.355 766.724 8.241 98140.706 1.162 1.144 1.175 882.757 9.511 112992.880
4096 1.374 1.364 1.389 744.407 5.620 190568.208 1.185 1.173 1.189 865.959 5.002 221685.510
Numer of read IOPS reported by fio with block size 4 KB and I/O depth 32:
197000
+ blockdev-perftest -f -j -d -s 30 -m 12 /dev/sdb
blocksize W W W W(avg, W(std, W R R R R(avg, R(std, R
(bytes) (s) (s) (s) MB/s) MB/s) (IOPS) (s) (s) (s) MB/s) MB/s) (IOPS)
67108864 0.726 0.727 0.730 1407.245 3.283 21.988 0.600 0.600 0.599 1707.616 1.343 26.682
33554432 0.738 0.731 0.720 1403.526 14.290 43.860 0.605 0.605 0.605 1692.562 0.000 52.893
16777216 0.725 0.726 0.731 1407.901 5.069 87.994 0.619 0.616 0.617 1658.754 3.349 103.672
8388608 0.746 0.745 0.756 1367.216 9.025 170.902 0.639 0.640 0.640 1600.835 1.180 200.104
4194304 0.775 0.783 0.782 1312.848 6.009 328.212 0.672 0.675 0.678 1517.057 5.505 379.264
2097152 0.863 0.871 0.865 1182.011 4.628 591.006 0.741 0.740 0.738 1384.411 2.336 692.206
1048576 0.964 0.960 0.973 1060.441 5.956 1060.441 0.840 0.837 0.849 1216.196 7.342 1216.196
524288 1.197 1.185 1.198 858.122 4.262 1716.243 0.981 1.001 0.994 1032.330 8.649 2064.661
262144 1.312 1.311 1.313 780.488 0.486 3121.952 1.079 1.112 1.109 931.082 12.730 3724.326
131072 1.536 1.538 1.533 666.813 0.893 5334.501 1.268 1.260 1.261 810.774 2.280 6486.196
65536 1.943 1.937 1.941 527.745 0.679 8443.924 1.654 1.644 1.646 621.363 1.626 9941.816
32768 2.755 2.753 2.745 372.229 0.585 11911.334 2.321 2.286 2.303 444.590 2.758 14226.886
16384 4.371 4.325 4.366 235.191 1.117 15052.245 3.644 3.680 3.644 280.094 1.296 17925.987
8192 7.553 7.589 7.531 135.493 0.428 17343.092 6.333 6.223 6.248 163.379 1.222 20912.470
4096 13.793 13.573 13.802 74.626 0.579 19104.136 11.348 11.551 11.287 89.870 0.885 23006.749
+ blockdev-perftest -f -j -a -s 30 -m 12 /dev/sdb
blocksize W W W W(avg, W(std, W R R R R(avg, R(std, R
(bytes) (s) (s) (s) MB/s) MB/s) (IOPS) (s) (s) (s) MB/s) MB/s) (IOPS)
67108864 1.505 1.508 1.504 680.098 0.767 10.627 1.345 1.345 1.345 761.338 0.000 11.896
33554432 1.515 1.503 1.503 679.505 2.544 21.235 1.342 1.342 1.340 763.420 0.537 23.857
16777216 1.506 1.512 1.504 679.349 1.530 42.459 1.337 1.337 1.336 766.085 0.270 47.880
8388608 1.514 1.505 1.504 679.201 2.022 84.900 1.321 1.325 1.323 774.000 0.955 96.750
4194304 1.511 1.518 1.506 677.405 2.204 169.351 1.246 1.239 1.239 824.925 2.189 206.231
2097152 1.498 1.491 1.503 683.890 2.249 341.945 1.035 1.037 1.042 986.520 2.794 493.260
1048576 1.405 1.414 1.406 727.107 2.075 727.107 0.950 0.954 0.960 1072.646 4.613 1072.646
524288 1.308 1.345 1.308 775.696 10.152 1551.392 0.904 0.907 0.921 1124.525 9.103 2249.050
262144 1.316 1.294 1.299 785.920 5.657 3143.678 0.907 0.907 0.904 1130.246 1.766 4520.982
131072 1.248 1.239 1.237 824.932 3.172 6599.453 0.882 0.874 0.878 1166.303 4.338 9330.425
65536 1.278 1.266 1.257 808.246 5.481 12931.929 0.887 0.883 0.885 1157.066 2.135 18513.057
32768 1.311 1.299 1.302 785.288 3.064 25129.218 0.891 0.891 0.890 1149.701 0.609 36790.429
16384 1.391 1.399 1.378 737.073 4.599 47172.659 0.935 0.934 0.937 1094.799 1.459 70067.124
8192 1.550 1.533 1.529 666.112 3.931 85262.303 1.011 1.010 1.012 1012.859 0.818 129645.980
4096 1.864 1.847 1.862 551.238 2.257 141117.020 1.289 1.290 1.287 794.621 0.769 203422.850
blocksize W W W W(avg, W(std, W R R R R(avg, R(std, R
(bytes) (s) (s) (s) MB/s) MB/s) (IOPS) (s) (s) (s) MB/s) MB/s) (IOPS)
67108864 0.568 0.573 0.572 1793.371 6.800 28.021 0.373 0.372 0.372 2750.228 3.479 42.972
33554432 0.553 0.570 0.563 1822.346 22.683 56.948 0.374 0.374 0.373 2740.415 3.460 85.638
16777216 0.552 0.554 0.552 1852.840 3.157 115.803 0.387 0.384 0.384 2659.776 9.745 166.236
8388608 0.525 0.526 0.525 1949.240 1.748 243.655 0.411 0.409 0.410 2497.571 4.974 312.196
4194304 0.542 0.540 0.541 1892.795 2.857 473.199 0.433 0.437 0.428 2366.890 20.165 591.722
2097152 0.611 0.610 0.612 1675.944 2.240 837.972 0.517 0.512 0.511 1994.857 10.167 997.429
1048576 0.678 0.691 0.684 1496.437 11.609 1496.437 0.588 0.597 0.586 1734.727 13.989 1734.727
524288 0.946 0.941 0.947 1083.989 3.017 2167.977 0.808 0.784 0.788 1290.981 16.943 2581.961
262144 1.102 1.167 1.152 898.524 22.201 3594.096 0.968 0.964 0.970 1058.587 2.732 4234.349
131072 1.289 1.239 1.249 813.581 13.820 6508.648 1.076 1.074 1.071 953.745 1.826 7629.957
65536 1.599 1.604 1.608 638.540 1.466 10216.641 1.389 1.396 1.405 733.190 3.436 11731.045
32768 2.300 2.319 2.309 443.423 1.490 14189.537 1.976 2.004 1.967 516.595 4.088 16531.055
16384 3.780 3.777 3.788 270.780 0.332 17329.951 3.210 3.086 3.050 328.854 7.147 21046.655
8192 6.800 6.406 6.560 155.512 3.804 19905.533 5.409 5.250 5.272 192.865 2.533 24686.738
4096 12.368 12.240 11.924 84.111 1.298 21532.302 9.561 9.847 9.559 106.072 1.472 27154.518