Simple TESTs to check upper bounds: + time sh -c 'mkfile 32g bla ; sync' ; \ + time sh -c 'mkfile 32g blabla ; sync' ; \ + time sh -c 'mkfile 32g blablabla ; sync' ; \ + time sh -c 'mkfile 32g blablablabla ; sync' + chmod 644 b* + time dd if=bla of=/dev/null bs=128k ; \ + time dd if=blabla of=/dev/null bs=128k ; \ + time dd if=blablabla of=/dev/null bs=128k ; \ + time dd if=blablablabla of=/dev/null bs=128k Solaris Express b151 2x Intel(r) Xeon(r) CPU X5680 @ 3.33GHz (6 cores with 2 HTs) 96 GB ECC SEAGATE ST9300603SS 0006 279GiB 512 (2.5" SAS2 10K) LSI SAS 9211-8i (SAS2) direkt zpool Single disk: [MiB/s] mxpio=disabled PCIe 2.0 x8 write 100.6 98.7 93.9 89.9 read 116.9 115.2 1265.2 5957.9 zpool stripe of 2: [MiB/s] mxpio=disabled PCIe 2.0 x8 write 208.6 209.2 203.6 197.7 read 226.7 245.1 5748.8 5649.7 zpool 2-way mirror: [MiB/s] mxpio=disabled PCIe 2.0 x8 write 99.0 96.4 93.4 88.4 read 192.2 181.3 173.4 5748.8 SEAGATE ST9146852SS 0005 136GiB 512 (2.5" SAS2 15K) LSI SAS 9200-8e (SAS2) via LSI J620 (Marketing: up to 320,000 IOPs) zpool Single disk: [MiB/s] mxpio=disabled PCIe 2.0 x4 PCIe 2.0 x8 write 129.9 123.9 112.2 100.3 read 153.2 145.4 134.0 125.3 UFS Single disk: [MiB/s] mxpio=enabled (8K) PCIe 2.0 x4 PCIe 2.0 x8 write 120.6 114.2 118.6 123.4 read 188.5 150.7 728.2 2391.9 zpool stripe of 24: [MiB/s] mxpio=disabled PCIe 2.0 x4 PCIe 2.0 x8 write 1305.5 1343.0 1326.7 1316.0 1998.1 1916.3 1974.0 1820.5 read 1187.3 1204.7 1195.9 1213.7 1222.7 1231.9 1222.7 1209.2 zpool stripe of 24: [MiB/s] mxpio=enabled PCIe 2.0 x4 PCIe 2.0 x8 write 1359.7 1354.0 1343.0 1326.7 2114.1 1939.0 1771.3 1800.1 read 1122.2 1133.9 1114.6 1130.0 1236.6 1191.6 1200.3 1218.2 SUM of 2x zpool of 2 stripes of 12: [MiB/s] mxpio=disabled PCIe 2.0 x4 PCIe 2.0 x8 write 1501.5 1459.7 1466.2 1489.5 2541.6 2473.1 2530.4 2463.8 read 1482.8 1487.8 1503.2 1518.9 1820.5 1805.4 1854.4 1835.8 zpool of 12x 2-way mirrors: [MiB/s] mxpio=disabled PCIe 2.0 x4 PCIe 2.0 x8 write 684.1 692.8 682.7 679.9 1290.1 1305.5 1255.5 1241.3 read 1213.7 1236.6 1231.9 1231.9 1213.7 1231.9 1236.6 1241.3 zpool of 6x 2-way mirrors: [MiB/s] mxpio=disabled PCIe 2.0 x4 PCIe 2.0 x8 write 671.5 672.9 651.5 647.6 743.1 746.5 734.7 723.5 read 801.2 833.8 848.9 819.2 801.2 801.2 813.1 813.1 SUM of 2x zpool of 6x 2-way mirrors: [MiB/s] mxpio=disabled PCIe 2.0 x4 PCIe 2.0 x8 write 734.3 755.9 760.3 752.5 1387.1 1303.0 1320.0 1324.0 read 1474.5 1471.1 1446.7 1471.1 1646.8 1644.6 1687.0 1659.3 stripe of 2 (ST9300603SS): zpool create pool1 c16t5000C5002C6C35DDd0 c11t5000C5002C6D3235d0 2-way mirror (ST9300603SS): zpool create pool1 mirror c16t5000C5002C6C35DDd0 c11t5000C5002C6D3235d0 stripe of 24 (ST9146852SS): prtconf -v | gawk -f etc/prtconf2disk.awk | sort -k 4,4 -k 3,3n | \ grep w50080e521d32b03f | \ awk '{ A = A " " $2 } END { print "zpool create pool2" A }' 12 2-way mirrors (ST9146852SS): prtconf -v | gawk -f etc/prtconf2disk.awk | sort -k 4,4 -k 3,3n | \ grep w50080e521d32b03f | \ nawk '{ A = A " mirror " $2; getline; A = A " " $2; } \ END { print "zpool create pool2 " A }' 2x 2 stripes of 12: prtconf -v | gawk -f etc/prtconf2disk.awk | sort -k 4,4 -k 3,3n | \ grep w50080e521d32b03f | \ nawk '{ if (k > 11) { B = B " " $2 } else { A = A " " $2; k++} } \ END { print "zpool create pool2 " A "\nzpool create pool3 " B }' 2x 6x 2-way mirrors: prtconf -v | gawk -f etc/prtconf2disk.awk | sort -k 4,4 -k 3,3n | \ grep w50080e521d32b03f | \ nawk '{ P=$2; getline; \ if (k > 5) { B = B " mirror " P " " $2 } \ else { A = A " mirror " P " " $2; k++} } \ END { print "zpool create pool2 " A "\nzpool create pool3 " B }' HGST Ultrastar SS200 (SDLL1DLR960GCCA1) - 4096 (2.5" SAS3 960GB SSD): 2x LSI SAS 9211-8i (SAS2) direkt - Solaris 11.3.35.6.0 zpool Single disk: [MiB/s] mxpio=disabled PCIe 2.0 x8 write 2463.8 2501.4 2560.0 2621.4 read 11299.3 11299.3 11299.3 11299.3 zpool 2x 2-way mirrors: [MiB/s] mxpio=disabled PCIe 2.0 x8 write 2463.8 2520.6 2445.4 2580.2 read 11702.9 11299.3 11702.9 11299.3