E5-2690 Talos Ugrade: BIOS 1.1.2 -> 1.1.8, FW 3.00E -> 3.20E sd config: sd46: 'OCZ TALOS2 ' S/N: 6OT21Y9E2118 Tunables: throttle-max (max #cmds allowed in transport) : 256 controller-type : 2 retries-notready (# of tries before error) : 1 retries-busy (# of tries before cmd failing) : 3 retries-reset (# of tries before reset) : 1 timeout-releasereservation : 5 throttle-min (min #cmds allowed in transport) : 8 disksort (lba sorting enabled) : 1 reset-lun (device supports lun reset) : 0 cache-nonvolatile (suppress cache flush) : 0 power-condition (power condition enabled) : 1 delay-busy (µs to wait before retry throttled cmd): 500 retries-timeout (# of times to retry a normal op) : 3 rmw-type : 0 emulation-rmw (rmw forced) : 0 physical-block-size [byte] : 512 Mmc-gesn-polling (GetEventStatusPolling enabled) : 1 Misc: System blocksize [byte] : 512 Sd logical blocksize [byte] : 512 Sd system blocks : 781443840 Command timeout (Timeout for completion) : 60 Max. DMA transfer size : 1048576 Is SSD : 1 Sync cache command supported : 1 Sync nv cache supported : 0 Sync nv cache required : 0 Write cache enabled : 0 Adaptive throttling enabled : 1 Power Management enabled : 1 Power Management supported : 0 Is Hotpluggable : 0 Current Power Level : 1 setenv JBOD1 /dev/chassis/JBOD1 + zpool create -o failmode=continue -O compression=on -O atime=off pool1 \ mirror $JBOD1/SLOT_01_/disk $JBOD1/SLOT_02_/disk \ mirror $JBOD1/SLOT_03_/disk $JBOD1/SLOT_04_/disk \ mirror $JBOD1/SLOT_05_/disk $JBOD1/SLOT_06_/disk \ mirror $JBOD1/SLOT_07_/disk $JBOD1/SLOT_08_/disk \ mirror $JBOD1/SLOT_09_/disk $JBOD1/SLOT_10_/disk \ mirror $JBOD1/SLOT_11_/disk $JBOD1/SLOT_12_/disk \ mirror $JBOD1/SLOT_13_/disk $JBOD1/SLOT_14_/disk \ mirror $JBOD1/SLOT_15_/disk $JBOD1/SLOT_16_/disk \ mirror $JBOD1/SLOT_17_/disk $JBOD1/SLOT_18_/disk \ mirror $JBOD1/SLOT_19_/disk $JBOD1/SLOT_20_/disk \ mirror $JBOD1/SLOT_21_/disk $JBOD1/SLOT_22_/disk \ mirror $JBOD1/SLOT_23_/disk $JBOD1/SLOT_24_/disk \ spare /dev/chassis/SYS/HDD1/disk /dev/chassis/SYS/HDD9/disk \ log /dev/chassis/SYS/HDD13/disk # Talos2 --------------------------------------------------------------------------- compression=on, atime=off, recordsize=128K --------------------------------------------------------------------------- write 1998.1 2073.9 2087.1 2073.9 MiB/s read 1646.6 1655.0 1655.0 1655.0 MiB/s filebench 1.4.8 (0.175.1.0.0.24.2) as is with 'set $dir=/pool1/test': ops ops/s r/w mb/s cpu/op latency [µs] [ms] fileserver: 10586369 175376.9 15943/31887 4251.9 611 0.8 6444903 106897.6 9718/19436 2590.8 1059 1.4 7076797 117622.3 10693/21386 2850.8 962 1.2 5285970 87906.2 7991/15983 2130.0 1297 1.7 multistreamread: 858245 14298.9 14299/0 14284.9 278 0.3 858857 14313.3 14313/0 14299.3 278 0.3 856490 14262.3 14262/0 14248.4 279 0.3 858727 14310.9 14311/0 14296.9 278 0.3 multistreamwrite: 513378 8555.3 0/8555 8555.3 1334 0.5 537349 8953.2 0/8953 8953.2 1312 0.4 540239 9000.8 0/9001 9000.7 1310 0.4 540382 9004.4 0/9004 9004.3 1309 0.4 oltp: 7824223 130340.0 64847/64825 258.2 77 0.0 7841083 130598.0 64977/64952 258.7 77 0.0 7859409 130913.3 65132/65111 259.3 76 0.0 7824780 130318.7 64839/64812 258.2 77 0.0 singlestreamread: 192878 3213.9 3214/0 3213.2 311 0.3 192917 3212.7 3213/0 3212.0 312 0.3 192596 3207.3 3207/0 3206.7 312 0.3 191034 3181.4 3181/0 3180.7 315 0.3 singlestreamwrite: 126159 2102.0 0/2102 2102.0 1291 0.5 126494 2107.4 0/2107 2107.4 1285 0.5 127085 2116.8 0/2117 2116.8 1286 0.5 128662 2143.2 0/2143 2143.2 1286 0.5 varmail: 1445653 24089.6 3706/3706 75.5 269 2.1 1356997 22613.3 3479/3479 73.5 375 2.2 1438743 23975.2 3688/3689 76.9 275 2.1 1423501 23721.4 3649/3650 76.8 315 2.1 webproxy: 9619569 160169.6 42150/8430 400.5 396 2.0 7466130 124335.1 32720/6544 312.3 542 2.5 9694664 161438.1 42484/8497 403.2 403 1.9 8261081 137566.3 36202/7240 344.0 505 2.3 --------------------------------------------------------------------------- compression=on, atime=off, recordsize=16K --------------------------------------------------------------------------- write 1090.8 1073.0 1110.0 1076.8 MiB/s read 230.7 231.9 231.8 230.4 MiB/s filebench 1.4.8 (0.175.1.0.0.24.2) as is with 'set $dir=/pool1/test': ops ops/s r/w mb/s cpu/op latency [µs] [ms] fileserver: 7088830 117623.3 10693/21386 2851.5 968 1.2 3847577 63778.1 5798/11596 1545.4 1814 2.5 3103618 51417.6 4674/9349 1246.7 2257 3.1 4474911 74265.0 6751/13503 1799.3 1555 2.1 multistreamread: 854128 14231.7 14232/0 14217.8 279 0.3 867376 14451.3 14451/0 14437.2 275 0.3 865915 14427.8 14428/0 14413.7 275 0.3 830733 13835.9 13836/0 13822.4 287 0.3 multistreamwrite: 171817 2862.7 0/2863 2862.6 6492 1.4 192148 3200.9 0/3201 3200.8 6033 1.2 191303 3187.9 0/3188 3187.8 6096 1.2 189318 3154.3 0/3154 3154.3 6124 1.3 oltp: 7683613 127976.5 63677/63643 253.5 81 0.0 7642060 127281.5 63327/63302 252.1 82 0.0 7590367 126421.4 62887/62886 250.5 89 0.0 7346295 122334.5 60863/60844 242.3 95 0.0 singlestreamread: 233212 3882.9 3883/0 3882.1 258 0.3 231451 3854.5 3855/0 3853.7 260 0.3 193562 3222.8 3223/0 3222.1 311 0.3 222812 3713.2 3713/0 3712.5 269 0.3 singlestreamwrite: 69050 1150.0 0/1150 1150.0 5855 0.9 69821 1162.8 0/1163 1162.8 5812 0.9 71171 1185.4 0/1185 1185.4 5710 0.8 70295 1171.1 0/1171 1171.1 5856 0.8 varmail: 1403589 23387.8 3598/3598 75.5 311 2.2 1438331 23969.2 3687/3688 74.9 296 2.1 1477569 24622.0 3788/3788 75.2 277 2.1 1484538 24738.6 3806/3806 75.3 291 2.0 webproxy: 10194873 169778.5 44678/8936 424.1 387 1.8 9869118 164387.6 43260/8652 410.9 398 1.9 9595522 159799.5 42052/8411 398.6 409 2.0 10572159 176037.5 46326/9265 439.8 376 1.8