s/CORAID/corosync/

To dedicate resources to producing a good cluster LVM lock manager that does not depend on CORAID?

Something like SGI's CXVM would be great!!!

Obviously you never had to add a driver to a pre-module support kernel with make zImage before going to bed.

I would argue that in 1993 it was very popular.

Compared to SLS is it was a dream.

I did actually buy a CD-ROM drive to install RedHat's Mother's day release in late 1994.

Mostly because I got sick making floppies with dd

I also don't see any mention of an ARC, I don't know if they are even looking at porting that part. But a single disk setup is absolutly not ZFS's strong point.

With a $5000 Super Micro JBOD here are some quick number on a Solaris 11 Express system I set up this week to test the performance.

We are testing it for COMSTAR and as a fibre channel target. With a $10K head and a $5K jbod it runs rings around $100K commercial arrays.

I will have better stats on it's speed from a client perspective but I only have one 4GB HBA in the initiator system, and it fills that pipe quite well on non sync writes.

Writes

root@uszfs002:/tank/test# dd if=/dev/zero of=/tank/test/testfile bs=4k count=20000k
20480000+0 records in
20480000+0 records out
83886080000 bytes (84 GB) copied, 126.938 s, 661 MB/s

Reads.

This is using 22 1TB SATA drives in 11 striped mirrors.
root@uszfs002:/tank/test# dd of=/dev/zero if=/tank/test/testfile bs=4k count=20000k
20480000+0 records in
20480000+0 records out
83886080000 bytes (84 GB) copied, 83.5461 s, 1.0 GB/s /usr/benchmarks/iozone/iozone -Rab /root/20diskraid10.wks

The top row is records sizes, the left column is file sizes
Writer Report
        4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384
64 336889 610350 614542 1066042 2052169
128 240124 424133 805138 1111981 1487977 3759450
256 424604 765970 1084800 1790149 2170027 2911402 4332998
512 602243 986529 1216149 1910902 1718254 5227492 4784885 5115422
1024 632467 1132697 1762539 2353657 2547723 5950309 5169641 5120336 5630486
2048 742829 1311279 1775951 2560486 3074635 5593112 5119743 5704543 5884299 5832361
4096 784977 1364044 2008682 2592481 3105653 5587302 5603704 5713661 5447345 5996870 6005255
8192 786033 1370125 2009834 2604824 3062418 6145757 6077276 6136976 5935548 6072979 6054786 5748846
16384 799251 1392949 2034757 2540197 3108380 6243929 6030242 5966368 6127020 6030242 6136321 5853544 4599757
32768 0 0 0 0 2399347 6305173 6054631 6063446 6132982 6177918 6015674 6097339 4718317
65536 0 0 0 0 2447387 6050207 6173312 6126531 6169294 6171649 6122028 6067569 4736595
131072 0 0 0 0 2428112 6348527 6187891 6162297 5912382 6102376 6179475 6079970 4795212
262144 0 0 0 0 2421742 6297144 6170555 6108302 6157079 6174610 6182491 6154357 4832682
524288 0 0 0 0 1721533 6321524 6185705 6201142 6184905 6189866 6174416 6130026 4948176
Re-writer Report
        4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384
64 842003 780776 1124074 1599680 1734015
128 876086 1346196 1504659 2035099 2511022 2558895
256 861885 1437779 1907837 3705040 3879045 3285566 3823789
512 958781 1500891 2178404 2975154 3849877 4690818 4610256 4784885
1024 972414 1662264 2681328 3483896 4356809 5219904 5120336 5472650 5417427
2048 963342 1639674 2752473 3799501 4720248 4839929 5489457 5345969 5549749 5447681
4096 993181 1706585 2773270 3821310 5069594 5711761 5664678 5634950 5535098 5519094 5506711
8192 1003414 1794447 2905979 4059129 5000831 5806161 5721087 5661696 5713476 5572627 5821902 5826839
16384 1003060 1814193 2967571 4046414 5278477 6104162 5997088 6003375 5771445 5923681 5981949 6054683 4720131
32768 0 0 0 0 5153933 6372707 6076044 6135173 6136542 6147796 6119057 6115517 4718803
65536 0 0 0 0 5566718 6409979 6223772 6161688 6139668 6233934 6271912 6055805 4738391
131072 0 0 0 0 5462445 6428929 6238873 6230247 6183228 6245393 6159397 6059731 4745336
262144 0 0 0 0 5434496 6345295 6272285 6096651 6210638 6151155 6128287 6092968 4824751
524288 0 0 0 0 5471080 6342089 6197123 6241749 6204519 6182783 6074904 6071935 4936203
Reader Report
        4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384
64 2067979 4274062 4274062 5860307 4564786
128 2511022 3124872 6406138 4012317 10779307 12842051
256 2533571 3236056 3770085 5117791 5320671 10245071 4819184
512 2665014 4237291 5509113 8140399 10044089 6999490 5439343 5398323
1024 2468647 4493556 4898425 8914314 6479979 12790037 5853003 5813392 5226256
2048 2605532 4405533 6132138 4983122 11305435 13058467 6243566 6321679 6037320 5492967
4096 2584291 4571782 6461498 9019223 10534589 11439475 6398924 6480999 6370451 6041154 5171846
8192 2430860 4149824 5498608 7515572 9942612 10463389 5932474 6140266 6098850 5684175 5411147 4870401
16384 2405149 3819062 5055205 6640970 7414059 7138346 4823162 5118462 4978299 5116937 5022690 4945339 5077241
32768 0 0 0 0 7400408 7187550 4918052 5041262 5021920 5051453 4995090 4921575 5011117
65536 0 0 0 0 7295679 7188266 4871147 4995073 5034688 4994710 5054035 5009638 5032660
131072 0 0 0 0 7383851 7454032 4857023 4992660 5054863 5030763 5042206 5055234 5105610
262144 0 0 0 0 7401835 7582326 4910445 5025768 5079612 5063704 5084333 5093236 5098006
524288 0 0 0 0 7522611 7506971 5073516 5237430 5288302 5281482 5286281 5265623 5300820
Re-reader Report
        4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384
64 2772930 5389653 7940539 12902017 6421025
128 2608629 4267461 6114306 10779307 14200794 14200794
256 2775920 4496299 7314033 10651598 13454450 13454450 5347168
512 2815243 4871723 6931711 10235583 11683444 13783088 5684095 5439343
1024 2791104 4898425 7113161 10134284 12790037 13818817 6244448 6059442 5536137
2048 2809182 4853603 7159438 9990553 12805399 13926483 6483920 6397004 6110328 5521212
4096 2684016 4767146 7149920 10083232 12756011 13879294 6542703 6565206 6471234 6112079 5497899
8192 2758310 4824582 6742748 9809204 12189466 12879400 6486879 6558696 6072979 6292063 5765244 5022761
16384 2476751 4018493 5355819 7242926 8167466 8172323 5236246 5186451 5361251 5312346 5263115 5021222 5161907
32768 0 0 0 0 7459047 7809561 4964956 5125678 5194646 5150457 5142556 5075704 5056098
65536 0 0 0 0 7679482 7623256 4979960 5090161 5138884 5079156 5147352 5116024 5152948
131072 0 0 0 0 7531643 7501429 4951559 5016303 5052308 5066742 5042437 5061891 5098886
262144 0 0 0 0 7654697 7549993 4932053 5058346 5113393 5069424 5011360 5083558 5114702
524288 0 0 0 0 7464670 7435970 5077604 5243187 5310960 5302367 5261931 5308267 5299645
Random Read Report
        4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384
64 666414 789967 2467108 7100397 3738358
128 1487977 1802755 1637771 2660335 4267461 3053774
256 1619994 2413957 3421677 4117018 5117791 6107548 4652146
512 1754758 2768068 4163357 2753870 7871843 8140399 5067142 5278892
1024 1822368 3232201 4570058 6393168 8262639 9765601 5751117 5690162 5303701
2048 1887563 3334853 5345969 7670915 9841749 10945301 6114678 6284678 5489457 5492967
4096 1885037 3316061 4911613 7742845 10665388 11907264 6330545 6439700 6401308 6094733 4917236
8192 1902447 3413510 5231540 7315554 10795424 12298542 6095604 6538726 6491781 6210183 5802240 5204597
16384 1735042 3030118 4543494 6646751 8015984 8613831 5450550 5520166 5548244 5466592 5393229 5070872 5126480
32768 0 0 0 0 6995842 7323903 4941748 5179963 5136789 5131994 5136981 5093009 5104926
65536 0 0 0 0 6844602 7164658 4904697 5029161 5121171 5101687 5066518 5074374 5130826
131072 0 0 0 0 6801483 7052237 4901933 4981440 5054073 5061844 4914949 5065995 5116968
262144 0 0 0 0 6425090 6980458 4854681 4985434 5015589 5000648 5046853 5060395 5074806
524288 0 0 0 0 6525140 6981473 4981829 5087660 5217572 5229285 5228240 5234089 5206639
Random Write Report
        4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384
64 743988 1232453 1879725 2923952 3406295
128 809997 1424795 2175277 2905056 3468030 4267461
256 814795 1300235 2397785 3326279 4197489 4734192 4332998
512 835010 1323315 2347475 3481620 4262523 4827914 4927617 4871723
1024 810095 1518833 2039583 3544270 3808251 5251818 4392454 5042191 4920874
2048 832212 1513696 2308622 3441748 4581773 5187767 5251194 5156624 4162181 4807425
4096 821499 1520368 2496056 3583764 4505833 5389246 5284803 5230102 5164073 5120972 5001700
8192 810202 1498736 2336633 3515851 4486305 5343822 5247519 5204597 5007390 5050818 5136133 5218033
16384 815566 1477082 2397430 3601686 4497405 5188409 5340419 5227880 5383933 5423021 5416182 5327997 4564923
32768 0 0 0 0 4812489 5242998 5662260 5642964 5676057 5677933 5808963 5875517 4652669
65536 0 0 0 0 4910567 5849361 5801216 5827535 5800604 5903632 5968106 5991522 4706345
131072 0 0 0 0 5052308 6025460 5989421 5973606 6045470 6023017 6091017 6023215 4756215
262144 0 0 0 0 5079330 6121565 6089156 6057754 6071804 6144795 6137215 6049655 4805582
524288 0 0 0 0 5078484 6105874 6098136 6116709 6166486 6185635 6150738 6100132 4899884
Backward Read Report
        4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384
64 913649 620221 3588436 4274062 2278628
128 1000121 1102844 2166499 2558895 1424795 1684006
256 1243036 1673001 2533571 4496299 3605511 3207059 2783115
512 1718254 2150051 3182373 3815675 3459188 5331314 5019764 5019764
1024 1724328 2822283 3680961 5390231 7941793 9569770 4995276 5417427 5120336
2048 1854954 3452815 4807425 7470770 8987113 8830061 6075753 6225466 5916724 5416763
4096 1848528 3314142 5178081 7834651 8256354 11128258 6049663 6391782 6342230 6049663 5438722
8192 1779669 3275536 4705649 6820377 9360271 11113162 6244039 6384425 6326821 6095604 5498608 4832725
16384 1781460 2999042 4403173 5999706 7768594 7927213 5247842 5461379 5359578 5204520 5254664 4899502 5123422
32768 0 0 0 0 7184545 7342292 4915590 5021003 5143325 5061498 5099244 5035720 5044963
65536 0 0 0 0 6887650 7190710 4824890 4999706 4829468 5071659 5044297 5051342 5091764
131072 0 0 0 0 6982373 7158949 4841965 5000834 5037955 5071463 5079523 5118206 5131008
262144 0 0 0 0 6935940 7069913 4847340 5018153 5055416 5063424 5084239 5084545 5127606
524288 0 0 0 0 6895915 7139110 4978614 5168459 5240363 5265635 5221834 5322722 5289154
Record Rewrite Report
        4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384
64 347801 901377 598110 1363961 3363612
128 670413 1266785 1543594 2905056 2464907 1642783
256 748353 1306564 1190657 2588541 2842047 4332998 4332998
512 798675 1165966 2314583 3550700 2597325 5067142 5019764 4973263
1024 742071 1340164 2398343 3567824 4304412 5564829 5660167 5356618 4972145
2048 804089 1522820 2540795 3772800 4623699 5953632 6041567 6114678 5640860 5144271
4096 833173 1493277 2595614 3740604 5192166 6391782 6410863 6216019 6112079 5777065 5139356
8192 834971 1511726 2528346 3789200 5340499 6511465 6591409 6435847 6365501 6104267 5724900 5291970
16384 824599 1510457 2506381 3796067 5408935 6600783 6534875 6466008 6395004 6298872 6065906 5951384 4687611
32768 0 0 0 0 5418917 6703748 6552260 6502967 6469601 6403885 6287003 6241322 4830248
65536 0 0 0 0 5299688 6565376 6525476 6382593 6436998 6485446 6430072 6264194 4888908
131072 0 0 0 0 5404821 6490331 6608133 6479087 6467578 6529491 6481302 6385915 4955665
262144 0 0 0 0 5360939 6608086 6602293 6591013 6486151 6551661 6518567 6461375 4952826
524288 0 0 0 0 5433325 6604788 6589923 6571922 6559024 6588265 6525547 6457064 5015862
Stride Read Report
        4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384
64 1526887 2222043 955947 743988 998622
128 852438 1755594 1359835 1802755 8036304 1436229
256 1208072 1790149 2441400 3009318 2261434 5971678 3326279
512 1531941 2189509 2782414 4099771 10235583 3815675 3710197 5227492
1024 1659694 2552265 3668386 4720752 7160597 10769573 4741598 5500686 5277632
2048 1814210 2929912 5172149 7670915 6543188 9898453 5644567 5884299 5953632 5420181
4096 1789419 3105653 4796426 6761583 11035332 9267351 6094733 6439700 6389405 5988509 5482110
8192 1714146 2818958 4313945 6050521 9692982 10981742 6127127 6601541 6601541 6460047 6028229 4421075
16384 1657456 2756408 4037618 5584313 7557565 8102942 5466592 5616719 6701197 6654475 6460536 5561265 5141054
32768 0 0 0 0 6966057 7406789 4980609 5221883 5293686 6680288 6540412 6010413 5273982
65536 0 0 0 0 6918159 7321524 4950185 5081410 5154688 5195511 6725038 6314270 5281765
131072 0 0 0 0 6499386 6885822 4866956 5060539 5093547 5134075 5141710 6485125 5343982
262144 0 0 0 0 6396272 6524408 4811134 5018543 5102975 5111705 5127319 5099378 5408831
524288 0 0 0 0 6461276 6738487 4973648 5160514 5263467 5222988 5282065 5321267 5342131
Fwrite Report
        4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384
64 592827 659861 695778 725882 763021
128 590094 1007629 1048974 1093856 1196221 1111981
256 778183 1254656 1497953 1642294 2486631 1632308 1340826
512 833713 1240025 1803387 2141475 2381315 1848401 2081286 1417662
1024 851195 1351126 2003431 2553783 2892612 1848247 2183727 2448941 1486247
2048 875647 1444461 1988040 2800938 2916978 1862193 2176427 2395538 2562778 1515833
4096 857800 1450903 2055301 2640698 2921843 1824383 2202319 2335234 2502236 2668590 1509813
8192 875768 1421950 2105401 2686914 2883543 1908258 2168928 2325877 2444696 2603048 2703616 1532972
16384 840638 1357856 1965671 2573203 3021724 1960232 2218560 2339242 2423642 2607672 2638307 2746712 1463648
32768 0 0 0 0 2982434 1913557 2216907 2429975 2509438 2628810 2613911 2654142 2587485
65536 0 0 0 0 2900204 1936580 2192344 2379672 2534749 2606643 2625741 2564810 2544604
131072 0 0 0 0 2898595 1942464 2229760 2390556 2494142 2552068 2622645 2589794 2548897
262144 0 0 0 0 2940021 1939349 2201317 2388841 2533572 2585754 2635379 2614878 2551504
524288 0 0 0 0 2848756 2001397 2238472 2415561 2556656 2626192 2657180 2655306 2594458
Re-fwrite Report
        4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384
64 592827 863676 1690338 2203800 1124074
128 731625 1142750 1346196 1040839 2098744 1858934
256 838988 1552085 1956506 1985448 2911402 1814348 2588541
512 890404 1610042 2198475 2926501 4228947 2327124 2317080 2655129
1024 926676 1635675 2541692 3594699 3880507 2419964 2559871 2534194 2672984
2048 978485 1728424 2680329 3341339 4374126 2467091 2534797 2528082 2625441 2691246
4096 952120 1732748 2639075 3768502 4510565 2502236 2433820 2522443 2635836 2714122 2901120
8192 938693 1690781 2571104 3613465 4297757 2437413 2554284 2570334 2604824 2620719 2818033 2964907
16384 927015 1585268 2401283 3422488 4244614 2484272 2549622 2591251 2578901 2698817 2713417 2746712 2590762
32768 0 0 0 0 4081237 2467095 2408344 2612470 2648108 2511318 2646680 2662575 2587485
65536 0 0 0 0 3956739 2417767 2515865 2577943 2609118 2646318 2637052 2607657 2464216
131072 0 0 0 0 3886139 2410957 2499710 2568678 2592970 2625802 2633437 2614016 2542519
262144 0 0 0 0 3917400 2447679 2511247 2537062 2605207 2624378 2648290 2604972 2551729
524288 0 0 0 0 3915487 2557167 2548898 2598922 2647706 2666679 2676344 2132266 2589984
Fread Report
        4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384
64 1143223 1255511 735831 754443 1210227
128 901083 1391557 1732927 1878447 2166499 2409592
256 2015259 3326279 2911402 3705040 4422226 1967260 2699161
512 2007358 2736325 3604335 4091959 4522868 2796910 2449212 2708713
1024 1977602 2852271 4095102 5789881 4949226 3579719 2813041 2485792 2653170
2048 2197023 3319389 4820915 5800851 4656281 3779440 2852087 2824887 2734075 2832339
4096 2281885 3650006 4929936 5611025 4613524 4409837 2771480 2894765 2832715 2738348 2801763
8192 2126773 3408769 4423351 5237920 5244315 4387765 2905979 2834539 2744430 2717085 2555234 2747283
16384 1963312 3129614 4083686 5100606 5283347 3896367 2741125 2712132 2629826 2637092 2616907 2620999 2757292
32768 0 0 0 0 5265697 4014714 2706993 2690302 2639817 2629212 2600803 2619341 2732503
65536 0 0 0 0 5184340 4012476 2745297 2668385 2637153 2618712 2597137 2616618 2736361
131072 0 0 0 0 5177007 3999044 2728224 2667697 2632541 2613084 2617613 2616367 2729917
262144 0 0 0 0 5224380 4052247 2752282 2672643 2658420 2629273 2593072 2619033 2729360
524288 0 0 0 0 4909434 3749305 2707693 2652394 2619029 2605919 2603892 2448913 2735539
Re-fread Report
        4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384
64 2133730 1879725 4564786 5860307 6421025
128 2058509 3359523 3036502 5325799 6727225 3536566
256 1384034 3770085 4734192 6398720 7120034 3950402 3009318
512 2317080 3822466 5177083 6571132 7410080 4650188 2860238 2860238
1024 2353657 3712781 5175871 6519323 7472033 4926518 3029305 2813041 2774874
2048 2376319 3848872 5006356 6629029 7609754 5029807 3083465 2748949 2467800 2745435
4096 2396810 3806915 5075585 6024207 7351860 5089116 3098371 2955520 2846325 2756362 2678994
8192 2347328 3813593 4779617 6127127 6501608 5000831 3080815 2905979 2800805 2731558 2532259 2766750
16384 1987616 3170916 4228160 5331717 5481418 4153286 2817549 2740687 2634867 2622700 2591153 2681023 2742985
32768 0 0 0 0 5388747 4088278 2760106 2709662 2646221 2637082 2594665 2623541 2724271
65536 0 0 0 0 5185220 4050434 2754900 2683259 2647185 2629761 2607558 2630491 2736933
131072 0 0 0 0 5269857 4085404 2754662 2694514 2654250 2621482 2613183 2627848 2733746
262144 0 0 0 0 5225547 4107562 2773331 2690945 2657309 2639625 2614381 2620106 2739971
524288 0 0 0 0 4937267 3980386 2758465 2668306 2634691 2613691 2611698 2532938 2755292