Hi smartos-discuss, I have a HP Microserver N36L with modified BIOS (to have 6 SATA ports enabled) with 6x 1.5T SATA HDD and 8G RAM (non-ECC) and dualcore AMD Athlon(tm) II Neo N36L. It servers as a NAS and also a small LAB.
For some reason, I can't get more than 32Mbyte/s of write performance as seen in 'rsync --progress -av HDTV 192.168.3.3::pub' (rsync to rsyncd module, no encryption, over gigabit network) I've tried current Joyent release and older EAIT with AMD KVM support - smartos-20141106-eait (http://imgapi.uqcloud.net/builds) The result is the same. With OmniOS, I'm seeing write performance up to 46M in progress. zpool iostat is consistent with this: OmniOS 5.11 omnios-170cea2 April 2015 root@hermes:/root# zpool iostat capacity operations bandwidth pool alloc free read write read write ---------- ----- ----- ----- ----- ----- ----- rpool 7.15G 12.9G 1 20 4.80K 58.4K tank 5.16T 2.90T 1 567 1.64K 44.8M The only visible difference is that with SmartOS, zones zpool is created using whole devices. With OmniOS, I have small raidz1 from 6x30G partitions (write penalty, I know, but i can boot from any device) and the rest from 1.5T is raidz1. Disks are 4xATA-SAMSUNGHD154UI, 1x ATA-ST31500341AS-CC1H and 1x ATA-ST31500541AS-CC32) - all should be 512 byte sector disk. ashift is 9 for both SmartOS and OmniOS. ### ZPOOL OMNIOS # zpool status pool: rpool state: ONLINE scan: resilvered 22.1G in 0h1m with 0 errors on Thu Jun 18 00:39:35 2015 config: NAME STATE READ WRITE CKSUM rpool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c1t1d0s0 ONLINE 0 0 0 c1t0d0s0 ONLINE 0 0 0 c1t2d0s0 ONLINE 0 0 0 c1t3d0s0 ONLINE 0 0 0 c1t4d0s0 ONLINE 0 0 0 c1t5d0s0 ONLINE 0 0 0 errors: No known data errors pool: tank state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 c1t0d0s1 ONLINE 0 0 0 c1t1d0s1 ONLINE 0 0 0 c1t2d0s1 ONLINE 0 0 0 c1t3d0s1 ONLINE 0 0 0 c1t4d0s1 ONLINE 0 0 0 c1t5d0s1 ONLINE 0 0 0 errors: No known data errors ### I'd really love to use SmartOS for various reasons, but I'm out of ideas how to debug this further and why I see such a difference. How can I debug this further? Hit with cluestick highly appreciated ... Thank you for your time, Jan P.S. Reinstalling with SmartOS is possible, It's only that I'm replicating ~5.5T from another ancient OpenIndiana box ... ------------------------------------------- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125&id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
