On 3/25/13 10:39 AM, Franz Schober wrote: > Hi, > > our new server with 4 x E5-4620 with 256GB running OmniOS(I also tested > with Smartos and OI) is significantly > slower in filesystem and memory operations compared to our older single > socket machines. > > I know the memory architecture on this system is distributed between the > cpus (every cpu got 4 x 16 GB of ram), > but the performance on just a simple dd write to the tmpfs seems quite > low to me. > > Test: Writing a 1 GB File > time dd if=/dev/zero of=/tmp/testfile1 bs=128k count=8k > Mean value of 3 tests on every system. > (I also tried IOZone but the simple dd test seems to show the problem) > > New System: > 4x Intel(R) Xeon(R) CPU E5-4620 0 @ 2.20GHz 2,1 seconds (around 487 > MByte/s) > Mainboard Supermicro X9QR7-TF+ > 256 GByte Ram in 16 x 16 GByte Registered ECC DDR3 > > Other Systems: > Intel(R) Xeon(R) CPU E5-1650 0 @ 3.20GHz 0,79 s (1296 MByte/s) > Intel(R) Xeon(R) CPU E5606 @ 2.13GHz 0,9s (1140 MByte/s) > Intel(R) Core(TM) i5-2400S CPU @ 2.50GHz 0,69s (1485 MByte/s) > > The reason why i am asking is because: > When i export a ZVOL on a ZFS pool (2x6 Disks RAIDZ2 striped +ZIL) > which is writing with about 750MB/s native, over > FC then i only get 200 MB/s on the initator. > > I then tried to export RAM disks (they are slower then the tmpfs) and > then tmpfs files, but the > performance over FC was the same. After that, I saw that the whole > system performs much worse than > my older ones (which have no FC). > > Are there any clues what i can do about that situation ? > Is it necessary to tune the system ? > Can this be related to IRQ distribution among the 64 shown cores ?
Does the OS actually recognize the locality groups in this case? See lgrpinfo(1). Robert ------------------------------------------- illumos-discuss Archives: https://www.listbox.com/member/archive/182180/=now RSS Feed: https://www.listbox.com/member/archive/rss/182180/21175430-2e6923be Modify Your Subscription: https://www.listbox.com/member/?member_id=21175430&id_secret=21175430-6a77cda4 Powered by Listbox: http://www.listbox.com
