[OpenIndiana-discuss] Need a PCI e-sata card for OI151a
Here's my situation: m1015 with 6 sata drives for pool tank. 7th port has 15K 73GB SAS drive as cache device. 8th port currently connected to e-sata connector on front panel of case for monthly backups. 160GB sata drive on one of the 4 motherboard sata ports (supermicro pdsmi+). I have a 64GB crucial m4 I want to use as a log device, but plugging it into the motherboard seems to only yield sata1 speed (in addition to the fact that OI apparently refuses to even go to the grub menu and just hangs - sigh...) Even when I didn't have that issue (e.g. just switched from nexenta back to OI), I discovered the motherboard ports apparently do NOT support hot-plug, so switching the M4 and the e-sata connector is a no-go (unless I want to have to boot with the e-sata drive plugged in and turned on - LOL). My motherboard only has one pcie slot (x8) which is where the m1015 resides. So the plan is to get a pci card with e-sata connector. I've found a couple of cheap rosewill cards on newegg, that indicate the sil3512 chipset, but I'm having trouble finding out if that is supported or not. Any help appreciated! ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Need a PCI e-sata card for OI151a
Dan, I can't give you specifics, but I went through a lot of pain early on until I found cards from LSI that worked really well. At the time, the best supported chipset was from Marvell. The Silicon Image chipsets worked unreliably and needed firmware reflashing to turn off RAID support. I contributed to a few fixes in the Silicon Image drivers, but the code was not completely finished the last time I looked. I would stay away from sata multiplexers. Since then, I believe that the Intel chipset has gotten the most attention but I have never tried them. Gary On 3/27/12 9:10 AM, Dan Swartzendruber wrote: Here's my situation: m1015 with 6 sata drives for pool tank. 7th port has 15K 73GB SAS drive as cache device. 8th port currently connected to e-sata connector on front panel of case for monthly backups. 160GB sata drive on one of the 4 motherboard sata ports (supermicro pdsmi+). I have a 64GB crucial m4 I want to use as a log device, but plugging it into the motherboard seems to only yield sata1 speed (in addition to the fact that OI apparently refuses to even go to the grub menu and just hangs - sigh...) Even when I didn't have that issue (e.g. just switched from nexenta back to OI), I discovered the motherboard ports apparently do NOT support hot-plug, so switching the M4 and the e-sata connector is a no-go (unless I want to have to boot with the e-sata drive plugged in and turned on - LOL). My motherboard only has one pcie slot (x8) which is where the m1015 resides. So the plan is to get a pci card with e-sata connector. I've found a couple of cheap rosewill cards on newegg, that indicate the sil3512 chipset, but I'm having trouble finding out if that is supported or not. Any help appreciated! ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Need a PCI e-sata card for OI151a
Gary, thanks. I guess I will keep looking :( -Original Message- From: Gary Gendel [mailto:g...@genashor.com] Sent: Tuesday, March 27, 2012 9:36 AM To: Discussion list for OpenIndiana Subject: Re: [OpenIndiana-discuss] Need a PCI e-sata card for OI151a Dan, I can't give you specifics, but I went through a lot of pain early on until I found cards from LSI that worked really well. At the time, the best supported chipset was from Marvell. The Silicon Image chipsets worked unreliably and needed firmware reflashing to turn off RAID support. I contributed to a few fixes in the Silicon Image drivers, but the code was not completely finished the last time I looked. I would stay away from sata multiplexers. Since then, I believe that the Intel chipset has gotten the most attention but I have never tried them. Gary On 3/27/12 9:10 AM, Dan Swartzendruber wrote: Here's my situation: m1015 with 6 sata drives for pool tank. 7th port has 15K 73GB SAS drive as cache device. 8th port currently connected to e-sata connector on front panel of case for monthly backups. 160GB sata drive on one of the 4 motherboard sata ports (supermicro pdsmi+). I have a 64GB crucial m4 I want to use as a log device, but plugging it into the motherboard seems to only yield sata1 speed (in addition to the fact that OI apparently refuses to even go to the grub menu and just hangs - sigh...) Even when I didn't have that issue (e.g. just switched from nexenta back to OI), I discovered the motherboard ports apparently do NOT support hot-plug, so switching the M4 and the e-sata connector is a no-go (unless I want to have to boot with the e-sata drive plugged in and turned on - LOL). My motherboard only has one pcie slot (x8) which is where the m1015 resides. So the plan is to get a pci card with e-sata connector. I've found a couple of cheap rosewill cards on newegg, that indicate the sil3512 chipset, but I'm having trouble finding out if that is supported or not. Any help appreciated! ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] Openindiana on KVM problem
Hi there, i run openindiana as a test environment on an linux kvm server. My serviceprovider informed me that my cpu uses 100% all over the time. So i noticed that root@vs3:~# dmesg | grep cpu Mar 27 12:57:38 vs3 unix: [ID 223955 kern.info] x86_feature: cpuid Mar 27 12:57:43 vs3 unix: [ID 950921 kern.info] cpu0: x86 (chipid 0x0 GenuineIntel 623 family 6 model 2 step 3 clock 2500 MHz) Mar 27 12:57:43 vs3 unix: [ID 950921 kern.info] cpu0: QEMU Virtual CPU version 1.0.50 Mar 27 12:57:43 vs3 unix: [ID 608849 kern.notice] NOTICE: System detected 2 cpus, but only 1 cpu(s) were enabled during boot. Mar 27 12:57:43 vs3 unix: [ID 458440 kern.notice] NOTICE: Use boot-ncpus parameter to enable more CPU(s). See eeprom(1M). Trying to enable the second cpu via eeprom boot-ncpus=2 does not succeed. root@vs3:~# psrinfo -vp The physical processor has 1 virtual processor (0) x86 (GenuineIntel 623 family 6 model 2 step 3 clock 2500 MHz) QEMU Virtual CPU version 1.0.50 I know that is basically a problem on KVM side, but maybe some one has an idea to solve it. In addition to that there is now reason which causes the kvm to tell the machine uses 100% cpu, cause it idles 82% most of the time. Regards Jörg ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Need a PCI e-sata card for OI151a
A quick glance at the motherboard manual for what you have indicates the probability that your on-board SATA ports aren't using AHCI. Likely some compatibility mode meant for those poor souls that may have needed Win9x when that BIOS was basically coded. http://www.supermicro.com/manuals/motherboard/3000/MNL-0889.pdf Page 4-4 In the BIOS check to see if the SATA Controller Mode is set to Compatibile. You will need to change it to Enhanced. (*Note: The Enhanced mode is supported by the Windows 2000 OS or a later version. :-p ) From there the SATA RAID mode should default to Disabled. The SATA AHCI mode you will want to change to Enabled. AHCI mode should give you hot-swap capabilities as well as let you use your SSD with some sanity. I don't know if your existing intstall of OI on your boot disk connected to the motherboard SATA ports will have a problem or if it'll be able to cleanly adjust to new drivers. I know the Windows world requires a bit of fidgeting if you change the SATA mode after the initial install. Hopefully no need for spending money on a new PCI card. If that all works then I'd recommend your front-panel eSATA port be connected to your motherboard and you use your shiny Crucial M4 on your M1015. Good luck! -Russ From: Dan Swartzendruber [dswa...@druber.com] Sent: Tuesday, March 27, 2012 6:10 AM To: 'Discussion list for OpenIndiana' Subject: [OpenIndiana-discuss] Need a PCI e-sata card for OI151a Here's my situation: m1015 with 6 sata drives for pool tank. 7th port has 15K 73GB SAS drive as cache device. 8th port currently connected to e-sata connector on front panel of case for monthly backups. 160GB sata drive on one of the 4 motherboard sata ports (supermicro pdsmi+). I have a 64GB crucial m4 I want to use as a log device, but plugging it into the motherboard seems to only yield sata1 speed (in addition to the fact that OI apparently refuses to even go to the grub menu and just hangs - sigh...) Even when I didn't have that issue (e.g. just switched from nexenta back to OI), I discovered the motherboard ports apparently do NOT support hot-plug, so switching the M4 and the e-sata connector is a no-go (unless I want to have to boot with the e-sata drive plugged in and turned on - LOL). My motherboard only has one pcie slot (x8) which is where the m1015 resides. So the plan is to get a pci card with e-sata connector. I've found a couple of cheap rosewill cards on newegg, that indicate the sil3512 chipset, but I'm having trouble finding out if that is supported or not. Any help appreciated! ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Need a PCI e-sata card for OI151a
On 3/27/2012 12:51 PM, Russell Hansen wrote: A quick glance at the motherboard manual for what you have indicates the probability that your on-board SATA ports aren't using AHCI. Likely some compatibility mode meant for those poor souls that may have needed Win9x when that BIOS was basically coded. http://www.supermicro.com/manuals/motherboard/3000/MNL-0889.pdf Page 4-4 In the BIOS check to see if the SATA Controller Mode is set to Compatibile. You will need to change it to Enhanced. (*Note: The Enhanced mode is supported by the Windows 2000 OS or a later version. :-p ) From there the SATA RAID mode should default to Disabled. The SATA AHCI mode you will want to change to Enabled. AHCI mode should give you hot-swap capabilities as well as let you use your SSD with some sanity. Must be a bios bug then. I am pretty sure (will confirm tonite) that the sata controller is set to enhanced. My other mobo x9scl-f that runs esxi has TWO settings for each port: one for whether to enable AHCI and one for whether to enable hot plug. I kid you not. If I can't figure this out, I may just get the $14 rosewill sil card - it's only for occasional backup to a WD Blue consumer sata drive. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Need a PCI e-sata card for OI151a
Dan, To make things a bit more complicated (!): We've had very good luck with our BIOS settings* at AHCI and 'Native' IDE mode enabled; these settings are for the P67A Intel controller on-board; these settings get us Command Queuing and HotPlug capabilities. They also allow pass-through of HDD SMART capabilities, for compatibility with smartctl. FWIW, I am aware of no driver available for the Marvell 88SE9128 controller on this mobo; we don't use it. Lou Picciano *this is on a GigaByte GA-P67A-UD7-B3 - Original Message - From: Dan Swartzendruber dswa...@druber.com To: Discussion list for OpenIndiana openindiana-discuss@openindiana.org Sent: Tuesday, March 27, 2012 12:58:09 PM Subject: Re: [OpenIndiana-discuss] Need a PCI e-sata card for OI151a On 3/27/2012 12:51 PM, Russell Hansen wrote: A quick glance at the motherboard manual for what you have indicates the probability that your on-board SATA ports aren't using AHCI. Likely some compatibility mode meant for those poor souls that may have needed Win9x when that BIOS was basically coded. http://www.supermicro.com/manuals/motherboard/3000/MNL-0889.pdf Page 4-4 In the BIOS check to see if the SATA Controller Mode is set to Compatibile. You will need to change it to Enhanced. (*Note: The Enhanced mode is supported by the Windows 2000 OS or a later version. :-p ) From there the SATA RAID mode should default to Disabled. The SATA AHCI mode you will want to change to Enabled. AHCI mode should give you hot-swap capabilities as well as let you use your SSD with some sanity. Must be a bios bug then. I am pretty sure (will confirm tonite) that the sata controller is set to enhanced. My other mobo x9scl-f that runs esxi has TWO settings for each port: one for whether to enable AHCI and one for whether to enable hot plug. I kid you not. If I can't figure this out, I may just get the $14 rosewill sil card - it's only for occasional backup to a WD Blue consumer sata drive. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Need a PCI e-sata card for OI151a
e-SATA shares the same electrical specification as SATA. The primary difference is in the cable shielding specification. I would consider using a LSI card and an adapter to go from the non/lightly shielded internal SATA cable to the heavily shielded e-SATA cable. I am not aware of anyone who makes one with a repeater to maintain super high signal quality but it should work w/o such a device (supermicro does it all the time ;-], where as Intel doesn't). If you get an 8-port card you could dump your onboard ports altogether and get the hot-plug you deserve. For 1068e based products you'll want the SAS3801-R -- while it comes with the RAID firmware it is designed for internal ports. The plan SAS3081 has two four port external plugs which you don't want. You should be able to flash the SAS3081-R with the IT firmware or simply not configure RAID on it, in which case the drives are exposed as JBODs by default. j. PS - you'll need an 8x PCI-e slot. http://www.ebay.com/sch/?_nkw=sas3081clk_rvr_id=327631751749 if you have prime, these adapters ship for free. http://www.amazon.com/s/ref=nb_sb_noss?url=search-alias%3Delectronicsfield- keywords=sata+to+e-sata+bracket#/ref=sr_nr_p_85_0?rh=n%3A172282%2Ck%3Asata+t o+e-sata+bracket%2Cp_85%3A2470955011bbn=172282keywords=sata+to+e-sata+brac ketie=UTF8qid=1332871247rnid=2470954011 -Original Message- From: Dan Swartzendruber [mailto:dswa...@druber.com] Sent: Tuesday, March 27, 2012 6:11 AM To: 'Discussion list for OpenIndiana' Subject: [OpenIndiana-discuss] Need a PCI e-sata card for OI151a Here's my situation: m1015 with 6 sata drives for pool tank. 7th port has 15K 73GB SAS drive as cache device. 8th port currently connected to e-sata connector on front panel of case for monthly backups. 160GB sata drive on one of the 4 motherboard sata ports (supermicro pdsmi+). I have a 64GB crucial m4 I want to use as a log device, but plugging it into the motherboard seems to only yield sata1 speed (in addition to the fact that OI apparently refuses to even go to the grub menu and just hangs - sigh...) Even when I didn't have that issue (e.g. just switched from nexenta back to OI), I discovered the motherboard ports apparently do NOT support hot-plug, so switching the M4 and the e-sata connector is a no-go (unless I want to have to boot with the e-sata drive plugged in and turned on - LOL). My motherboard only has one pcie slot (x8) which is where the m1015 resides. So the plan is to get a pci card with e-sata connector. I've found a couple of cheap rosewill cards on newegg, that indicate the sil3512 chipset, but I'm having trouble finding out if that is supported or not. Any help appreciated! ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Need a PCI e-sata card for OI151a
Jason, I appreciate the input, but as I said, I'm already slot limited. My mobo only has one pci-e slot, and that is occupied by the 8-port m1015 HBA :( My apologies. I just skimmed the big block of text. So, the M1015 is a rebadged LSI 9240-8i, likely with the IR firmware. You can do what you want to do with a 16 port card. You may have to dump and restore your zpool however since you have differences in firmware, IR versus IT. The following card only offers IT firmware. http://www.provantage.com/lsi-logic-lsi00244~7LSIG0J0.htm $380 Also, I discourage you from using the crucial drives as log devices. They lack super-caps to guarantee proper write operation in the event of a power failure. I use DDRdrive X1s in production environment and Crucial 128M4s for L2ARC. If the Intel 510s were available at the time of purchase I would have used those instead. Life might be easier for you if you got a more reasonable motherboard for a server. j. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
[OpenIndiana-discuss] Sequential read/write performance on striped mirror
Hi *, I've just set up a new system that I evaluate for using in heavy I/O intensive environments. For that, I've configured the following zpool for a test: NAME STATE READ WRITE CKSUM mpool ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 c2t5000C50034C0813Fd0 ONLINE 0 0 0 c2t5000C50034C1C8AFd0 ONLINE 0 0 0 mirror-1 ONLINE 0 0 0 c2t5000C50034B581EBd0 ONLINE 0 0 0 c2t5000C50034C3A5DBd0 ONLINE 0 0 0 mirror-2 ONLINE 0 0 0 c2t5000C50034BF20D3d0 ONLINE 0 0 0 c2t5000C50034B57EA7d0 ONLINE 0 0 0 mirror-3 ONLINE 0 0 0 c2t5000C50034B59093d0 ONLINE 0 0 0 c2t5000C50034C32133d0 ONLINE 0 0 0 mirror-4 ONLINE 0 0 0 c2t5000C50034B1CB9Bd0 ONLINE 0 0 0 c2t5000C50034BB53DBd0 ONLINE 0 0 0 mirror-5 ONLINE 0 0 0 c2t5000C50034C1F61Fd0 ONLINE 0 0 0 c2t5000C50034B08517d0 ONLINE 0 0 0 mirror-6 ONLINE 0 0 0 c2t5000C50034C027EBd0 ONLINE 0 0 0 c2t5000C50034B5841Bd0 ONLINE 0 0 0 mirror-7 ONLINE 0 0 0 c2t5000C50034C06E17d0 ONLINE 0 0 0 c2t5000C50034C05C5Fd0 ONLINE 0 0 0 mirror-8 ONLINE 0 0 0 c2t5000C50034AF3D6Fd0 ONLINE 0 0 0 c2t5000C50034BAEEBFd0 ONLINE 0 0 0 mirror-9 ONLINE 0 0 0 c2t5000C50034B18117d0 ONLINE 0 0 0 c2t5000C500349D2AEFd0 ONLINE 0 0 0 mirror-10ONLINE 0 0 0 c2t5000C50034C00F8Bd0 ONLINE 0 0 0 c2t5000C50034C22E0Bd0 ONLINE 0 0 0 logs c2t5001517959585A71d0ONLINE 0 0 0 c2t5001517959585DA4d0ONLINE 0 0 0 cache c2t5001517959639231d0ONLINE 0 0 0 c2t5001517959638A66d0ONLINE 0 0 0 All disks for the striped mirrors are Seagate ST33000650SS 3TB SAS (6Gb), which should be good for ~150 MiB/s sequential read/write. The disks for the ZIL are quite cheap Intel SSD 311 20GB and the cache consists of two Intel SSD 320 40GB. All disks are attached to an LSI SAS2008 controller. In theory, the best numbers I should be able to get are: sequential read: ~3.3 GByte/s sequential write: ~1.65 GByte/s Now for the test: I start with a simple file copy test locally including a filesystem mount/unmount to really ensure sync to disk. The results (using 1, 2 and 5 threads to copy 1 GiB, 5 GiB and 10 GiB files generated by fio - throughput is determined from timestamping and other statistics from the output of zpool iostat mpool 1): 1.) 1 thread: 1 GiB test (1 threads): 344.307 MiB/s 5 GiB test (1 threads): 401.758 MiB/s 10 GiB test (1 threads): 445.129 MiB/s Peak read bandwidth: 932 MiB/s Peak write bandwidth: 1034 MiB/s Peak combined bandwidth: 1043 MiB/s Peak read IOPS: 7K/s Peak write IOPS: 9K/s Peak combined IOPS: 9K/s 2.) 2 threads: 1 GiB test (2 threads): 297.752 MiB/s 5 GiB test (2 threads): 509.532 MiB/s 10 GiB test (2 threads): 562.484 MiB/s Peak read bandwidth: 1024 MiB/s Peak write bandwidth: 1075 MiB/s Peak combined bandwidth: 1403 MiB/s Peak read IOPS: 8K/s Peak write IOPS: 9K/s Peak combined IOPS: 11K/s 3.) 5 threads: 1 GiB test (5 threads): 466.370 MiB/s 5 GiB test (5 threads): 492.627 MiB/s 10 GiB test (5 threads): 569.436 MiB/s Peak read bandwidth: 1075 MiB/s Peak write bandwidth: 1044 MiB/s Peak combined bandwidth: 1552 MiB/s Peak read IOPS: 8K/s Peak write IOPS: 9K/s Peak combined IOPS: 13K/s So this is much less of what I would have expected. I know that the ZIL SSDs are not the fastest (that's why I arranged them as stripe, not as mirror for this test) but I would have expected to at least an adequate peak here. During the initial sequential write test I observed iostat and found out, that the disks are not being saturated: ~85% busy, ~4.3 actv, barely reaching the 100 MiB/s, mostly doing around 80 MiB/s. With exact same hardware and a software RAID under Gentoo (configured exactly the same way - 11 2-mirror stripes) using ext4 I easily get more than 1 GByte/s with multiple readers/writers. So something must be wrong with my config or setup in OpenIndiana. Can someone shed some light on this? Thanx, Ancoron ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Need a PCI e-sata card for OI151a
On 3/27/2012 3:06 PM, Jason Matthews wrote: Sorry I wasn't more helpful. btw, log device implies ZIL, as in intent log. I'm aware of that :( ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
