Re: [OpenIndiana-discuss] sas multipath
Randy, We tested it on Nexenta and Solaris in the past. We have not tried it on OIa7 We tried a combination of cables and SAS IO modules. Rocky -Original Message- From: Randy S [mailto:sim@live.nl] Sent: Wednesday, February 06, 2013 4:16 PM To: openindiana-discuss@openindiana.org Subject: Re: [OpenIndiana-discuss] sas multipath Hi Rocky, Thanks for your answer. Yes, the Jbod is including dual expander, and yes mpathadm list lu confirms two paths. All goes well using the two paths. The only thing is that when you pull one cable , it grinds to a halt while it notices that one path is gone. Do you mean that you have not tested it on oi7 or that you know for sure that it doesn't work on oi7. Did you also pull cables when you tested your system and what os did you use? Thank you again, Regards R > From: roc...@dataonstorage.com > To: openindiana-discuss@openindiana.org > Date: Wed, 6 Feb 2013 20:20:15 + > Subject: Re: [OpenIndiana-discuss] sas multipath > > Randy, > > 1) By default, 6G HBA(mpt_sas) is already MPxIO enabled. You no > longer need to use stmsboot to set it like with 3G HBA > 2) yes, logicblock will be faster > 3) please make sure your JBOD have dual expander > 4) FYI, we normally use 9205-8e or 9207-8E > 5) the following link is what we do the cable > http://dataonstorage.com/images/PDF/Solutions/NX2260-S2%20Unifiled%20S > torage%20System.pdf > 6) you may use "mpathadm list lu" to confirm you have dual path. > > I tested it in the past and working but not on OIa7 > > Rocky > -Original Message- > From: Randy S [mailto:sim@live.nl] > Sent: Wednesday, February 06, 2013 4:03 AM > To: openindiana-discuss@openindiana.org > Subject: [OpenIndiana-discuss] sas multipath > > > Hi all, > > I have a test system running with OIa7, very much ram, 2 LSI SAS 9207-4i4e > hba's, 1 sm jbod containing seagate 3Tb sas drives. > > I have enabled the multipathing with stmsboot and set it to use > logical-blocksize, since round-robin symmetric-option isn't functioning. > > During tests I can see that the system sees the two path's with mpathadm and > simple dd tests show that all disks are all accessed at almost maximum speed > with minimum latency according to iostat. > We started to test with 4 sas disks in 2 striped mirrors. > > All good, but shouldn't it be possible to pull one of the sas cables without > any disruption to the storage, forcing it to use only one path? (this way > simulating a broken hba). > When we do this, the whole system grinds to a screeching halt, being almost > unresponsive. > > What am I doing wrong. Maybe somebody can point in in the right direction to > troubleshoot. > > Rgrds, > > Randy > > > > > > > ___ > OpenIndiana-discuss mailing list > OpenIndiana-discuss@openindiana.org > http://openindiana.org/mailman/listinfo/openindiana-discuss > > ___ > OpenIndiana-discuss mailing list > OpenIndiana-discuss@openindiana.org > http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] sas multipath
Randy, 1) By default, 6G HBA(mpt_sas) is already MPxIO enabled. You no longer need to use stmsboot to set it like with 3G HBA 2) yes, logicblock will be faster 3) please make sure your JBOD have dual expander 4) FYI, we normally use 9205-8e or 9207-8E 5) the following link is what we do the cable http://dataonstorage.com/images/PDF/Solutions/NX2260-S2%20Unifiled%20Storage%20System.pdf 6) you may use "mpathadm list lu" to confirm you have dual path. I tested it in the past and working but not on OIa7 Rocky -Original Message- From: Randy S [mailto:sim@live.nl] Sent: Wednesday, February 06, 2013 4:03 AM To: openindiana-discuss@openindiana.org Subject: [OpenIndiana-discuss] sas multipath Hi all, I have a test system running with OIa7, very much ram, 2 LSI SAS 9207-4i4e hba's, 1 sm jbod containing seagate 3Tb sas drives. I have enabled the multipathing with stmsboot and set it to use logical-blocksize, since round-robin symmetric-option isn't functioning. During tests I can see that the system sees the two path's with mpathadm and simple dd tests show that all disks are all accessed at almost maximum speed with minimum latency according to iostat. We started to test with 4 sas disks in 2 striped mirrors. All good, but shouldn't it be possible to pull one of the sas cables without any disruption to the storage, forcing it to use only one path? (this way simulating a broken hba). When we do this, the whole system grinds to a screeching halt, being almost unresponsive. What am I doing wrong. Maybe somebody can point in in the right direction to troubleshoot. Rgrds, Randy ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] 200TB managed by OpenIndiana + ZFS
Fabio, Our customers also use Solaris, OpenSolaris and OpenIndiana with our JBOD. Since OpenIndiana is using Illumos kernel now which is the fork of Open Solaris Kernel, the MPxIO feature is from the same place as Solaris. Therefore, DNS-1660 configuration also work on the above Rocky from DataON -Original Message- From: Fabio Martinelli [mailto:fabio.martine...@psi.ch] Sent: Monday, September 12, 2011 6:10 AM To: openindiana-discuss@openindiana.org Subject: [OpenIndiana-discuss] 200TB managed by OpenIndiana + ZFS Hello I need to buy a new 200TB raw storage system with 3TB disks and my usual Supermicro salesman told me that many customers are using OpenIndiana with ZFS; this was a good new for me because I didn't know OpenIndiana but we're use to use Solaris and ZFS. I'd like to know if someone has experiences to report about an active/active SAS controller solution managed by OpenIndiana; basically I'd like to replicate an architecture like this http://www.dataonstorage.com/images/PDF/Solutions/NX2K/NexentaStor%20Storage %20Solutions_6G%20Unified%20Storage%20NX%202280-S2.pdf but without buying the NexentaStor license. many thanks for your remarks, kind regards Fabio Martinelli ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] nexenta dsm
Gary, The package you download is only for Nexenta platform. We do have other package for openindiana/solaris 10 users. It help users to identify fail disk and monitor FRU of the JBOD Rocky -Original Message- From: Gary [mailto:gdri...@gmail.com] Sent: Monday, July 25, 2011 5:33 PM To: openindiana-discuss@openindiana.org Subject: Re: [OpenIndiana-discuss] nexenta dsm On Mon, Jul 25, 2011, jason matthews wrote: > > Does anyone have an experience with it, either good or bad? > Curious -- I only see the debian package for Nexentastor or NCP; http://apt.dataonstorage.com/dists/hardy-stable/main/binary-solaris-i386/bas e I've extracted the binaries but it's unclear whether this will work outside of Nexentastor's plug-in architecture. Also, the documentation and web site suggests that it's only for their hardware. That's not surprising but if they're also letting others use the binaries on mainstream (or forked) Solaris distributions I don't see how they've provided it in a way that makes that possible -- or at the very least uncomplicated. -Gary ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] ZFS with 5 SAS best config
Gabriele, I will recommend RAID Z2. It allow you have two Hard drive fail in the same time while you data still save. After several years usage, it can likely to see second HD fail when the system still busy to resilver the first fail HD. Rocky -Original Message- From: Gabriele Bulfon [mailto:gbul...@sonicle.com] Sent: Thursday, July 21, 2011 1:35 AM To: Discussion list for OpenIndiana Subject: [OpenIndiana-discuss] ZFS with 5 SAS best config Hi, I'm configuring a machine with 5 SAS disks dedicated to data. I was thinking to make a raidz2 pool on these 5 disks. What is the best option? What if I want to do it 4 disks + 1 for spare? Thanx, Gabriele. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] SAS controller LSI 3442-E-R
Tim, I recommend you to consider LSI 6Gb/s HBA. It work better than LSI 3Gb/s. 3Gb/s(mpt) driver is closed source while (mpt_sas) driver is open source Check this link for product detail http://lsi.com/products/storagecomponents/Pages/LSISAS9212-4i4e.aspx Rocky -Original Message- From: Tim Shaw [mailto:tim.s...@imsu.ox.ac.uk] Sent: Wednesday, July 06, 2011 9:29 AM To: openindiana-discuss@openindiana.org Subject: [OpenIndiana-discuss] SAS controller LSI 3442-E-R Can anyone who has used SAS controller LSI 3442-E-R please let me know if it is suitable for use with OI The HCL for OI is quite limited as yet so I'm hoping someone on the list will be able to confirm it works before I purchase many thanks T ___ TIM SHAW - Deputy Director - Network Services Medical Sciences Division - University of Oxford email: tim.s...@imsu.ox.ac.uk tel: +44 (0)1865 221323 fax : +44 (0)1865 221322 mobile : 07092 145978 ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] OI/Illumos HCL
Matt, We have done lot of test on Intel Server & various JBOD storage in our lab. We can also contribute to this list Rocky -Original Message- From: Matthew Wilby [mailto:matthewwi...@btinternet.com] Sent: Friday, January 21, 2011 4:18 AM To: Discussion list for OpenIndiana Subject: Re: [OpenIndiana-discuss] OI/Illumos HCL If there is interest in creating an HCL, I will get something setup on the wiki and maintain it. It will however rely on community contribution. As a project we don't have the resources yet to test every possible bit of kit out there. For the time being please feel free to email me and I'll add it to the list. Something along the lines of. Vendor Model Works? Notes/special instructions etc Thanks, Matt On 21 Jan 2011, at 11:53, Dave Koelmeyer wrote: > >>> I know it's early days, but what's the possibility of getting an HCL (Hardware >>> Compatibility List) page setup on the OI website? This would give community >>> members a chance to provide information on what works and what does not, and >>> perhaps share experiences on how to fix/tune certain components specific to that >>> hardware. >>> >>> With Openindianna moving away from the original Opensolaris code base sooner or >>> later the original HCL will start to become out of date. While I don't expect OI >>> to maintain a list of 'certified hardware' (yet) if the distribution is going to >>> penetrate production environments such a site would prove useful, rather than >>> the suck it and see approach at the moment. Might also take some of the load off >>> the bug submission etc. >>> >>> For information, Opensolaris has been removed from the main Sun/Oracle HCLpage >>> (http://www.sun.com/bigadmin/hcl/) but is still accessiblehere >>> (http://www.sun.com/bigadmin/hcl/data/os/). > > Anybody wanting to take Matthew's suggestion and run with it? I don't know how to make this happen, perhaps a section on the Wiki or something, but given recent discussion over storage adaptors etc this would be a very useful resource. > > -- > Dave Koelmeyer > http://davekoelmeyer.wordpress.com/ > > > ___ > OpenIndiana-discuss mailing list > OpenIndiana-discuss@openindiana.org > http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] Weird device naming with new HBA
Gertjan, Under LSI 9200-8E, by default, it enable MPxIO. With MPxIO enabled , the device will be like that based on WWN of the disk Rocky -Original Message- From: Gertjan Oude Lohuis [mailto:gert...@oudelohuis.nl] Sent: Wednesday, January 19, 2011 12:44 PM To: openindiana-discuss@openindiana.org Subject: [OpenIndiana-discuss] Weird device naming with new HBA Hi, I just installed a new LSI 9200-8E SAS HBA which controls an IBM EXP2524 enclosure. Formerly an IBM M5025 RAID-controller did this. With the M5025 controller (also LSI) I got the normal device names in Solaris, like c2t0d0 up to c2t23d0. With the new controller, device names are ridiculous: c5t5000C5002C21BAF9d0 c5t5000C5002C21C3C9d0 c5t5000C5002C21D0DDd0 c5t5000C5002C21D98Dd0 and so forth, all 24 disks. Does anyone know what causes this? I haven't looked into it too much yet, will do tomorrow. Regards, Gertjan Oude Lohuis ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] USB ports issue
I also have seen the same USB KB/mouse issue on b134+ based Nexenta with Intel SR2625. After applying the workaround(disable autopm in /etc/pwer.conf), the problem solved. Rocky -Original Message- From: Oscar del Rio [mailto:del...@mie.utoronto.ca] Sent: Tuesday, October 12, 2010 10:43 AM To: openindiana-discuss@openindiana.org Subject: Re: [OpenIndiana-discuss] USB ports issue On 10/12/10 01:02 PM, Carlos Almeida wrote: > On 10/12/10 05:29 PM, Oscar del Rio wrote: >> >> On 10/12/10 11:20 AM, Carlos Almeida wrote: >>> On 10/12/10 04:01 PM, Albert Lee wrote: I would be very interested in helping you work on a fix, although I haven't reproduced the problem locally. The time frame of the bug suggests that this changeset introduced it: http://hg.openindiana.org/onnv-gate/rev/b9f8177eb4e2 If you have ideas, let me know; I've filed http://www.illumos.org/issues/336 to track this in Illumos. >>> ok, I will look into it, and on my Dell M4300 is a 100% situation, >>> so if you want I can test anything you need without a problem. >>> >> >> I had the same problem on my Sun Ultra 24 after upgrading from 134 to >> 147. No kbd/mouse after leaving the system idle for a while (had to >> reboot every morning). I thought it would be a screensaver problem >> but it continued after disabling it. Resetting power management to >> defaults (pmconfig -r) did not help. The problem went away after >> disabling power management. I have not tried the workaround given in >> the bug report yet. >> > I think the workaround on bug report *is* disable automatic power > management. I disabled the service altogether: svcadm disable svc:/system/power:default and removed gnome-powermanager from the desktop startup applications. I will try to disable just the autopm option. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
