Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
> -Original Message- > From: Fred Liu > Sent: 星期二, 五月 06, 2014 12:22 > To: Zhiwen Zheng; Keith Wesolowski > Cc: omnios-disc...@lists.omniti.com; Discussion list for OpenIndiana; Fred > Liu; > develo...@lists.illumos.org; smartos-disc...@lists.smartos.org > Subject: RE: [developer] HBA recommended except LSI and ARECA > > > >From: Zhiwen Zheng [mailto:zhiwen...@gmail.com] > >Sent: 星期二, 五月 06, 2014 10:09 > >To: Keith Wesolowski > >Cc: omnios-disc...@lists.omniti.com; Fred Liu; Discussion list for > OpenIndiana; Fred Liu; develo...@lists.illumos.org; > smartos-disc...@lists.smartos.org > >Subject: Re: [developer] HBA recommended except LSI and ARECA > > >Hi, > >I get an Adaptec card several days ago, the pci id changed, after add the new > pci id, pmcs still can not attach. > >I checked the linux pm8001 driver, > >it seems to access some registers, pci bar 4 address need to be shifted. > >I am out of door now, I think I can try to fix this several days later. > > "prtconf -D" has no info about pm8001. "prtconf -vvv" will get only following > info: > > name='vendor-id' type=int items=1 > value=9005 > name='device-id' type=int items=1 > value=8081 > name='vendor-name' type=string items=1 > value='Adaptec' > name='device-name' type=string items=1 > value='PMC-Sierra PM8001 SAS HBA [Series 6H]' > name='subsystem-name' type=string items=1 > value='unknown subsystem' > > And yes, pmcs doen't attach. Any progress so far? Thanks. Fred ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
On Sun, May 04, 2014 at 02:42:54AM -0700, Fred Liu wrote: I haven’t got a sas drive to test. But the price delta between sas and sata drive under the same capacity is not small like USD30 at all. ☹. I'll counter nebulous griping with hard data: http://www.costcentral.com/proddetail/Hitachi_HGST_Ultrastar_7K4000_HUS724030ALA640/0F14689/11841415/ http://www.costcentral.com/proddetail/Hitachi_HGST_Ultrastar_7K4000_HUS724030ALS640/0B26886/11904874/ Same device, same vendor, same capacity, different interface. SAS premium, USD 23. Buyers in bulk or with vendor relationships will pay less. SAS would be cheap at twice the price. How much time have you wasted on SATA already, especially when I already warned you explicitly that there was a good chance SATA wouldn't work? That's not to say you can't possibly make it work, but it's going to take a significant effort to figure out what's going wrong and fix it. I can assure you that effort will cost you far more than SAS disks. ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
On Wed, Apr 30, 2014 at 10:13:49AM -0700, Fred Liu wrote: Is 6805H/6405H(http://www.adaptec.com//en-us/products/series/6h/) worthy of recommendation too? That uses the PM8001, which I believe is the same ASIC I have direct experience with. So it would be good to look at too, yes. ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
On Tue, May 06, 2014 at 12:10:24AM +0800, Fred Liu wrote: I have a 6805H in hand and illumos can not detect it. But I don't have experience porting driver in FreeBSD it has to illumos. And I do NOT want to waste my money.:-) Therefore I would like to do anything to pursue this as long as I can! There's no reason to port a driver; we already have one. The first step here is to figure out whether we're even trying to attach. Do you see the device in the output of prtconf -D? Is pmcs associated with it? If the answer to both is yes, you will need to figure out why pmcs is not attaching; check log messages and consider standard driver-attach debugging methods such as DTrace. If the answer is no, then you will need to use update_drv(1M) to add an appropriate alias; the alias should be pmcs and the identity should match the PCI vendor and device ID associated with your card. Because I do not have one in hand, I do not know what these are. If you get all the way into attach and it seems like the device is simply doing something we don't expect (i.e., that it's a qualitatively different device than the one our driver expects due to different firmware, configuration, etc.) then it will be time to start looking at other OS's drivers for this card and/or engaging with PMC Engineering to figure out what the device is doing and why. All of this is fairly standard in debugging device not seen type issues, so you should have success getting additional tips by searching the archives; of course, the details end up being device-dependent. Good luck! ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
On Mon, May 05, 2014 at 02:49:15AM -0700, Fred Liu wrote: Just like what Bob mentioned, the current pmcs(7D) in illumos cannot work with 6H/7H series of HBAs. Even replaced with SAS drives, the effort is still in vain. Are you sure the 6-series needs more than just PCI IDs? It's the same ASIC I know worked in the past, so I'd expect it wouldn't be terribly hard to get it working. Are you interested in pursuing this? I intend to engage with these guys in an effort to get documentation so it can be a first-class citizen in illumos again, but I'd be very happy to see someone else pick that up. It's likely just a matter of finding the right engineering contact inside PMC (I wouldn't bother with the Adaptec side other than to help you make the business case). ___ openindiana-discuss mailing list openindiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
-Original Message- From: Keith Wesolowski [mailto:keith.wesolow...@joyent.com] Sent: 星期一, 五月 05, 2014 10:19 To: Fred Liu Cc: Fred Liu; smartos-disc...@lists.smartos.org; develo...@lists.illumos.org; Discussion list for OpenIndiana; OmniOS- disc...@lists.omniti.com Subject: Re: [developer] HBA recommended except LSI and ARECA On Sun, May 04, 2014 at 02:42:54AM -0700, Fred Liu wrote: I haven’t got a sas drive to test. But the price delta between sas and sata drive under the same capacity is not small like USD30 at all. ☹. I'll counter nebulous griping with hard data: http://www.costcentral.com/proddetail/Hitachi_HGST_Ultrastar_7K4000_HUS 724030ALA640/0F14689/11841415/ http://www.costcentral.com/proddetail/Hitachi_HGST_Ultrastar_7K4000_HUS 724030ALS640/0B26886/11904874/ Same device, same vendor, same capacity, different interface. SAS premium, USD 23. Buyers in bulk or with vendor relationships will pay less. Yes. Like What Garrett said, this comparison is between *enterprise* SATA and SAS drives. But I mean *consumer* SATA drives. So my statement should be changed to the price delta between sas and laptop sata drive under the same capacity is not small like USD30 at all. ☹ SAS would be cheap at twice the price. How much time have you wasted on SATA already, especially when I already warned you explicitly that there was a good chance SATA wouldn't work? That's not to say you can't possibly make it work, but it's going to take a significant effort to figure out what's going wrong and fix it. I can assure you that effort will cost you far more than SAS disks. Just like what Bob mentioned, the current pmcs(7D) in illumos cannot work with 6H/7H series of HBAs. Even replaced with SAS drives, the effort is still in vain. Anyway, it looks like there is a very clear gap between commodity and enterprise market. I definitely understand it is because of different business model. LSI and ADAPTEC are enterprise-oriented. And so far I cannot find commodity-oriented(Marvell?) HBAs working in illumos. The on-board AHCI SATA interfaces are friends for individual/home users. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
Le 2014/05/05 11:54 +0200, Fred Liu a écrit: Just like what Bob mentioned, the current pmcs(7D) in illumos cannot work with 6H/7H series of HBAs. Even replaced with SAS drives, the effort is still in vain. Anyway, it looks like there is a very clear gap between commodity and enterprise market. I definitely understand it is because of different business model. LSI and ADAPTEC are enterprise-oriented. And so far I cannot find commodity-oriented(Marvell?) HBAs working in illumos. The on-board AHCI SATA interfaces are friends for individual/home users. What about the Silicon Image ones? I used to have an Si3124, once the original dirty bugs were fixed in S10, it's been working well enough for me. I've switched to using an LSI SAS card with the same consumer SATA drives, saved enough money and has been working well for me (still on S10). Laurent ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
Laurent Blume laurent...@elanor.org于2014年5月5日星期一写道： Le 2014/05/05 11:54 +0200, Fred Liu a écrit: Just like what Bob mentioned, the current pmcs(7D) in illumos cannot work with 6H/7H series of HBAs. Even replaced with SAS drives, the effort is still in vain. Anyway, it looks like there is a very clear gap between commodity and enterprise market. I definitely understand it is because of different business model. LSI and ADAPTEC are enterprise-oriented. And so far I cannot find commodity-oriented(Marvell?) HBAs working in illumos. The on-board AHCI SATA interfaces are friends for individual/home users. What about the Silicon Image ones? I used to have an Si3124, once the original dirty bugs were fixed in S10, it's been working well enough for me. [Fred]: I also heard of this HBA. It has 4 ports as max and very limited bus bandwidth from point view of current days. The dirty bugs are in my mind too. I've switched to using an LSI SAS card with the same consumer SATA drives, saved enough money and has been working well for me (still on S10). [Fred]: you have good luck! :-) ___ ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
Le 2014/05/05 17:22 +0200, Fred Liu a écrit: [Fred]: I also heard of this HBA. It has 4 ports as max and very limited bus bandwidth Well, hey, consumer! :-) [Fred]: you have good luck! :-) 哈哈，真的很好运阿! I did have issues, the usual failing disks and stuff, but there's been no datalose, and nothing unexpected, I've done firmware upgrades on cards and disks with relative ease, so I'm good. As supported in the Solaris world for a prosumer use, I'd say the LSI SAS2 devices are amongst the best ROI those days. And seriously, if you plan to connect 8 drives there, the cost of one HBA card is not much compared to the disks, the enclosure, the cables... Laurent ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
Laurent Blume laurent...@elanor.org于2014年5月5日星期一写道： Le 2014/05/05 17:22 +0200, Fred Liu a écrit: [Fred]: I also heard of this HBA. It has 4 ports as max and very limited bus bandwidth Well, hey, consumer! :-) [Fred]: hr, I agree! :-) [Fred]: you have good luck! :-) 哈哈，真的很好运阿! [Fred]: 哇，你能写中文啊！Wow， you can write in chinese！cool！ I did have issues, the usual failing disks and stuff, but there's been no datalose, and nothing unexpected, I've done firmware upgrades on cards and disks with relative ease, so I'm good. As supported in the Solaris world for a prosumer use, I'd say the LSI SAS2 devices are amongst the best ROI those days. And seriously, if you plan to connect 8 drives there, the cost of one HBA card is not much compared to the disks, the enclosure, the cables... [Fred]: That is true. One trick is possibly checking the compatibility list from LSI to see if there are *consumer* sata drives. But stability improvement from refreshing firmware is filesystem-agnostic. ZFS is still picky on them. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
Keith Wesolowski keith.wesolow...@joyent.com于2014年5月5日星期一写道： On Mon, May 05, 2014 at 02:49:15AM -0700, Fred Liu wrote: Just like what Bob mentioned, the current pmcs(7D) in illumos cannot work with 6H/7H series of HBAs. Even replaced with SAS drives, the effort is still in vain. Are you sure the 6-series needs more than just PCI IDs? It's the same ASIC I know worked in the past, so I'd expect it wouldn't be terribly hard to get it working. Are you interested in pursuing this? I intend to engage with these guys in an effort to get documentation so it can be a first-class citizen in illumos again, but I'd be very happy to see someone else pick that up. It's likely just a matter of finding the right engineering contact inside PMC (I wouldn't bother with the Adaptec side other than to help you make the business case). I have a 6805H in hand and illumos can not detect it. But I don't have experience porting driver in FreeBSD it has to illumos. And I do NOT want to waste my money.:-) Therefore I would like to do anything to pursue this as long as I can! ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
From: Zhiwen Zheng [mailto:zhiwen...@gmail.com] Sent: 星期二, 五月 06, 2014 10:09 To: Keith Wesolowski Cc: omnios-disc...@lists.omniti.com; Fred Liu; Discussion list for OpenIndiana; Fred Liu; develo...@lists.illumos.org; smartos-disc...@lists.smartos.org Subject: Re: [developer] HBA recommended except LSI and ARECA Hi, I get an Adaptec card several days ago, the pci id changed, after add the new pci id, pmcs still can not attach. I checked the linux pm8001 driver, it seems to access some registers, pci bar 4 address need to be shifted. I am out of door now, I think I can try to fix this several days later. prtconf -D has no info about pm8001. prtconf -vvv will get only following info: name='vendor-id' type=int items=1 value=9005 name='device-id' type=int items=1 value=8081 name='vendor-name' type=string items=1 value='Adaptec' name='device-name' type=string items=1 value='PMC-Sierra PM8001 SAS HBA [Series 6H]' name='subsystem-name' type=string items=1 value='unknown subsystem' And yes, pmcs doen't attach. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
[fred]：ok. Let's see how it goes after I get the hba. [fred]: I have got 6805H HBA. It can recognize the sata drives in bios but these drives cannot be detected in the latest illumos(smartos,oi) release. I haven’t got a sas drive to test. But the price delta between sas and sata drive under the same capacity is not small like USD30 at all. ☹. Thanks. Fred ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
Is 6805H/6405H(http://www.adaptec.com//en-us/products/series/6h/) worthy of recommendation too? Thanks. Fred -Original Message- From: Keith Wesolowski [mailto:keith.wesolow...@joyent.com] Sent: 星期四, 五月 01, 2014 0:29 To: Fred Liu Cc: develo...@lists.illumos.org Subject: Re: [developer] HBA recommended except LSI and ARECA On Wed, Apr 30, 2014 at 06:34:29AM -0700, Fred Liu via illumos- developer wrote: Sorry for the typo… From: Fred Liu Sent: 星期三, 四月 30, 2014 21:31 To: 'develo...@lists.illumos.org' Subject: HBA recommended except LSI and ARECO Hi, Any ideas will be highly appreciated! Well, since you've excluded two of the three HBA vendors, I'm not sure why you're asking for ideas. The remaining player is PMC-Sierra, who recently bought Adaptec and are now using that as a consumer-facing brand for cards based on the ASICs they've made for years. I have not yet evaluated them in my lab, but I suspect that e.g. the 7085H/7805H likely work with our pmcs(7D) driver. If so, I would recommend giving this a close look (if not, we need to get in touch with them and fix that); we used PMC-Sierra ASICs on a Sun-made board when I was at Fishworks and I was reasonably pleased with the product. At the time anyway, PMC was much better aligned with the ZFS-centric storage architecture than LSI: less work being done in firmware, better non-RAID options, superior error handling and telemetry, etc. I have not seen LSI change their stance on this; they clearly remain committed to selling people expensive HW RAID controllers with bloated firmware stacks. Assuming this generation of PMC products is similar to the old, you'll likely find them a better fit than the other vendors. See http://www.adaptec.com/en-us/products/series/7h/. I would not recommend any of the consumer-grade (pre-PMC) or HW RAID based stuff from Adaptec. That stuff was trash, and I'm not sure any of it works with illumos at all. ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
Keith Wesolowski via smartos-discuss smartos-disc...@lists.smartos.org 于2014年5月1日星期四写道： On Wed, Apr 30, 2014 at 10:13:49AM -0700, Fred Liu wrote: Is 6805H/6405H(http://www.adaptec.com//en-us/products/series/6h/) worthy of recommendation too? That uses the PM8001, which I believe is the same ASIC I have direct experience with. So it would be good to look at too, yes. [fred]: gotcha! I will give it a try. Does it work well with commodity sata drives? Thanks. Fred --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/22027488-c60da3c5 Modify Your Subscription: https://www.listbox.com/member/?member_id=22027488id_secret=22027488-68892e07 Powered by Listbox: http://www.listbox.com ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
Re: [OpenIndiana-discuss] [developer] HBA recommended except LSI and ARECA
Keith Wesolowski keith.wesolow...@joyent.com于2014年5月1日星期四写道： On Thu, May 01, 2014 at 02:13:38AM +0800, Fred Liu wrote: That uses the PM8001, which I believe is the same ASIC I have direct experience with. So it would be good to look at too, yes. [fred]: gotcha! I will give it a try. Does it work well with commodity sata drives? Unknown. The interface to the ASIC is basically SAS-only; the model in the 8001 was that the SATL is provided by software, not firmware or hardware. Presumably PMC/Adapted implemented a SATL in their bundled drivers for legacy OSs. This is markedly different from LSI's model (and a big advantage of PMC's). I do not know how far they got on making that work, because by the time we started using this device we had long since decided that we would never again ship a storage product with SATA devices in it. So from my perspective this HBA is completely untested with SATA end devices (commodity or otherwise). It may work, it may not. Certainly it was intended that it be usable in that configuration by the people at Sun who wrote the drivers, and it is possible to make it work if it does not. But I don't recommend using SATA, ever. SAS disks cost $30 more. Best $30 you'll ever spend. [fred]：ok. Let's see how it goes after I get the hba. Thanks. Fred ___ OpenIndiana-discuss mailing list OpenIndiana-discuss@openindiana.org http://openindiana.org/mailman/listinfo/openindiana-discuss
