[smartos-discuss] RE: [developer] HBA recommended except LSI and ARECA
> -Original Message- > From: Fred Liu > Sent: 星期二, 五月 06, 2014 12:22 > To: Zhiwen Zheng; Keith Wesolowski > Cc: omnios-disc...@lists.omniti.com; Discussion list for OpenIndiana; Fred > Liu; > develo...@lists.illumos.org; smartos-discuss@lists.smartos.org > Subject: RE: [developer] HBA recommended except LSI and ARECA > > > >From: Zhiwen Zheng [mailto:zhiwen...@gmail.com] > >Sent: 星期二, 五月 06, 2014 10:09 > >To: Keith Wesolowski > >Cc: omnios-disc...@lists.omniti.com; Fred Liu; Discussion list for > OpenIndiana; Fred Liu; develo...@lists.illumos.org; > smartos-discuss@lists.smartos.org > >Subject: Re: [developer] HBA recommended except LSI and ARECA > > >Hi, > >I get an Adaptec card several days ago, the pci id changed, after add the new > pci id, pmcs still can not attach. > >I checked the linux pm8001 driver, > >it seems to access some registers, pci bar 4 address need to be shifted. > >I am out of door now, I think I can try to fix this several days later. > > "prtconf -D" has no info about pm8001. "prtconf -vvv" will get only following > info: > > name='vendor-id' type=int items=1 > value=9005 > name='device-id' type=int items=1 > value=8081 > name='vendor-name' type=string items=1 > value='Adaptec' > name='device-name' type=string items=1 > value='PMC-Sierra PM8001 SAS HBA [Series 6H]' > name='subsystem-name' type=string items=1 > value='unknown subsystem' > > And yes, pmcs doen't attach. Any progress so far? Thanks. Fred --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
Re: [smartos-discuss] Re: [developer] HBA recommended except LSI and ARECA
Sent from my iPhone On May 21, 2014, at 7:05 AM, Zhiwen Zheng via smartos-discuss smartos-discuss@lists.smartos.org wrote: 在 2014-5-21 上午12:15，Keith Wesolowski keith.wesolow...@joyent.com写道： On Tue, May 20, 2014 at 10:30:13PM +0800, Zhiwen Zheng wrote: I tried to add suport for adaptec 6805H following the linux pm8001 driver. Before I read the patch, I need to know whether you cut and pasted even a single line of code from the Linux driver. In general, you really want to do work like this from a PRM or from a BSD driver, never Linux. no cut and paste from linux. I want to ask why not linux? thanks Linux drivers are usually GPL and that license forbids mixing code with certain other licenses. The CDDL license we use for illumos. is one such. BSD license is much easier to mix and match. But you do have to give credit and ensure copyright notices are preserved. It seems to access mpi configuration table, BAR4(PMCS_REGSET_2 in pmcs terms) should be used, instead of BAR5(PMCS_REGSET_3) currently used in pmcs. So are you making this model-specific somehow? Because otherwise you'll presumably break the existing devices. smartos-discuss | Archives | Modify Your Subscription --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
[smartos-discuss] Re: [developer] HBA recommended except LSI and ARECA
On Mon, May 05, 2014 at 02:49:15AM -0700, Fred Liu wrote: Just like what Bob mentioned, the current pmcs(7D) in illumos cannot work with 6H/7H series of HBAs. Even replaced with SAS drives, the effort is still in vain. Are you sure the 6-series needs more than just PCI IDs? It's the same ASIC I know worked in the past, so I'd expect it wouldn't be terribly hard to get it working. Are you interested in pursuing this? I intend to engage with these guys in an effort to get documentation so it can be a first-class citizen in illumos again, but I'd be very happy to see someone else pick that up. It's likely just a matter of finding the right engineering contact inside PMC (I wouldn't bother with the Adaptec side other than to help you make the business case). --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
[smartos-discuss] Re: [developer] HBA recommended except LSI and ARECA
Hi, I get an Adaptec card several days ago, the pci id changed, after add the new pci id, pmcs still can not attach. I checked the linux pm8001 driver, it seems to access some registers, pci bar 4 address need to be shifted. I am out of door now, I think I can try to fix this several days later. 在 2014-5-6 上午2:50，Keith Wesolowski develo...@lists.illumos.org写道： On Tue, May 06, 2014 at 12:10:24AM +0800, Fred Liu wrote: I have a 6805H in hand and illumos can not detect it. But I don't have experience porting driver in FreeBSD it has to illumos. And I do NOT want to waste my money.:-) Therefore I would like to do anything to pursue this as long as I can! There's no reason to port a driver; we already have one. The first step here is to figure out whether we're even trying to attach. Do you see the device in the output of prtconf -D? Is pmcs associated with it? If the answer to both is yes, you will need to figure out why pmcs is not attaching; check log messages and consider standard driver-attach debugging methods such as DTrace. If the answer is no, then you will need to use update_drv(1M) to add an appropriate alias; the alias should be pmcs and the identity should match the PCI vendor and device ID associated with your card. Because I do not have one in hand, I do not know what these are. If you get all the way into attach and it seems like the device is simply doing something we don't expect (i.e., that it's a qualitatively different device than the one our driver expects due to different firmware, configuration, etc.) then it will be time to start looking at other OS's drivers for this card and/or engaging with PMC Engineering to figure out what the device is doing and why. All of this is fairly standard in debugging device not seen type issues, so you should have success getting additional tips by searching the archives; of course, the details end up being device-dependent. Good luck! --- illumos-developer Archives: https://www.listbox.com/member/archive/182179/=now RSS Feed: https://www.listbox.com/member/archive/rss/182179/21175337-120aaa74 Modify Your Subscription: https://www.listbox.com/member/?; Powered by Listbox: http://www.listbox.com 在 2014-5-6 上午2:50，Keith Wesolowski develo...@lists.illumos.org写道： On Tue, May 06, 2014 at 12:10:24AM +0800, Fred Liu wrote: I have a 6805H in hand and illumos can not detect it. But I don't have experience porting driver in FreeBSD it has to illumos. And I do NOT want to waste my money.:-) Therefore I would like to do anything to pursue this as long as I can! There's no reason to port a driver; we already have one. The first step here is to figure out whether we're even trying to attach. Do you see the device in the output of prtconf -D? Is pmcs associated with it? If the answer to both is yes, you will need to figure out why pmcs is not attaching; check log messages and consider standard driver-attach debugging methods such as DTrace. If the answer is no, then you will need to use update_drv(1M) to add an appropriate alias; the alias should be pmcs and the identity should match the PCI vendor and device ID associated with your card. Because I do not have one in hand, I do not know what these are. If you get all the way into attach and it seems like the device is simply doing something we don't expect (i.e., that it's a qualitatively different device than the one our driver expects due to different firmware, configuration, etc.) then it will be time to start looking at other OS's drivers for this card and/or engaging with PMC Engineering to figure out what the device is doing and why. All of this is fairly standard in debugging device not seen type issues, so you should have success getting additional tips by searching the archives; of course, the details end up being device-dependent. Good luck! --- illumos-developer Archives: https://www.listbox.com/member/archive/182179/=now RSS Feed: https://www.listbox.com/member/archive/rss/182179/21175337-120aaa74 Modify Your Subscription: https://www.listbox.com/member/?; Powered by Listbox: http://www.listbox.com --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
[smartos-discuss] RE: [developer] HBA recommended except LSI and ARECA
[fred]：ok. Let's see how it goes after I get the hba. [fred]: I have got 6805H HBA. It can recognize the sata drives in bios but these drives cannot be detected in the latest illumos(smartos,oi) release. I haven’t got a sas drive to test. But the price delta between sas and sata drive under the same capacity is not small like USD30 at all. ☹. Thanks. Fred --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
[smartos-discuss] Re: [developer] HBA recommended except LSI and ARECA
On Sun, May 04, 2014 at 02:42:54AM -0700, Fred Liu wrote: I haven’t got a sas drive to test. But the price delta between sas and sata drive under the same capacity is not small like USD30 at all. ☹. I'll counter nebulous griping with hard data: http://www.costcentral.com/proddetail/Hitachi_HGST_Ultrastar_7K4000_HUS724030ALA640/0F14689/11841415/ http://www.costcentral.com/proddetail/Hitachi_HGST_Ultrastar_7K4000_HUS724030ALS640/0B26886/11904874/ Same device, same vendor, same capacity, different interface. SAS premium, USD 23. Buyers in bulk or with vendor relationships will pay less. SAS would be cheap at twice the price. How much time have you wasted on SATA already, especially when I already warned you explicitly that there was a good chance SATA wouldn't work? That's not to say you can't possibly make it work, but it's going to take a significant effort to figure out what's going wrong and fix it. I can assure you that effort will cost you far more than SAS disks. --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
[smartos-discuss] RE: [developer] HBA recommended except LSI and ARECA
Is 6805H/6405H(http://www.adaptec.com//en-us/products/series/6h/) worthy of recommendation too? Thanks. Fred -Original Message- From: Keith Wesolowski [mailto:keith.wesolow...@joyent.com] Sent: 星期四, 五月 01, 2014 0:29 To: Fred Liu Cc: develo...@lists.illumos.org Subject: Re: [developer] HBA recommended except LSI and ARECA On Wed, Apr 30, 2014 at 06:34:29AM -0700, Fred Liu via illumos- developer wrote: Sorry for the typo… From: Fred Liu Sent: 星期三, 四月 30, 2014 21:31 To: 'develo...@lists.illumos.org' Subject: HBA recommended except LSI and ARECO Hi, Any ideas will be highly appreciated! Well, since you've excluded two of the three HBA vendors, I'm not sure why you're asking for ideas. The remaining player is PMC-Sierra, who recently bought Adaptec and are now using that as a consumer-facing brand for cards based on the ASICs they've made for years. I have not yet evaluated them in my lab, but I suspect that e.g. the 7085H/7805H likely work with our pmcs(7D) driver. If so, I would recommend giving this a close look (if not, we need to get in touch with them and fix that); we used PMC-Sierra ASICs on a Sun-made board when I was at Fishworks and I was reasonably pleased with the product. At the time anyway, PMC was much better aligned with the ZFS-centric storage architecture than LSI: less work being done in firmware, better non-RAID options, superior error handling and telemetry, etc. I have not seen LSI change their stance on this; they clearly remain committed to selling people expensive HW RAID controllers with bloated firmware stacks. Assuming this generation of PMC products is similar to the old, you'll likely find them a better fit than the other vendors. See http://www.adaptec.com/en-us/products/series/7h/. I would not recommend any of the consumer-grade (pre-PMC) or HW RAID based stuff from Adaptec. That stuff was trash, and I'm not sure any of it works with illumos at all. --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
[smartos-discuss] Re: [developer] HBA recommended except LSI and ARECA
On Wed, Apr 30, 2014 at 10:13:49AM -0700, Fred Liu wrote: Is 6805H/6405H(http://www.adaptec.com//en-us/products/series/6h/) worthy of recommendation too? That uses the PM8001, which I believe is the same ASIC I have direct experience with. So it would be good to look at too, yes. --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
[smartos-discuss] Re: [developer] HBA recommended except LSI and ARECA
Keith Wesolowski via smartos-discuss smartos-discuss@lists.smartos.org 于2014年5月1日星期四写道： On Wed, Apr 30, 2014 at 10:13:49AM -0700, Fred Liu wrote: Is 6805H/6405H(http://www.adaptec.com//en-us/products/series/6h/) worthy of recommendation too? That uses the PM8001, which I believe is the same ASIC I have direct experience with. So it would be good to look at too, yes. [fred]: gotcha! I will give it a try. Does it work well with commodity sata drives? Thanks. Fred --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/22027488-c60da3c5 Modify Your Subscription: https://www.listbox.com/member/?; Powered by Listbox: http://www.listbox.com --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
[smartos-discuss] Re: [developer] HBA recommended except LSI and ARECA
On Thu, May 01, 2014 at 02:13:38AM +0800, Fred Liu wrote: That uses the PM8001, which I believe is the same ASIC I have direct experience with. So it would be good to look at too, yes. [fred]: gotcha! I will give it a try. Does it work well with commodity sata drives? Unknown. The interface to the ASIC is basically SAS-only; the model in the 8001 was that the SATL is provided by software, not firmware or hardware. Presumably PMC/Adapted implemented a SATL in their bundled drivers for legacy OSs. This is markedly different from LSI's model (and a big advantage of PMC's). I do not know how far they got on making that work, because by the time we started using this device we had long since decided that we would never again ship a storage product with SATA devices in it. So from my perspective this HBA is completely untested with SATA end devices (commodity or otherwise). It may work, it may not. Certainly it was intended that it be usable in that configuration by the people at Sun who wrote the drivers, and it is possible to make it work if it does not. But I don't recommend using SATA, ever. SAS disks cost $30 more. Best $30 you'll ever spend. --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
[smartos-discuss] Re: [developer] HBA recommended except LSI and ARECA
Keith Wesolowski keith.wesolow...@joyent.com于2014年5月1日星期四写道： On Thu, May 01, 2014 at 02:13:38AM +0800, Fred Liu wrote: That uses the PM8001, which I believe is the same ASIC I have direct experience with. So it would be good to look at too, yes. [fred]: gotcha! I will give it a try. Does it work well with commodity sata drives? Unknown. The interface to the ASIC is basically SAS-only; the model in the 8001 was that the SATL is provided by software, not firmware or hardware. Presumably PMC/Adapted implemented a SATL in their bundled drivers for legacy OSs. This is markedly different from LSI's model (and a big advantage of PMC's). I do not know how far they got on making that work, because by the time we started using this device we had long since decided that we would never again ship a storage product with SATA devices in it. So from my perspective this HBA is completely untested with SATA end devices (commodity or otherwise). It may work, it may not. Certainly it was intended that it be usable in that configuration by the people at Sun who wrote the drivers, and it is possible to make it work if it does not. But I don't recommend using SATA, ever. SAS disks cost $30 more. Best $30 you'll ever spend. [fred]：ok. Let's see how it goes after I get the hba. Thanks. Fred --- smartos-discuss Archives: https://www.listbox.com/member/archive/184463/=now RSS Feed: https://www.listbox.com/member/archive/rss/184463/25769125-55cfbc00 Modify Your Subscription: https://www.listbox.com/member/?member_id=25769125id_secret=25769125-7688e9fb Powered by Listbox: http://www.listbox.com
