Hi Mi - I took another look at the code here, I may have to rewrite the entire connection initialization routine for openib to be able to support this. Since it isnt trivial it may take me a while to pull things together.
Also, there doesn't appear to be any workarounds to using the 2nd device other than for me to suggest plugging in the first device, until this gets rewritten :-( Unfortunately I do not have the hardware to test any of the changes I'll make, so if you're willing once I get rewritten you can be the guinea pig for testing. More info to come. Kyle Schochenmaier On Tue, Mar 13, 2012 at 4:01 PM, Mi Zhou <mi.z...@stjude.org> wrote: > That will work! > > Thanks, > > Mi > On Tue, 2012-03-13 at 15:55 -0500, Kyle Schochenmaier wrote: >> Hi mi, it was hard coded to pick the first card if more than one was >> available, this was done to keep things simple, I can add the logic to >> poll all active cards and send you a patch, but this won't be >> configurable yet. We are discussing how to best handle these >> situations in a configurable manner right now >> >> On Mar 13, 2012 3:45 PM, "Mi Zhou" <mi.z...@stjude.org> wrote: >> Hi, >> >> We are setting up pvfs2 server with orangefs-2.8.5. We have 2 >> IB cards >> in the system, but one of them is not active. When I tried to >> start up >> pvfs2 server, it complains about the card that is not active, >> and the >> server won't start up. Here is the log >> >> [D 03/13/2012 15:28:41] Passing ib://pvfs03:3335 as BMI >> listen address. >> [D 03/13/2012 15:28:41] BMI_ib_initialize: init. >> [D 03/13/2012 15:28:41] openib_ib_initialize: init. >> [E 03/13/2012 15:28:41] Warning: get_nic_handle: found 2 HCAs, >> choosing >> the first. >> [E 03/13/2012 15:28:41] Error: openib_ib_initialize: port >> state is >> IBV_PORT_DOWN but should be ACTIVE; check subnet manager. >> [E 03/13/2012 15:28:41] >> [bt] /opt/orangefs/orangefs/sbin/pvfs2-server(error+0xca) >> [0x482faa] >> [E 03/13/2012 15:28:41] >> [bt] /opt/orangefs/orangefs/sbin/pvfs2-server(openib_ib_initialize >> +0x3d2) [0x4841d2] >> [E 03/13/2012 15:28:41] >> [bt] /opt/orangefs/orangefs/sbin/pvfs2-server() [0x482550] >> [E 03/13/2012 15:28:41] >> [bt] /opt/orangefs/orangefs/sbin/pvfs2-server() [0x432cfb] >> [E 03/13/2012 15:28:41] >> [bt] /opt/orangefs/orangefs/sbin/pvfs2-server(BMI_initialize >> +0x1ef) >> [0x43416f] >> [E 03/13/2012 15:28:41] >> [bt] /opt/orangefs/orangefs/sbin/pvfs2-server() [0x412e15] >> [E 03/13/2012 15:28:41] >> [bt] /opt/orangefs/orangefs/sbin/pvfs2-server() [0x414703] >> [E 03/13/2012 15:28:41] >> [bt] /opt/orangefs/orangefs/sbin/pvfs2-server(main+0xdfc) >> [0x4158cc] >> [E 03/13/2012 15:28:41] >> [bt] /lib64/libc.so.6(__libc_start_main >> +0xfd) [0x36be81ec9d] >> [E 03/13/2012 15:28:41] >> [bt] /opt/orangefs/orangefs/sbin/pvfs2-server() [0x411ac9] >> >> I wonder why it did not use the active card. Has anybody seen >> this? >> >> Thanks, >> >> Mi Zhou >> St. Jude Children's Research Hospital >> >> >> Email Disclaimer: www.stjude.org/emaildisclaimer >> >> >> _______________________________________________ >> Pvfs2-users mailing list >> pvfs2-us...@beowulf-underground.org >> http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users > -- > > Mi Zhou > System Integration Engineer > Information Sciences > St. Jude Children's Research Hospital > 262 Danny Thomas Pl. MS 312 > Memphis, TN 38105 > 901.595.5771 > > _______________________________________________ Pvfs2-developers mailing list Pvfs2-developers@beowulf-underground.org http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
