Re: [OMPI devel] IBCM error

2008-07-17 Thread Pavel Shamis (Pasha)
Sean Hefty wrote: It is not zero, it should be: #define IB_CM_ASSIGN_SERVICE_ID __cpu_to_be64(0x0200ULL) Unfortunately the value defined in kernel level IBCM and does not exposed to user level. Can you please expose it to user level (infiniband/cm.h) Oops - good catch. I will

Re: [OMPI devel] IBCM error

2008-07-17 Thread Sean Hefty
>It is not zero, it should be: >#define IB_CM_ASSIGN_SERVICE_ID __cpu_to_be64(0x0200ULL) > >Unfortunately the value defined in kernel level IBCM and does not >exposed to user level. >Can you please expose it to user level (infiniband/cm.h) Oops - good catch. I will add the assign ID a

Re: [OMPI devel] IBCM error

2008-07-17 Thread Pavel Shamis (Pasha)
Jeff Squyres wrote: On Jul 16, 2008, at 11:07 AM, Don Kerr wrote: Pasha added configure switches for this about a week ago: --en|disable-openib-ibcm --en|disable-openib-rdmacm I like these flags but I thought there was going to be a run time check for cases where Open MPI is built on a

Re: [OMPI devel] IBCM error

2008-07-17 Thread Pavel Shamis (Pasha)
Sean Hefty wrote: If you don't care what the service ID is, you can specify 0, and the kernel will assign one. The assigned value can be retrieved by calling ib_cm_attr_id(). (I'm assuming that you communicate the IDs out of band somehow.) It is not zero, it should be: #define IB_CM_ASSIGN_S

Re: [OMPI devel] PLM consistency: priority

2008-07-17 Thread Jeff Squyres
FWIW -- we talked about this a bunch in the Louisville and have some ideas. More details coming in meeting wrapup notes... On Jul 11, 2008, at 11:14 AM, Ralph H Castain wrote: Ummm...I actually was talking about the "PLM", not the "PML". But I believe what you suggest concurs with what I s

[OMPI devel] IBCM and ordering of OpenFabrics devices

2008-07-17 Thread Jeff Squyres
I have a case where ib_cm_open_device() is failing for an odd reason: I have 12 servers that contain both HCAs and iWARP NICs. In most cases, everything is fine. But one one of these servers, IBCM refuses to work -- ib_cm_open_device() fails with the following: libibcm: unable to open /de