[openib-general] How to get NFS with RDMA on OFED-1.1?

I know this might end up as an RTFM but before reading the wrong manual I'd rather ask We are currently using OFED-1.1 on SLES-10 doing RDMA via libibverbs and lnow ike to utilize NFS with RDMA over IB for another project. Any help, RTFM etc. welcome Thanks Thoma

Re: [openib-general] How to increase the waiting period/timeout for the completion of an RDMA operation?

; From: Bub Thomas > Sent: Saturday, November 18, 2006 12:41 PM > To: '[EMAIL PROTECTED]'; Roland Dreier > Cc: Thomas Bub; 'Erez Cohen'; openib-general@openib.org > Subject: RE: [openib-general] How to increase the waiting period/timeout > for the completion of a

Re: [openib-general] How to increase the waiting period/timeout for the completion of an RDMA operation?

Thanks that helped. Thomas > -Original Message- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] > Sent: Saturday, November 18, 2006 6:55 AM > To: Roland Dreier > Cc: Thomas Bub; 'Erez Cohen'; Bub Thomas; openib-general@openib.org > Subject: Re: [openib-

Re: [openib-general] What could prevent a gen2 x86 client qp from doing RDMA_READ on a gen1 PowerPC client?

Dotan and all others. I could isolate the problem with hardware measurement a little more today I just opened a new thread on the problem naming: "How to increase the waiting period/timeout for the completion of an RDMA operation?" Thanks for the support so far. Thomas _

[openib-general] How to increase the waiting period/timeout for the completion of an RDMA operation?

Yesterday I complained about a gen2 x86 client RDMA read not working on a gen1 PowerPC server. Today I got my hardware guy measuring the PCI-Express interface on the PowerPC gen1 server. It seems as if the RDMA read is at least started. So all ideas about endianess problems To explain the proble

Re: [openib-general] What could prevent a gen2 x86 client qp from doing RDMA_READ on a gen1 PowerPC client?

Endian-ness issues? Yes that is the first thought. But where? Since my gen2 x86 rdma code can do an rdma read from a gen1 and gen2 x86 server I think the only values in the ibv_send_wr that can be wrong talking to a PowerPC server can be remote_addr and rkey right I already swapped both but witho

[openib-general] What could prevent a gen2 x86 client qp from doing RDMA_READ on a gen1 PowerPC client?

Here is my next and hopefully last problem. As described earlier I'm connecting a gen2 x86 clients to a gen1 PowerPC server After having sorted out the trouble with the CM parameters I'm now having trouble with RDMA read from client on the server. What works is: - gen2 x86 client doing a VAPI

Re: [openib-general] Unusable QP's on CM established connections from gen2 client to gen1 server.

I don't have a svn repository. I'm living on OFED release will this work on the version in OFED-1.1? Thomas > -Original Message- > From: Sasha Khapyorsky [mailto:[EMAIL PROTECTED] > Sent: Monday, November 13, 2006 9:12 PM > To: Hal Rosenstock; Bub Thomas > C

Re: [openib-general] Unusable QP's on CM established connections from gen2 client to gen1 server.

Sean, you got it! Setting the hop_limit from 64 down to 0 or 1 solved the problem. :-) Don't ask me where I got that hop_limit from, it must have been an example I found somewhere. Can you explain why that hop_limit/is_global makes a difference in communication between gen1 and gen2? Does the coun

Re: [openib-general] Unusable QP's on CM established connections from gen2 client to gen1 server.

Sean, I had a bug in my debug printout so that the value at the end where showing up wrong. Find enclosed the values after corrections in the printout. I see all your questionable values in a good shape now. I tried to increase the retry_count but without success. In fact the maximum value I could

[openib-general] Unusable QP's on CM established connections from gen2 client to gen1 server.

ut: 0     retry_count: 0   rnr_retry: 1     alt_pkey_ix: 0    alt_port: 0 alt_av: 0     alt_timeout: 0 In the good cases described above the qp_state look similar to the ones described here Any help welcome. Thoma

[openib-general] How to register, query and delete a service_id?

/ts_ua0”. I browsed though the ofed sources and got lost in there. Is there some good and simple example that can help me out of my blind? I assume I have to use the ibmad and/or ibumad library? Thanks Thomas Bub Thomas Bub Grass

Re: [openib-general] OFED for SLES10

installed. Unpack the tgz and run the install script found in the directory OFED-1.1-rc6. It does everything you need to get the drivers build and installed. That should be all whats needed. Thomas Bub Thomas Bub Grass Valley Germany GmbH

[openib-general] What can be the reason for VAPI_WR_FLUSH_ERR when sending from gen2 to gen1

Title: What can be the reason for VAPI_WR_FLUSH_ERR when sending from gen2 to gen1 This seems to be the very last little bug in my journey migrating from gen1 client and server to gen2 client  and gen1 server. While I came over all CM issues I had so far (thanks to Sean Heafty)  I’m now in t

[openib-general] Any chance to get 32-Bit libraries on SLES9 x86_64?

Title: Any chance to get 32-Bit libraries on SLES9 x86_64? Is there any chance/trick to get 32-Bit Libraries build and usable on SLES9 x86_64? When I installed OFED-1.1-rc4 I get:   WARNING: sysfsutils 32-bit version is required to build 32-bit libibverbs package. WARNING: Skiping build o

[openib-general] Different byte order between gen1 CM and gen2 CM ->RE: How to connect gen2 CM to gen1 IBGD CM?

uld put a big “Warning” sign somewhere so that others don’t stumple into that pit again. ;-) _ From: Bub Thomas Sent: Wednesday, September 13, 2006 4:11 PM To: 'Sean Hefty'; '[EMAIL PROTECTED]' Cc: openib-general@openib.org Subject:

Re: [openib-general] OFED can't compile against sa.h under SLES10 x86_64

TECTED] [mailto:openib-general- > [EMAIL PROTECTED] On Behalf Of Jack Morgenstein > Sent: Thursday, September 14, 2006 1:12 PM > To: Bub Thomas > Cc: openib-general@openib.org > Subject: [openib-general] OFED can't compile against sa.h under SLES10 > x86_64 > > I was unable to reprod

Re: [openib-general] OFED can't compile against sa.h under SLES10 x86_64

Michael and Bryan, find the libibcm example cmpost.c that fails to compile enclosed. My compiler output looks like: cc -ggdb -Wall -O0 -I. -I./usr/include -I./oibfix -I/usr/local/ofed/include -I/usr/src/linux/drivers/infiniband/include -D__x86_64__ -c -o cmpost.o cmpost.c cmpost.c: In function

[openib-general] How to connect gen2 CM to gen1 IBGD CM?

Title: How to connect gen2 CM to gen1 IBGD CM? Sean, with your patience, the cmpost.c example and the OFED 1.1-rc4 on all machines I finally got a gen2 connection under SLES10 even with a 32-Bit executable on a x86_64 machine. Cool! Now the last part on my journey is standing out. It’s a

[openib-general] OFED can't compile against sa.h under SLES10 x86_64

Title: OFED can't compile against sa.h under SLES10 x86_64 Michael, this is another little issue using OFED under SLES10. In sa.h there is the definition of a struct ibv_sa_path_record that gets re-defined against ib_sa_path_record in the same header file. While the gcc 3.3.3 compile of SL

[openib-general] cmpost establisehd connections are very fragile!?

Title: cmpost establisehd connections are very fragile!? Sean, got my libibverbs/libibcm code working on SLES9 x86_64 after following all the tricks in cmpost.c What I don’t understand why the local_cm_response_timeout set to 254 instead of 20 can block IBV_WR_SEND from client to server whi

Re: [openib-general] Trouble installing OFED-1.1-rc3 on a x86_64 SLES 10 machine

#x27;t installed SVN and can't work on this. I wanted to let the people know that there are some issues. Thanks Thomas -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Michael S. Tsirkin Sent: Tuesday, September 12, 2006 2:55 PM To: Bub Thomas Cc: op

[openib-general] Trouble installing OFED-1.1-rc3 on a x86_64 SLES 10 machine

Just migrated from SLES 9 x86_64 to SLES 10 x86_64 in order to get 32-Bit support. Stumbled over some installation problems. First I tried "All packages" then "Basic install". Both failed to build at different places. Only a "customizied" installation worked. Find the details blow. Thomas Bub A

Re: [openib-general] ibv_poll_cq after ibv_post_send does not work

Dortan Barak wrote: If you are using RC QP: the reason for not getting any completion in the CQ is that Did you post any RR (Receive Request) at the listener side? Dotan, with the cmpost.c example I now get a cm connection even with another machine. However I don't get the cq event, on the sende

[openib-general] Wrong byte order in lid of struct ibv_port_attr reported by ibv_query port!?

Title: Wrong byte order in lid of struct ibv_port_attr reported by ibv_query port!? Sean, with the help of your modified cmpost.c example I found out that the byte order in the lid your query_for_path in cmpost.c is getting into the ib_sa_path_rec is the opposite to the one reported by  ibv_

Re: [openib-general] ibv_poll_cq after ibv_post_send does not work

Dotan, Find my answers inline. Since I could get the cmpost example from Sean compiled and running I will try to compare cmpost.c with my code and find the bugs in my code this way. I will keep your connect_qp example for the case that I can't find the problems the other way. Thanks Thomas Which

Re: [openib-general] libibcm can't connect/talk to libicm on other machine.

L PROTECTED] On Behalf Of Sean Hefty Sent: Tuesday, September 05, 2006 8:15 PM To: Bub Thomas Cc: openib-general@openib.org Subject: Re: [openib-general] libibcm can't connect/talk to libicm on other machine. Bub Thomas wrote: > Dotan, > the ibv_rc_pingpong example works for me so I can

[openib-general] ibv_poll_cq after ibv_post_send does not work

Title: ibv_poll_cq after ibv_post_send does not work I’m still in the process of porting my gen1 code to gen2. As mentioned yesterday I can connect to a listener on the same machine using libibcm. Doing this I have to do the ibv_modify_qp by myself to get the qp’s from INIT via RTR to RTS o

Re: [openib-general] libibcm can't connect/talk to libicm on other machine.

t get compiled) Thomas -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Dotan Barak Sent: Tuesday, September 05, 2006 5:12 PM To: Bub Thomas Cc: openib-general@openib.org Subject: Re: [openib-general] libibcm can't connect/talk to libicm on other machin

[openib-general] libibcm can't connect/talk to libicm on other machine.

Title: libibcm can't connect/talk to libicm on other machine. I’m still in the process of migrating my gen1 application to gen2. Actually I CAN connect a gen2 application to a gen2 listener application on the same machine but NOT to a gen 2 listener on another machine. Any hints where to lo

Re: [openib-general] libibcm can't open /dev/infiniband/ucm0

teresting enough the /dev/infiniband/ucm0 got created and usable automatically. Thomas -Original Message- From: Sean Hefty [mailto:[EMAIL PROTECTED] Sent: Tuesday, August 22, 2006 5:47 PM To: Bub Thomas; Sean Hefty Cc: openib-general@openib.org Subject: RE: [openib-general] libibcm can

Re: [openib-general] libibcm can't open /dev/infiniband/ucm0

re another way/description? Additionally I didn't find the udev rules for the already exsisting /dev/infinibadn devices in the /etc/udev/udev.rules file. Thanks Thomas -Original Message- From: Sean Hefty [mailto:[EMAIL PROTECTED] Sent: Monday, August 21, 2006 6:48 PM To: Bub Thomas

Re: [openib-general] libibcm can't open /dev/infiniband/ucm0

,ib_local_sa,ib_ipoib,ib_sa,ib_ uverbs,ib_umad,ib_ipath,ib_mthca,ib_mad scsi_mod 140177 6 ib_srp,qla2xxx,scsi_transport_fc,libata,mptscsih,sd_mod Thanks Thomas -Original Message- From: Sean Hefty [mailto:[EMAIL PROTECTED] Sent: Friday, August 18, 2006 6:06 PM To: Bub Thomas

Re: [openib-general] [PATCH] cmpost: allow cmpost to build with latest RDMA CM

Sean, as I understand cmpost.c and simple.c where originally pure libibcm examples. Is there any other test code utilizing the libibcm? Thanks Thomas -Original Message- From: Sean Hefty [mailto:[EMAIL PROTECTED] Sent: Friday, August 18, 2006 6:09 PM To: Bub Thomas Cc: Sean Hefty; openib

[openib-general] libibcm can't open /dev/infiniband/ucm0

2 Aug 17 15:14 uverbs0 The exact error message is: libibcm: error <-1:2> opening device I’m running OFED-1.0.1 on an HP xw9300 running SLES9 SP3 in the x86_64 flawor. Thanks Thomas Bub .... Thomas Bub Grass Valley Germany GmbH B

Re: [openib-general] [PATCH] cmpost: allow cmpost to build with latest RDMA CM

Sean Hefty [mailto:[EMAIL PROTECTED] Sent: Thursday, August 17, 2006 6:50 PM To: Bub Thomas Cc: Sean Hefty; openib-general@openib.org; Erez Cohen Subject: Re: [openib-general] [PATCH] cmpost: allow cmpost to build with latest RDMA CM Bub Thomas wrote: > I'm getting a little puzzled. > Fo

Re: [openib-general] [PATCH] cmpost: allow cmpost to build with latest RDMA CM

ation of `struct ibv_sa_path_rec' cmpost.c: In function `void run_client(char*)': cmpost.c:678: error: 'struct cmtest' has no member named 'path_rec' *** Error code 1 clearmake: Error: Build script failed for "cmpost.o" Thomas -Original Message- From:

[openib-general] Where are running examples using libibcm in OFED-1.0.1?

e and an x86 Linux PC data destination. All is running fine with gen1 drivers from Mellanox IBGD-1.8.2. In order to get our data destination application running on 64-Bit Workstations with SLES 9 SP3 and above as well I have to port it gen2. Thanks in advance. Thoma

[openib-general] gen1 drivers as rpm or tgz?

yet. Thanks Thomas Bub Thomas Bub Grass Valley Germany GmbH Brunnenweg 9 64331 Weiterstadt, Germany Tel: +49 6150 104 147 Fax: +49 6150 104 656 Email: [EMAIL PROTECTED] www.GrassValley.com