Re: [ewg] Errors when install OFED 1.5.3-rc4
On 02/22/2011 10:21 PM, Tanin wrote: The whole log file is in the attachment. Need I install the mlx4 if I only want to use iWARP? On Tue, Feb 22, 2011 at 9:02 AM, Taninfanqie...@gmail.com wrote: OK, thanks You do not have to install mlx4 if you are going to use iWARP. In any case, it seems that you have old libibverbs headers, probably, under /usr/local/include. So, if you will clean /usr/local directory from the previous installations OFED installation will succeed. Regards, Vladimir ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
Re: [ewg] Installation problems of OFED-1.5.2
On 02/23/2011 05:12 AM, Tanin wrote: Dear all, I have recompiled the kernel to 2.6.18, and try to install OFED-1.5.2 instead. Now the kernel version is [litan@tera04 OFED-1.5.2]$ uname -a Linux tera04.ultralight.org 2.6.18-prep #1 SMP Tue Feb 22 18:51:00 EST 2011 x86_64 x86_64 x86_64 GNU/Linux I have the full log file in the attachment. Dose it related to that I try many times to install different version of OFED? Thanks a million! OFED's backport system is rely on kernel version. So, changing kernel version changes the set of patches and headers to be used for the compilation. You should keep the kernel version as close as possible to the original version. E.g.: If you compile 2.6.18 from kernel.org then you can name it 2.6.18-prep But, if you recompile 2.6.18-164.el5, then you should name it 2.6.18-164.any extension.el5 Regards, Vladimir ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
Re: [ewg] [PATCH] cxgb3: OFED-1.5.3 Release Notes.
On 02/22/2011 10:13 PM, Steve Wise wrote: Signed-off-by: Steve Wisesw...@opengridcomputing.com --- Applied, Regards, Vladimir ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
Re: [ewg] OFA management tree seperation
On 15:59 Sun 13 Feb , Jason Gunthorpe wrote: On Sun, Feb 13, 2011 at 09:55:50AM +0200, Alex Netes wrote: We finished the management tree seperation. From now on, Ira Weiny wei...@llnl.gov takes the responsibility for maitaining libibmad and infiniband-diags. His trees are: git://git.openfabrics.org/~iraweiny/libibmad git://git.openfabrics.org/~iraweiny/infiniband-diags libibumad, opensm and ibsim trees stays under my responsibility: git://git.openfabrics.org/~alexnetes/libibumad git://git.openfabrics.org/~alexnetes/opensm git://git.openfabrics.org/~alexnetes/ibsim Can you please include the OpenSm 3.2.6 and related branch and tags in your repository? Done. OpenSM 3.2.6 resides on opensm-3.2 branch as before. ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
[ewg] ofa_1_5_kernel 20110223-0200 daily build status
This email was generated automatically, please do not reply git_url: git://git.openfabrics.org/ofed_1_5/linux-2.6.git git_branch: ofed_kernel_1_5 Common build parameters: Passed: Passed on i686 with linux-2.6.19 Passed on i686 with linux-2.6.18 Passed on i686 with linux-2.6.21.1 Passed on i686 with linux-2.6.24 Passed on i686 with linux-2.6.27 Passed on i686 with linux-2.6.26 Passed on i686 with linux-2.6.28 Passed on i686 with linux-2.6.22 Passed on i686 with linux-2.6.29 Passed on i686 with linux-2.6.33 Passed on i686 with linux-2.6.32 Passed on i686 with linux-2.6.31 Passed on i686 with linux-2.6.30 Passed on i686 with linux-2.6.36 Passed on i686 with linux-2.6.34 Passed on i686 with linux-2.6.35 Passed on x86_64 with linux-2.6.16.60-0.54.5-smp Passed on x86_64 with linux-2.6.16.60-0.21-smp Passed on x86_64 with linux-2.6.18-194.el5 Passed on x86_64 with linux-2.6.18 Passed on x86_64 with linux-2.6.18-238.el5 Passed on x86_64 with linux-2.6.18-164.el5 Passed on x86_64 with linux-2.6.20 Passed on x86_64 with linux-2.6.21.1 Passed on x86_64 with linux-2.6.19 Passed on x86_64 with linux-2.6.24 Passed on x86_64 with linux-2.6.26 Passed on x86_64 with linux-2.6.27 Passed on x86_64 with linux-2.6.22 Passed on x86_64 with linux-2.6.25 Passed on x86_64 with linux-2.6.28 Passed on x86_64 with linux-2.6.27.19-5-smp Passed on ia64 with linux-2.6.18 Passed on ia64 with linux-2.6.19 Passed on ia64 with linux-2.6.21.1 Passed on ia64 with linux-2.6.23 Passed on ia64 with linux-2.6.22 Passed on ia64 with linux-2.6.28 Passed on ia64 with linux-2.6.26 Passed on ia64 with linux-2.6.24 Passed on ia64 with linux-2.6.25 Passed on ppc64 with linux-2.6.18 Passed on ppc64 with linux-2.6.19 Failed: ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
[ewg] [PATCH] RDMA/doc: Updated nes_release_notes.txt
Updated a section What's new for NES driver and MPI usage
Signed-off-by: Mirek Walukiewicz miroslaw.walukiew...@intel.com
---
docs/release_notes/nes_release_notes.txt | 150 --
1 files changed, 60 insertions(+), 90 deletions(-)
diff --git a/docs/release_notes/nes_release_notes.txt
b/docs/release_notes/nes_release_notes.txt
index 0233d90..f89b687 100644
--- a/docs/release_notes/nes_release_notes.txt
+++ b/docs/release_notes/nes_release_notes.txt
@@ -1,6 +1,6 @@
Open Fabrics Enterprise Distribution (OFED)
NetEffect Ethernet Cluster Server Adapter Release Notes
- September 2010
+ February 2011
@@ -10,20 +10,20 @@ support for the NetEffect Ethernet Cluster Server Adapters.
==
What's New
==
-OFED 1.5.2 contains several enhancements and bug fixes to iw_nes driver.
-
-* Add new feature iWarp Multicast Acceleration (IMA).
-* Add module option to disable extra doorbell read after a write.
-* Change CQ event notification to not fire event unless there is a
- new CQE not polled.
-* Fix payload calculation for post receive with more than one SGE.
-* Fix crash when CLOSE was indicated twice due to connection close
- during remote peer's timeout on pending MPA reply.
-* Fix ifdown hang by not calling ib_unregister_device() till removal
- of iw_nes module.
-* Handle RST when state of connection is in FIN_WAIT2.
-* Correct properties for various nes_query_{qp, port, device} calls.
-
+OFED 1.5.3 contains several enhancements and bug fixes to iw_nes driver.
+
+* Correct AEQE operation.
+* Add backports for 2.6.35 and 2.6.36 kernels.
+* Fix for problem of lack of HW limit checking for MG attach for IMA.
+* Fix for a problem with non-aligned buffers crash during post_recv for IMA.
+* Fix for possible crash when RAW QP resources are destroyed.
+* Fix for problem of RAW QP transition state toERR.
+* Fix a problem with sending packets with VLAN flag for IMA.
+* Enable bonds on iw_nes.
+* Fix hazard of sending ibevent for unregistered device.
+* Fix for sending IB_EVENT_PORT_ERR/PORT_ACTIVEevent on link state
interrupt.
+* Fix SFP link down detection issue with switch port disable.
+* Fix incorrect SFP link status detection on driver init.
Required Setting - RDMA Unify TCP port space
@@ -121,115 +121,84 @@ mpd.hosts file
mpd.hosts is a text file with a list of nodes, one per line, in the MPI ring.
Use either fully qualified hostname or IP address.
+===
+100% CPU Utilization remark
+===
+Most of the RDMA applications use CQ Polling mode to decrease latency.
+This operational mode can cause 100% CPU utilization.
-===
-Recommended Settings for HP MPI 2.2.7
-===
-Add the following to mpirun command:
-
--1sided
-
-Example mpirun command with uDAPL-2.0:
-
-mpirun -np 2 -hostfile /opt/mpd.hosts
- -UDAPL -prot -intra=shm
- -e MPI_HASIC_UDAPL=ofa-v2-iwarp
- -1sided
- /opt/hpmpi/help/hello_world
-
-Example mpirun command with uDAPL-1.2:
-
-mpirun -np 2 -hostfile /opt/mpd.hosts
- -UDAPL -prot -intra=shm
- -e MPI_HASIC_UDAPL=OpenIB-iwarp
- -1sided
- /opt/hpmpi/help/hello_world
-
-
-
-Recommended Settings for Platform MPI 7.1 (formerly HP-MPI)
-
-Add the following to mpirun command:
-
--1sided
-
-Example mpirun command with uDAPL-2.0:
-
-mpirun -np 2 -hostfile /opt/mpd.hosts
- -UDAPL -prot -intra=shm
- -e MPI_HASIC_UDAPL=ofa-v2-iwarp
- -1sided
- /opt/platform_mpi/help/hello_world
-
-Example mpirun command with uDAPL-1.2:
-
-mpirun -np 2 -hostfile /opt/mpd.hosts
- -UDAPL -prot -intra=shm
- -e MPI_HASIC_UDAPL=OpenIB-iwarp
- -1sided
- /opt/platform_mpi/help/hello_world
-
+To switch to Event Driven mode and lower CPU utilization please refer to
README or
+Release Notes for specific application.
==
-Recommended Settings for Intel MPI 3.2.x/4.0.x
+Recommended Settings for Intel MPI 4.0.x
==
Add the following to mpiexec command:
-genv I_MPI_FALLBACK_DEVICE 0
--genv I_MPI_DEVICE rdma:OpenIB-iwarp
+-genv I_MPI_FABRICS shm:dapl
+-genv I_MPI_DAPL_PROVIDER ofa-v2-iwarp
-genv I_MPI_USE_RENDEZVOUS_RDMA_WRITE 1
Example mpiexec command line for uDAPL-2.0:
mpiexec -genv I_MPI_FALLBACK_DEVICE 0
--genv I_MPI_DEVICE rdma:ofa-v2-iwarp
+-genv I_MPI_FABRICS shm:dapl
+-genv I_MPI_DAPL_PROVIDER ofa-v2-iwarp
-genv I_MPI_USE_RENDEZVOUS_RDMA_WRITE
Re: [ewg] Installation problems of OFED-1.5.2
I think I also need iw_nes driver for my RNIC card, right? [litan@tera05 init.d]$ /sbin/lspci Ethernet controller: NetEffect NE020 10Gb Accelerated Ethernet Adapter (iWARP RNIC) (rev 05) On Wed, Feb 23, 2011 at 2:02 PM, Tanin fanqie...@gmail.com wrote: Oh, yes. Thanks so much! After uninstall all libibverbs packages, the OFED-1.5.3-rc5 successfully passed all building process: Install iscsi-initiator-utils RPM: Running rpm -iv /atlas/data18a/litan/OFED-1.5.3-rc5/RPMS/sl-release-5.5-1/x86_64/iscsi-initiator-utils-2.0-869.2.x86_64.rpm The default IPoIB interface configuration is based on DHCP. Note that a special patch for DHCP is required for supporting IPoIB. The patch is available under docs/dhcp If you do not have DHCP, you must change this configuration in the following steps. IPoIB interfaces configured successfully Press any key to continue ... Installation finished successfully. Press any key to continue... It seems that the IPoIB is not configured due to DHCP issues. And the OFED tools did not work also: [litan@tera05 OFED-1.5.3-rc5]$ sudo ibv_devinfo Failed to get IB devices list: Function not implemented [litan@tera05 OFED-1.5.3-rc5]$ sudo ibstat sudo: ibstat: command not found On Wed, Feb 23, 2011 at 4:14 AM, Vladimir Sokolovsky v...@dev.mellanox.co.il wrote: On 02/23/2011 05:12 AM, Tanin wrote: Dear all, I have recompiled the kernel to 2.6.18, and try to install OFED-1.5.2 instead. Now the kernel version is [litan@tera04 OFED-1.5.2]$ uname -a Linux tera04.ultralight.org 2.6.18-prep #1 SMP Tue Feb 22 18:51:00 EST 2011 x86_64 x86_64 x86_64 GNU/Linux I have the full log file in the attachment. Dose it related to that I try many times to install different version of OFED? Thanks a million! OFED's backport system is rely on kernel version. So, changing kernel version changes the set of patches and headers to be used for the compilation. You should keep the kernel version as close as possible to the original version. E.g.: If you compile 2.6.18 from kernel.org then you can name it 2.6.18-prep But, if you recompile 2.6.18-164.el5, then you should name it 2.6.18-164.any extension.el5 Regards, Vladimir -- Best regards, --- Li, Tan PhD Candidate Research Assistant, Electrical Engineering, Stony Brook University, NY Personal Web Site: https://sites.google.com/site/homepagelitan/Home Email: fanqie...@gmail.com -- Best regards, --- Li, Tan PhD Candidate Research Assistant, Electrical Engineering, Stony Brook University, NY Personal Web Site: https://sites.google.com/site/homepagelitan/Home Email: fanqie...@gmail.com ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
Re: [ewg] Installation problems of OFED-1.5.2
OK, every thing works fine after reboot. Thanks so much for all of your help. Have a nice day! On Wed, Feb 23, 2011 at 2:24 PM, Tanin fanqie...@gmail.com wrote: I think I also need iw_nes driver for my RNIC card, right? [litan@tera05 init.d]$ /sbin/lspci Ethernet controller: NetEffect NE020 10Gb Accelerated Ethernet Adapter (iWARP RNIC) (rev 05) On Wed, Feb 23, 2011 at 2:02 PM, Tanin fanqie...@gmail.com wrote: Oh, yes. Thanks so much! After uninstall all libibverbs packages, the OFED-1.5.3-rc5 successfully passed all building process: Install iscsi-initiator-utils RPM: Running rpm -iv /atlas/data18a/litan/OFED-1.5.3-rc5/RPMS/sl-release-5.5-1/x86_64/iscsi-initiator-utils-2.0-869.2.x86_64.rpm The default IPoIB interface configuration is based on DHCP. Note that a special patch for DHCP is required for supporting IPoIB. The patch is available under docs/dhcp If you do not have DHCP, you must change this configuration in the following steps. IPoIB interfaces configured successfully Press any key to continue ... Installation finished successfully. Press any key to continue... It seems that the IPoIB is not configured due to DHCP issues. And the OFED tools did not work also: [litan@tera05 OFED-1.5.3-rc5]$ sudo ibv_devinfo Failed to get IB devices list: Function not implemented [litan@tera05 OFED-1.5.3-rc5]$ sudo ibstat sudo: ibstat: command not found On Wed, Feb 23, 2011 at 4:14 AM, Vladimir Sokolovsky v...@dev.mellanox.co.il wrote: On 02/23/2011 05:12 AM, Tanin wrote: Dear all, I have recompiled the kernel to 2.6.18, and try to install OFED-1.5.2 instead. Now the kernel version is [litan@tera04 OFED-1.5.2]$ uname -a Linux tera04.ultralight.org 2.6.18-prep #1 SMP Tue Feb 22 18:51:00 EST 2011 x86_64 x86_64 x86_64 GNU/Linux I have the full log file in the attachment. Dose it related to that I try many times to install different version of OFED? Thanks a million! OFED's backport system is rely on kernel version. So, changing kernel version changes the set of patches and headers to be used for the compilation. You should keep the kernel version as close as possible to the original version. E.g.: If you compile 2.6.18 from kernel.org then you can name it 2.6.18-prep But, if you recompile 2.6.18-164.el5, then you should name it 2.6.18-164.any extension.el5 Regards, Vladimir -- Best regards, --- Li, Tan PhD Candidate Research Assistant, Electrical Engineering, Stony Brook University, NY Personal Web Site: https://sites.google.com/site/homepagelitan/Home Email: fanqie...@gmail.com -- Best regards, --- Li, Tan PhD Candidate Research Assistant, Electrical Engineering, Stony Brook University, NY Personal Web Site: https://sites.google.com/site/homepagelitan/Home Email: fanqie...@gmail.com -- Best regards, --- Li, Tan PhD Candidate Research Assistant, Electrical Engineering, Stony Brook University, NY Personal Web Site: https://sites.google.com/site/homepagelitan/Home Email: fanqie...@gmail.com ___ ewg mailing list ewg@lists.openfabrics.org http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
