RE: [ewg] can't remove ofed1.3.x packages

[Scott Weitzenkamp (sweitzen)]

Use "rpm -e --allmatches libsdp-1.1.99-1.ofed1.3.1"?

Scott

> -Original Message-
> From: [EMAIL PROTECTED] 
> [mailto:[EMAIL PROTECTED] On Behalf Of Or Gerlitz
> Sent: Monday, November 17, 2008 10:38 PM
> To: [EMAIL PROTECTED]
> Cc: ewg@lists.openfabrics.org
> Subject: [ewg] can't remove ofed1.3.x packages
> 
> Hi Vlad,
> 
> doing
> 
> $ rpm -e libsdp-1.1.99-1.ofed1.3.1
> error: "libsdp-1.1.99-1.ofed1.3.1" specifies multiple packages
> 
> I noted that ofed1.3.x had the practice of installing multiple
> packages with the same name! e.g see below the sorting of packages.
> 
> So how can I remove a specific package (I don't want to do huge
> uninstall/install just remove 2-3 packages)? also has this fixed
> in the next release?
> 
> Or.
> 
> $ rpm -qav | grep ofed1.3.1 | sort
> 
> dapl-1.2.7-1.ofed1.3.1
> dapl-1.2.7-1.ofed1.3.1
> dapl-2.0.9-1.ofed1.3.1
> dapl-2.0.9-1.ofed1.3.1
> dapl-devel-1.2.7-1.ofed1.3.1
> dapl-devel-1.2.7-1.ofed1.3.1
> dapl-devel-2.0.9-1.ofed1.3.1
> dapl-devel-2.0.9-1.ofed1.3.1
> dapl-utils-2.0.9-1.ofed1.3.1
> dapl-utils-2.0.9-1.ofed1.3.1
> ibutils-1.2-1.ofed1.3.1
> libibcm-1.0.2-1.ofed1.3.1
> libibcm-1.0.2-1.ofed1.3.1
> libibcm-devel-1.0.2-1.ofed1.3.1
> libibcm-devel-1.0.2-1.ofed1.3.1
> libibcommon-1.0.8-1.ofed1.3.1
> libibcommon-devel-1.0.8-1.ofed1.3.1
> libibcommon-devel-1.0.8-1.ofed1.3.1
> libibmad-1.1.6-1.ofed1.3.1
> libibmad-devel-1.1.6-1.ofed1.3.1
> libibmad-devel-1.1.6-1.ofed1.3.1
> libibumad-1.1.7-1.ofed1.3.1
> libibverbs-1.1.1-1.ofed1.3.1
> libibverbs-1.1.1-1.ofed1.3.1
> libibverbs-devel-1.1.1-1.ofed1.3.1
> libibverbs-devel-1.1.1-1.ofed1.3.1
> libibverbs-utils-1.1.1-1.ofed1.3.1
> libibverbs-utils-1.1.1-1.ofed1.3.1
> libmlx4-1.0-1.ofed1.3.1
> libmlx4-1.0-1.ofed1.3.1
> libmthca-1.0.4-1.ofed1.3.1
> libmthca-1.0.4-1.ofed1.3.1
> librdmacm-1.0.7-1.ofed1.3.1
> librdmacm-1.0.7-1.ofed1.3.1
> librdmacm-devel-1.0.7-1.ofed1.3.1
> librdmacm-devel-1.0.7-1.ofed1.3.1
> librdmacm-utils-1.0.7-1.ofed1.3.1
> librdmacm-utils-1.0.7-1.ofed1.3.1
> libsdp-1.1.99-1.ofed1.3.1
> libsdp-1.1.99-1.ofed1.3.1
> libsdp-devel-1.1.99-1.ofed1.3.1
> libsdp-devel-1.1.99-1.ofed1.3.1
> mstflint-1.3-1.ofed1.3.1
> perftest-1.2-1.ofed1.3.1
> qperf-0.4.0-1.ofed1.3.1
> sdpnetstat-1.60-1.ofed1.3.1
> srptools-0.0.4-1.ofed1.3.1
> tvflash-0.9.0-1.ofed1.3.1
> 
> 
> here I assume to see the content of both the 64 and 32 bit 
> packages, correct?
> 
> $ rpm -ql libsdp-1.1.99-1.ofed1.3.1 | xargs file
> 
> 
> /etc/libsdp.conf:   ASCII English text
> /usr/lib64/libsdp.so.1: symbolic link to 
> `libsdp.so.1.0.0'
> /usr/lib64/libsdp.so.1.0.0: ELF 64-bit LSB shared 
> object, AMD x86-64, version 1 (SYSV), stripped
> /usr/share/doc/libsdp-1.1.99:   directory
> /usr/share/doc/libsdp-1.1.99/COPYING:   ASCII English text
> /usr/share/doc/libsdp-1.1.99/ChangeLog: ASCII English text
> /usr/share/doc/libsdp-1.1.99/NEWS:  ASCII text
> /usr/share/doc/libsdp-1.1.99/README:ASCII English text
> /etc/libsdp.conf:   ASCII English text
> /usr/lib/libsdp.so.1:   symbolic link to 
> `libsdp.so.1.0.0'
> /usr/lib/libsdp.so.1.0.0:   ELF 32-bit LSB shared 
> object, Intel 80386, version 1 (SYSV), stripped
> /usr/lib/libsdp_sys.so.1:   symbolic link to 
> `libsdp_sys.so.1.0.0'
> /usr/lib/libsdp_sys.so.1.0.0:   ELF 32-bit LSB shared 
> object, Intel 80386, version 1 (SYSV), stripped
> /usr/share/doc/libsdp-1.1.99:   directory
> /usr/share/doc/libsdp-1.1.99/COPYING:   ASCII English text
> /usr/share/doc/libsdp-1.1.99/ChangeLog: ASCII English text
> /usr/share/doc/libsdp-1.1.99/NEWS:  ASCII text
> /usr/share/doc/libsdp-1.1.99/README:ASCII English text
> 
> 
> ___
> ewg mailing list
> ewg@lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] RE: [ofa-general] OFED 1.4-RC1 is available

[Scott Weitzenkamp (sweitzen)]

Sure, that's fine.  I don't really have a strong opinion, just wanted to
know what you were up to.

Scott
 

> -Original Message-
> From: Dhabaleswar Panda [mailto:[EMAIL PROTECTED] 
> Sent: Wednesday, September 10, 2008 3:25 PM
> To: Scott Weitzenkamp (sweitzen)
> Cc: Jonathan Perkins; ewg@lists.openfabrics.org; 
> [EMAIL PROTECTED]; Dhabaleswar Panda
> Subject: RE: [ewg] RE: [ofa-general] OFED 1.4-RC1 is available
> 
> > So I can have mpirun_rsh *or* mpiexec, but not both?
> 
> Our goal is to provide both. However, it will take us some 
> time to make
> the necessary changes to the SRPM creation process and test it. For
> tomorrow's SRPM version, we will provide the option for having one of
> these two. By next week, we will have an SRPM update to have both.
> 
> Will that work out?
> 
> Thanks,
> 
> DK
> 
> > Scott
> >
> >
> >
> > > -Original Message-
> > > From: Dhabaleswar Panda [mailto:[EMAIL PROTECTED]
> > > Sent: Wednesday, September 10, 2008 3:15 PM
> > > To: Scott Weitzenkamp (sweitzen)
> > > Cc: Jonathan Perkins; ewg@lists.openfabrics.org;
> > > [EMAIL PROTECTED]; Dhabaleswar Panda
> > > Subject: RE: [ewg] RE: [ofa-general] OFED 1.4-RC1 is available
> > >
> > > Hi Scott,
> > >
> > > Thanks for your note. Starting with MVAPICH2 1.2, a new scalable
> > > mpirun_rsh job start-up framework (similar to the one used in
> > > MVAPICH) has
> > > been introduced. This allows MVAPICH2 to start on 
> multi-thousand core
> > > clusters with very little time (like MVAPICH). It also allows
> > > job start-up
> > > scheme to be uniform across MVAPICH and MVAPICH2.  The traditional
> > > MPD/mpiexec job start-up option is still there. In the latest
> > > MVAPICH2 1.2
> > > SRPM (1.2rc2-4), the default has been set for the new
> > > scalable start-up
> > > scheme.  That's why you are not able to have it built with
> > > mpiexec. Since
> > > Jonathan is updating the SRPM to take care of the 
> multiple compilers
> > > errors (you reported yesterday), we will also include an
> > > option to have
> > > either of these two job start-up schemes (A. the new scalable
> > > mpirun_rsh
> > > framework or B. the traditional MPD-based framework)
> > > installed. The new
> > > SRPM to be uploaded by tomorrow will have all these fixes.
> > >
> > > Let us know if this will work out for you.
> > >
> > > Thanks,
> > >
> > > DK
> > >
> > > On Wed, 10 Sep 2008, Scott Weitzenkamp (sweitzen) wrote:
> > >
> > > > I'm also not getting mpiexec built, at least on the first
> > > distro I tried
> > > > (RHEL4 x86_64):
> > > >
> > > > # rpm -qlip mvapich2_gcc-1.2rc2-4.x86_64.rpm | fgrep mpiexec
> > > > /usr/mpi/gcc/mvapich2-1.2rc2/bin/mpiexec.mpd
> > > >
> > > > Scott
> > > >
> > > >
> > > >
> > > > > -Original Message-
> > > > > From: Jonathan Perkins [mailto:[EMAIL PROTECTED]
> > > > > Sent: Tuesday, September 09, 2008 1:25 PM
> > > > > To: Scott Weitzenkamp (sweitzen)
> > > > > Cc: Tziporet Koren; ewg@lists.openfabrics.org;
> > > > > [EMAIL PROTECTED]
> > > > > Subject: Re: [ewg] RE: [ofa-general] OFED 1.4-RC1 is available
> > > > >
> > > > > Thanks for the note.  We are taking a look at this.
> > > > >
> > > > > On Tue, Sep 09, 2008 at 12:52:44PM -0700, Scott Weitzenkamp
> > > > > (sweitzen) wrote:
> > > > > > I am unable to build MVAPICH2 for multiple compilers:
> > > > > >
> > > > > > Building the MVAPICH2 RPM [OFA]...
> > > > > > Running  rpmbuild --rebuild --define '_topdir
> > > /var/tmp/OFED_topdir'
> > > > > > --define 'di
> > > > > > st %{nil}' --target x86_64 --define '_name mvapich2_gcc'
> > > > > --define 'impl
> > > > > > ofa' --d
> > > > > > efine 'rdma --with-rdma=gen2' --define 'ib_include
> > > > > > --with-ib-include=/usr/includ
> > > > > > e' --define 'ib_libpath 
> --with-ib-libpath=/usr/lib64' --define
> > > > > > 'shared_libs 1' -
> > > > > > -define 'romio 1' --define '

RE: [ewg] RE: [ofa-general] OFED 1.4-RC1 is available

[Scott Weitzenkamp (sweitzen)]

So I can have mpirun_rsh *or* mpiexec, but not both?

Scott

 

> -Original Message-
> From: Dhabaleswar Panda [mailto:[EMAIL PROTECTED] 
> Sent: Wednesday, September 10, 2008 3:15 PM
> To: Scott Weitzenkamp (sweitzen)
> Cc: Jonathan Perkins; ewg@lists.openfabrics.org; 
> [EMAIL PROTECTED]; Dhabaleswar Panda
> Subject: RE: [ewg] RE: [ofa-general] OFED 1.4-RC1 is available
> 
> Hi Scott,
> 
> Thanks for your note. Starting with MVAPICH2 1.2, a new scalable
> mpirun_rsh job start-up framework (similar to the one used in 
> MVAPICH) has
> been introduced. This allows MVAPICH2 to start on multi-thousand core
> clusters with very little time (like MVAPICH). It also allows 
> job start-up
> scheme to be uniform across MVAPICH and MVAPICH2.  The traditional
> MPD/mpiexec job start-up option is still there. In the latest 
> MVAPICH2 1.2
> SRPM (1.2rc2-4), the default has been set for the new 
> scalable start-up
> scheme.  That's why you are not able to have it built with 
> mpiexec. Since
> Jonathan is updating the SRPM to take care of the multiple compilers
> errors (you reported yesterday), we will also include an 
> option to have
> either of these two job start-up schemes (A. the new scalable 
> mpirun_rsh
> framework or B. the traditional MPD-based framework) 
> installed. The new
> SRPM to be uploaded by tomorrow will have all these fixes.
> 
> Let us know if this will work out for you.
> 
> Thanks,
> 
> DK
> 
> On Wed, 10 Sep 2008, Scott Weitzenkamp (sweitzen) wrote:
> 
> > I'm also not getting mpiexec built, at least on the first 
> distro I tried
> > (RHEL4 x86_64):
> >
> > # rpm -qlip mvapich2_gcc-1.2rc2-4.x86_64.rpm | fgrep mpiexec
> > /usr/mpi/gcc/mvapich2-1.2rc2/bin/mpiexec.mpd
> >
> > Scott
> >
> >
> >
> > > -Original Message-
> > > From: Jonathan Perkins [mailto:[EMAIL PROTECTED]
> > > Sent: Tuesday, September 09, 2008 1:25 PM
> > > To: Scott Weitzenkamp (sweitzen)
> > > Cc: Tziporet Koren; ewg@lists.openfabrics.org;
> > > [EMAIL PROTECTED]
> > > Subject: Re: [ewg] RE: [ofa-general] OFED 1.4-RC1 is available
> > >
> > > Thanks for the note.  We are taking a look at this.
> > >
> > > On Tue, Sep 09, 2008 at 12:52:44PM -0700, Scott Weitzenkamp
> > > (sweitzen) wrote:
> > > > I am unable to build MVAPICH2 for multiple compilers:
> > > >
> > > > Building the MVAPICH2 RPM [OFA]...
> > > > Running  rpmbuild --rebuild --define '_topdir 
> /var/tmp/OFED_topdir'
> > > > --define 'di
> > > > st %{nil}' --target x86_64 --define '_name mvapich2_gcc'
> > > --define 'impl
> > > > ofa' --d
> > > > efine 'rdma --with-rdma=gen2' --define 'ib_include
> > > > --with-ib-include=/usr/includ
> > > > e' --define 'ib_libpath --with-ib-libpath=/usr/lib64' --define
> > > > 'shared_libs 1' -
> > > > -define 'romio 1' --define 'comp_env CC=gcc CXX=g++ F77=gfortran
> > > > F90=gfortran' -
> > > > -define 'auto_req 0' --define 'mpi_selector 
> /usr/bin/mpi-selector'
> > > > --define '_pr
> > > > efix /usr/mpi/gcc/mvapich2-1.2rc2'
> > > > /tmp/OFED-1.4-rc1/SRPMS/mvapich2-1.2rc2-4.src
> > > > .rpm
> > > > Install mvapich2_gcc RPM:
> > > > Running rpm -iv --nodeps
> > > > /tmp/OFED-1.4-rc1/RPMS/redhat-release-4AS-4.1/x86_64/mv
> > > > apich2_gcc-1.2rc2-4.x86_64.rpm
> > > > Build mvapich2_pgi RPM
> > > > Building the MVAPICH2 RPM [OFA]...
> > > > Running  rpmbuild --rebuild --define '_topdir 
> /var/tmp/OFED_topdir'
> > > > --define 'di
> > > > st %{nil}' --target x86_64 --define '_name mvapich2_pgi'
> > > --define 'impl
> > > > ofa' --d
> > > > efine 'rdma --with-rdma=gen2' --define 'ib_include
> > > > --with-ib-include=/usr/includ
> > > > e' --define 'ib_libpath --with-ib-libpath=/usr/lib64' --define
> > > > 'shared_libs 1' -
> > > > -define 'romio 1' --define 'comp_env CC=pgcc CXX=pgCC F77=pgf77
> > > > F90=pgf90' --def
> > > > ine 'auto_req 0' --define 'mpi_selector
> > > /usr/bin/mpi-selector' --define
> > > > '_prefix
> > > >  /usr/mpi/pgi/mvapich2-1.2rc2'
> > > > /tmp/OFE

RE: [ewg] RE: [ofa-general] OFED 1.4-RC1 is available

[Scott Weitzenkamp (sweitzen)]

I'm also not getting mpiexec built, at least on the first distro I tried
(RHEL4 x86_64):

# rpm -qlip mvapich2_gcc-1.2rc2-4.x86_64.rpm | fgrep mpiexec
/usr/mpi/gcc/mvapich2-1.2rc2/bin/mpiexec.mpd

Scott

 

> -Original Message-
> From: Jonathan Perkins [mailto:[EMAIL PROTECTED] 
> Sent: Tuesday, September 09, 2008 1:25 PM
> To: Scott Weitzenkamp (sweitzen)
> Cc: Tziporet Koren; ewg@lists.openfabrics.org; 
> [EMAIL PROTECTED]
> Subject: Re: [ewg] RE: [ofa-general] OFED 1.4-RC1 is available
> 
> Thanks for the note.  We are taking a look at this.
> 
> On Tue, Sep 09, 2008 at 12:52:44PM -0700, Scott Weitzenkamp 
> (sweitzen) wrote:
> > I am unable to build MVAPICH2 for multiple compilers:
> > 
> > Building the MVAPICH2 RPM [OFA]...
> > Running  rpmbuild --rebuild --define '_topdir /var/tmp/OFED_topdir'
> > --define 'di
> > st %{nil}' --target x86_64 --define '_name mvapich2_gcc' 
> --define 'impl
> > ofa' --d
> > efine 'rdma --with-rdma=gen2' --define 'ib_include
> > --with-ib-include=/usr/includ
> > e' --define 'ib_libpath --with-ib-libpath=/usr/lib64' --define
> > 'shared_libs 1' -
> > -define 'romio 1' --define 'comp_env CC=gcc CXX=g++ F77=gfortran
> > F90=gfortran' -
> > -define 'auto_req 0' --define 'mpi_selector /usr/bin/mpi-selector'
> > --define '_pr
> > efix /usr/mpi/gcc/mvapich2-1.2rc2'
> > /tmp/OFED-1.4-rc1/SRPMS/mvapich2-1.2rc2-4.src
> > .rpm
> > Install mvapich2_gcc RPM:
> > Running rpm -iv --nodeps
> > /tmp/OFED-1.4-rc1/RPMS/redhat-release-4AS-4.1/x86_64/mv
> > apich2_gcc-1.2rc2-4.x86_64.rpm
> > Build mvapich2_pgi RPM
> > Building the MVAPICH2 RPM [OFA]...
> > Running  rpmbuild --rebuild --define '_topdir /var/tmp/OFED_topdir'
> > --define 'di
> > st %{nil}' --target x86_64 --define '_name mvapich2_pgi' 
> --define 'impl
> > ofa' --d
> > efine 'rdma --with-rdma=gen2' --define 'ib_include
> > --with-ib-include=/usr/includ
> > e' --define 'ib_libpath --with-ib-libpath=/usr/lib64' --define
> > 'shared_libs 1' -
> > -define 'romio 1' --define 'comp_env CC=pgcc CXX=pgCC F77=pgf77
> > F90=pgf90' --def
> > ine 'auto_req 0' --define 'mpi_selector 
> /usr/bin/mpi-selector' --define
> > '_prefix
> >  /usr/mpi/pgi/mvapich2-1.2rc2'
> > /tmp/OFED-1.4-rc1/SRPMS/mvapich2-1.2rc2-4.src.rpm
> > Install mvapich2_pgi RPM:
> > Running rpm -iv --nodeps
> > /tmp/OFED-1.4-rc1/RPMS/redhat-release-4AS-4.1/x86_64/mv
> > apich2_pgi-1.2rc2-4.x86_64.rpm
> > Failed to install mvapich2_pgi RPM
> > See /tmp/OFED.12539.logs/mvapich2_pgi.rpminstall.log
> > 
> > # more /tmp/OFED.12539.logs/mvapich2_pgi.rpminstall.log
> > Preparing packages for installation...
> > file /etc/mpe_graphics.conf from install of
> > mvapich2_pgi-1.2rc2-4 confli
> > cts with file from package mvapich2_gcc-1.2rc2-4
> > file /etc/mpe_log.conf from install of mvapich2_pgi-1.2rc2-4
> > conflicts w
> > ith file from package mvapich2_gcc-1.2rc2-4
> > file /etc/mpe_mpianim.conf from install of 
> mvapich2_pgi-1.2rc2-4
> > conflic
> > ts with file from package mvapich2_gcc-1.2rc2-4
> > file /etc/mpe_mpicheck.conf from install of
> > mvapich2_pgi-1.2rc2-4 confli
> > cts with file from package mvapich2_gcc-1.2rc2-4
> > file /etc/mpe_mpilog.conf from install of 
> mvapich2_pgi-1.2rc2-4
> > conflict
> > s with file from package mvapich2_gcc-1.2rc2-4
> > file /etc/mpe_mpitrace.conf from install of
> > mvapich2_pgi-1.2rc2-4 confli
> > cts with file from package mvapich2_gcc-1.2rc2-4
> > file /etc/mpe_nolog.conf from install of 
> mvapich2_pgi-1.2rc2-4
> > conflicts
> >  with file from package mvapich2_gcc-1.2rc2-4
> > file /etc/mpicc.conf from install of mvapich2_pgi-1.2rc2-4
> > conflicts wit
> > h file from package mvapich2_gcc-1.2rc2-4
> > file /etc/mpicxx.conf from install of mvapich2_pgi-1.2rc2-4
> > conflicts wi
> > th file from package mvapich2_gcc-1.2rc2-4
> > file /etc/mpif77.conf from install of mvapich2_pgi-1.2rc2-4
> > conflicts wi
> > th file from package mvapich2_gcc-1.2rc2-4
> > file /etc/mpif90.conf from install of mvapich2_pgi-1.2rc2-4
> > conflicts wi
> > th file from package mvapich2_gcc-1.2rc2-4
> > 
> > Scott Weitzenkamp
> > SQA and Release Man

[ewg] RE: [ofa-general] OFED 1.4-RC1 is available

[Scott Weitzenkamp (sweitzen)]

I am unable to build MVAPICH2 for multiple compilers:

Building the MVAPICH2 RPM [OFA]...
Running  rpmbuild --rebuild --define '_topdir /var/tmp/OFED_topdir'
--define 'di
st %{nil}' --target x86_64 --define '_name mvapich2_gcc' --define 'impl
ofa' --d
efine 'rdma --with-rdma=gen2' --define 'ib_include
--with-ib-include=/usr/includ
e' --define 'ib_libpath --with-ib-libpath=/usr/lib64' --define
'shared_libs 1' -
-define 'romio 1' --define 'comp_env CC=gcc CXX=g++ F77=gfortran
F90=gfortran' -
-define 'auto_req 0' --define 'mpi_selector /usr/bin/mpi-selector'
--define '_pr
efix /usr/mpi/gcc/mvapich2-1.2rc2'
/tmp/OFED-1.4-rc1/SRPMS/mvapich2-1.2rc2-4.src
.rpm
Install mvapich2_gcc RPM:
Running rpm -iv --nodeps
/tmp/OFED-1.4-rc1/RPMS/redhat-release-4AS-4.1/x86_64/mv
apich2_gcc-1.2rc2-4.x86_64.rpm
Build mvapich2_pgi RPM
Building the MVAPICH2 RPM [OFA]...
Running  rpmbuild --rebuild --define '_topdir /var/tmp/OFED_topdir'
--define 'di
st %{nil}' --target x86_64 --define '_name mvapich2_pgi' --define 'impl
ofa' --d
efine 'rdma --with-rdma=gen2' --define 'ib_include
--with-ib-include=/usr/includ
e' --define 'ib_libpath --with-ib-libpath=/usr/lib64' --define
'shared_libs 1' -
-define 'romio 1' --define 'comp_env CC=pgcc CXX=pgCC F77=pgf77
F90=pgf90' --def
ine 'auto_req 0' --define 'mpi_selector /usr/bin/mpi-selector' --define
'_prefix
 /usr/mpi/pgi/mvapich2-1.2rc2'
/tmp/OFED-1.4-rc1/SRPMS/mvapich2-1.2rc2-4.src.rpm
Install mvapich2_pgi RPM:
Running rpm -iv --nodeps
/tmp/OFED-1.4-rc1/RPMS/redhat-release-4AS-4.1/x86_64/mv
apich2_pgi-1.2rc2-4.x86_64.rpm
Failed to install mvapich2_pgi RPM
See /tmp/OFED.12539.logs/mvapich2_pgi.rpminstall.log

# more /tmp/OFED.12539.logs/mvapich2_pgi.rpminstall.log
Preparing packages for installation...
file /etc/mpe_graphics.conf from install of
mvapich2_pgi-1.2rc2-4 confli
cts with file from package mvapich2_gcc-1.2rc2-4
file /etc/mpe_log.conf from install of mvapich2_pgi-1.2rc2-4
conflicts w
ith file from package mvapich2_gcc-1.2rc2-4
file /etc/mpe_mpianim.conf from install of mvapich2_pgi-1.2rc2-4
conflic
ts with file from package mvapich2_gcc-1.2rc2-4
file /etc/mpe_mpicheck.conf from install of
mvapich2_pgi-1.2rc2-4 confli
cts with file from package mvapich2_gcc-1.2rc2-4
file /etc/mpe_mpilog.conf from install of mvapich2_pgi-1.2rc2-4
conflict
s with file from package mvapich2_gcc-1.2rc2-4
file /etc/mpe_mpitrace.conf from install of
mvapich2_pgi-1.2rc2-4 confli
cts with file from package mvapich2_gcc-1.2rc2-4
file /etc/mpe_nolog.conf from install of mvapich2_pgi-1.2rc2-4
conflicts
 with file from package mvapich2_gcc-1.2rc2-4
file /etc/mpicc.conf from install of mvapich2_pgi-1.2rc2-4
conflicts wit
h file from package mvapich2_gcc-1.2rc2-4
file /etc/mpicxx.conf from install of mvapich2_pgi-1.2rc2-4
conflicts wi
th file from package mvapich2_gcc-1.2rc2-4
file /etc/mpif77.conf from install of mvapich2_pgi-1.2rc2-4
conflicts wi
th file from package mvapich2_gcc-1.2rc2-4
file /etc/mpif90.conf from install of mvapich2_pgi-1.2rc2-4
conflicts wi
th file from package mvapich2_gcc-1.2rc2-4

Scott Weitzenkamp
SQA and Release Manager
Server Access Virtualization Business Unit
Cisco Systems


 

> -Original Message-
> From: [EMAIL PROTECTED] 
> [mailto:[EMAIL PROTECTED] On Behalf Of 
> Tziporet Koren
> Sent: Tuesday, September 09, 2008 8:20 AM
> To: ewg@lists.openfabrics.org
> Cc: [EMAIL PROTECTED]
> Subject: [ofa-general] OFED 1.4-RC1 is available
> 
> Hi,
> OFED 1.4-RC1 release is available on
> http://www.openfabrics.org/downloads/OFED/ofed-1.4/OFED-1.4-rc1.tgz
> 
> To get BUILD_ID run ofed_info
> 
> Please report any issues in bugzilla https://bugs.openfabrics.org/ for
> OFED 1.4
> 
> Tziporet & Vladimir
> 
> ==
> ==
> 
> Release information:
> 
> Linux Operating Systems:
>- RedHat EL4 up4:   2.6.9-42.ELsmp  *
>- RedHat EL4 up5:   2.6.9-55.ELsmp
>- RedHat EL4 up6:   2.6.9-67.ELsmp
>- RedHat EL4 up7:   2.6.9-78.ELsmp
>- RedHat EL5:   2.6.18-8.el5
>- RedHat EL5 up1:   2.6.18-53.el5
>- RedHat EL5 up2:   2.6.18-92.el5
>- CentOS 5.2:   2.6.18-92.el5
>- Fedora C9:2.6.25-14.fc9   *
>- SLES10:   2.6.16.21-0.8-smp
>- SLES10 SP1:   2.6.16.46-0.12-smp
>- SLES10 SP1 up1:   2.6.16.53-0.16-smp
>- SLES10 SP2:   2.6.16.60-0.21-smp
>- OpenSuSE 10.3:2.6.22.5-31 *
>- kernel.org:   2.6.26 and 2.6.27-rc5
> 
>  * Minimal QA for these versions
> 
> Systems:
>* x86_64
>* x86
>* ia64
>* ppc64
> 
> 
> Main Changes from OFED 1.4-beta
> ===
> o Kernel code based on 2.6.27-rc5
> o Added NFS-RDMA support for SLES10 SP2 and kernel 2.6.26 and 27
> o iSER

[ewg] RE: Add ofed 1.4 to bugzilla

[Scott Weitzenkamp (sweitzen)]

Done.
 




From: Ronni Zimmermann [mailto:[EMAIL PROTECTED] 
Sent: Wednesday, July 16, 2008 4:45 AM
To: Scott Weitzenkamp (sweitzen)
Cc: [EMAIL PROTECTED]
Subject: Add ofed 1.4 to bugzilla


Scott,
can you pleas add 1.4 to the version list in Bugzilla?
 
Thanks,
Ronni.
 
Ronni Zimmermann
SW Verification Group
Mellanox Technologies Ltd.

___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: Please change SDP owner from Jim to Amir in bugzilla

[Scott Weitzenkamp (sweitzen)]

> -Original Message-
> From: Tziporet Koren [mailto:[EMAIL PROTECTED] 
> Sent: Thursday, July 03, 2008 2:26 AM
> To: Scott Weitzenkamp (sweitzen)
> Cc: [EMAIL PROTECTED]; EWG; [EMAIL PROTECTED]
> Subject: Re: Please change SDP owner from Jim to Amir in bugzilla
> 
> Scott Weitzenkamp (sweitzen) wrote:
> > I can't make you an administor, I don't have those privs.
> >   
> 
> Thanks
> Do you know who can make me an administrator
> 
> Tziporet

No.  I believe it was [EMAIL PROTECTED] that did it for me.

Scott
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: Please change SDP owner from Jim to Amir in bugzilla

[Scott Weitzenkamp (sweitzen)]

I changed ownership for new SDP bugs, I'll let you change ownership on
existing bugs if you wish.

I can't make you an administor, I don't have those privs.

Scott Weitzenkamp
SQA and Release Manager
Data Center Access Engineering
Cisco Systems


 

> -Original Message-
> From: Tziporet Koren [mailto:[EMAIL PROTECTED] 
> Sent: Monday, June 30, 2008 11:24 PM
> To: Scott Weitzenkamp (sweitzen)
> Cc: EWG; [EMAIL PROTECTED]
> Subject: Please change SDP owner from Jim to Amir in bugzilla
> 
> Hi Scott,
> Can you change SDP owner to Amir Vadai ([EMAIL PROTECTED] )
> 
> BTW - can I become an administrator in bugzilla so I can do 
> such things 
> myself?
> 
> Thanks
> Tziporet
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: Can you add version 1.3.1 for OFED bugzilla

[Scott Weitzenkamp (sweitzen)]

Done

Scott Weitzenkamp
SQA and Release Manager
Data Center Access Engineering
Cisco Systems


 

> -Original Message-
> From: Tziporet Koren [mailto:[EMAIL PROTECTED] 
> Sent: Sunday, May 18, 2008 8:38 AM
> To: Scott Weitzenkamp (sweitzen)
> Cc: EWG
> Subject: Can you add version 1.3.1 for OFED bugzilla
> 
> 
> thanks
> Tziporet
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] Need to change iSER module owner in Bugzilla

[Scott Weitzenkamp (sweitzen)]

Done.

Scott Weitzenkamp
SQA and Release Manager
Data Center Access Engineering
Cisco Systems


 

> -Original Message-
> From: Tziporet Koren [mailto:[EMAIL PROTECTED] 
> Sent: Monday, May 12, 2008 4:08 AM
> To: Erez Zilber
> Cc: Doron Shoham; ewg@lists.openfabrics.org; Scott 
> Weitzenkamp (sweitzen)
> Subject: Re: [ewg] Need to change iSER module owner in Bugzilla
> 
> Erez Zilber wrote:
> > Tziporet,
> >
> >
> > The new owner of the iSER module in Bugzilla is Doron 
> Shoham. Who should
> > make this change in Bugzilla's definitions?
> >
> >
> >   
> Usually Scott was doing this
> Scott - can you do this change?
> 
> Thanks
> Tziporet
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] RE: [ofa-general] how do I use uDAPL with iWARP?

[Scott Weitzenkamp (sweitzen)]

Steve,

Thanks, that gets further, but dtest still fails.

Client side:

[EMAIL PROTECTED] ~]$ DAPL_MAX_INLINE=64 dtest -h 192.168.0.198
13926 Running as client - OpenIB-cma
13926 Server Name: 192.168.0.198
13926 Server Net Address: 192.168.0.198
13926 Waiting for connect response
13926 Error unexpected conn event : DAT_CONNECTION_EVENT_UNREACHABLE
13926 Error connect_ep: DAT_ABORT

13926: DAPL Test Complete.

13926: Message RTT: Total=  0.00 usec, 10 bursts, itime=  0.00
usec, pc=
0
13926: RDMA write:  Total=  0.00 usec, 10 bursts, itime=  0.00
usec, pc=
0
13926: RDMA read:   Total=  0.00 usec,   4 bursts, itime=  0.00
usec, pc
=0
13926: RDMA read:   Total=  0.00 usec,   4 bursts, itime=  0.00
usec, pc
=0
13926: RDMA read:   Total=  0.00 usec,   4 bursts, itime=  0.00
usec, pc
=0
13926: RDMA read:   Total=  0.00 usec,   4 bursts, itime=  0.00
usec, pc
=0
13926: open:36619.19 usec
13926: close:   32500.98 usec
13926: PZ create:   7.87 usec
13926: PZ free: 4.05 usec
13926: LMR create: 58.89 usec
13926: LMR free:   11.92 usec
13926: EVD create:  9.78 usec
13926: EVD free:   14.07 usec
13926: EP create:  78.92 usec
13926: EP free:26.23 usec
13926: TOTAL: 199.79 usec

Server side:

[EMAIL PROTECTED] ~]$ DAPL_MAX_INLINE=64 dtest
11461 Running as server - OpenIB-cma
11461 Server waiting for connect request..
11461 Waiting for connect response

11461 CONNECTED!

11461 Send RMR to remote: snd_msg:
r_key_ctx=bff,pad=0,va=146db580,len=0x40
11461 Waiting for remote to send RMR data
11461 Error waiting on h_dto_rcv_evd: DAT_TIMEOUT_EXPIRED
11461 Error connect_ep: DAT_TIMEOUT_EXPIRED

11461: DAPL Test Complete.

11461: Message RTT: Total=  0.00 usec, 10 bursts, itime=  0.00
usec, pc=
0
11461: RDMA write:  Total=  0.00 usec, 10 bursts, itime=  0.00
usec, pc=
0
11461: RDMA read:   Total=  0.00 usec,   4 bursts, itime=  0.00
usec, pc
=0
11461: RDMA read:   Total=  0.00 usec,   4 bursts, itime=  0.00
usec, pc
=0
11461: RDMA read:   Total=  0.00 usec,   4 bursts, itime=  0.00
usec, pc
=0
11461: RDMA read:   Total=  0.00 usec,   4 bursts, itime=  0.00
usec, pc
=0
11461: open:   900676.01 usec
11461: close:   31543.97 usec
11461: PZ create:   7.87 usec
11461: PZ free: 5.01 usec
11461: LMR create: 51.98 usec
11461: LMR free:   12.16 usec
11461: EVD create: 10.97 usec
11461: EVD free:   12.87 usec
11461: EP create:  77.01 usec
11461: EP free:30.04 usec
11461: TOTAL: 195.03 usec

Scott

 

> -Original Message-
> From: Steve Wise [mailto:[EMAIL PROTECTED] 
> Sent: Thursday, April 03, 2008 9:19 AM
> To: Scott Weitzenkamp (sweitzen)
> Cc: Joshua Bernstein; OpenFabrics EWG; [ofa_general]
> Subject: Re: [ewg] RE: [ofa-general] how do I use uDAPL with iWARP?
> 
> 
> 
> Scott Weitzenkamp (sweitzen) wrote:
> > I tried that, and it didn't work:
> > 
> > [EMAIL PROTECTED] ~]# grep eth /etc/dat.conf
> > OpenIB-cma u1.2 nonthreadsafe default libdaplcma.so.1 
> dapl.1.2 "eth2 0"
> > ""
> > [EMAIL PROTECTED] ~]# dtest
> > 10194 Running as server - OpenIB-cma
> > 10194 Error dat_ep_create: DAT_INVALID_HANDLE
> > 10194 Error freeing EP: DAT_INVALID_HANDLE DAT_INVALID_HANDLE_EP
> > 
> 
> try setting DAPL_MAX_INLINE=64
> 
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] how do I use uDAPL with iWARP?

[Scott Weitzenkamp (sweitzen)]

> > I tried that, and it didn't work:
> >
> > [EMAIL PROTECTED] ~]# grep eth /etc/dat.conf
> > OpenIB-cma u1.2 nonthreadsafe default libdaplcma.so.1 dapl.1.2  
> > "eth2 0"
> > ""
> > [EMAIL PROTECTED] ~]# dtest
> > 10194 Running as server - OpenIB-cma
> > 10194 Error dat_ep_create: DAT_INVALID_HANDLE
> > 10194 Error freeing EP: DAT_INVALID_HANDLE DAT_INVALID_HANDLE_EP
> 
> Ah, it is using the correct device then. Do you have the rdma_ucm  
> modules loaded?

Yes, I do:

[EMAIL PROTECTED] ~]# lsmod | grep cm
rdma_ucm   47232  0
ib_uverbs  75568  1 rdma_ucm
rdma_cm67348  2 rdma_ucm,ib_sdp
ib_cm  67496  2 ib_ipoib,rdma_cm
iw_cm  43656  1 rdma_cm
ib_sa  74632  3 ib_ipoib,rdma_cm,ib_cm
ib_mad 70948  5 ib_umad,mlx4_ib,ib_mthca,ib_cm,ib_sa
ib_core97664  13
rdma_ucm,ib_sdp,ib_ipoib,ib_uverbs,ib_umad,iw_c
xgb3,mlx4_ib,ib_mthca,rdma_cm,ib_cm,iw_cm,ib_sa,ib_mad
ib_addr41992  1 rdma_cm
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] how do I use uDAPL with iWARP?

[Scott Weitzenkamp (sweitzen)]

I tried that, and it didn't work:

[EMAIL PROTECTED] ~]# grep eth /etc/dat.conf
OpenIB-cma u1.2 nonthreadsafe default libdaplcma.so.1 dapl.1.2 "eth2 0"
""
[EMAIL PROTECTED] ~]# dtest
10194 Running as server - OpenIB-cma
10194 Error dat_ep_create: DAT_INVALID_HANDLE
10194 Error freeing EP: DAT_INVALID_HANDLE DAT_INVALID_HANDLE_EP

10194: DAPL Test Complete.

10194: Message RTT: Total=  0.00 usec, 10 bursts, itime=  0.00
usec, pc=
0
10194: RDMA write:  Total=  0.00 usec, 10 bursts, itime=  0.00
usec, pc=
0
10194: RDMA read:   Total=  0.00 usec,   4 bursts, itime=  0.00
usec, pc
=0
10194: RDMA read:   Total=  0.00 usec,   4 bursts, itime=  0.00
usec, pc
=0
10194: RDMA read:   Total=  0.00 usec,   4 bursts, itime=  0.00
usec, pc
=0
10194: RDMA read:   Total=  0.00 usec,   4 bursts, itime=  0.00
usec, pc
=0
10194: open:32254.93 usec
10194: close:   31936.17 usec
10194: PZ create:   7.15 usec
10194: PZ free: 4.05 usec
10194: LMR create: 36.00 usec
10194: LMR free:   22.89 usec
10194: EVD create:  6.91 usec
10194: EVD free:   11.92 usec
10194: EP create:  28.85 usec
10194: EP free: 0.00 usec
10194: TOTAL: 106.57 usec

Scott Weitzenkamp
SQA and Release Manager
Data Center Access Engineering
Cisco Systems


 

> -Original Message-
> From: Joshua Bernstein [mailto:[EMAIL PROTECTED] 
> Sent: Wednesday, April 02, 2008 4:05 PM
> To: Scott Weitzenkamp (sweitzen)
> Cc: [ofa_general]; OpenFabrics EWG
> Subject: Re: [ofa-general] how do I use uDAPL with iWARP?
> 
> Scott,
> 
> On Apr 2, 2008, at 4:00 PM, Scott Weitzenkamp (sweitzen) wrote:
> > I have OFED 1.3 and a Chelsio S310E-SR+ iWARP 10GE NIC.  I have  
> > ib_rdma_lat working, so I know IB verbs are working.
> >
> > How do I use uDAPL, though?  All the default /etc/dat.conf entries  
> > have IPoIB or bonding interfaces in them.
> 
> What you will want to do is edit /etc/ofed/dat64.conf or other  
> related dat.conf file and change the name of the device from 
> "ib0" to  
> the name of the interface that the Chelsio card came up as. So for  
> example with my NetXen cards coming up at eth2, so for example the  
> first two lines of my /etc/ofed/dat64.conf file look like this:
> 
> OpenIB-cma u1.2 nonthreadsafe default /usr/lib64/libdaplcma.so dapl. 
> 1.2 "eth2 0" ""
> #OpenIB-cma u1.2 nonthreadsafe default /usr/lib64/libdaplcma.so dapl. 
> 1.2 "ib0 0" ""
> 
> Notice how I've commented out the ib0 line and simply changed 
> that to  
> be eth2. Then you can use say HP-MPI for example using the -UDAPL  
> option. Other MPI stacks have similar methods of telling them to use  
> the UDAPL transport.
> 
> -Joshua Bernstein
> Software Engineer
> Penguin Computing
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] how do I use uDAPL with iWARP?

[Scott Weitzenkamp (sweitzen)]

I have OFED 1.3 and a Chelsio S310E-SR+ iWARP 10GE NIC.  I have
ib_rdma_lat working, so I know IB verbs are working.
 
How do I use uDAPL, though?  All the default /etc/dat.conf entries have
IPoIB or bonding interfaces in them.
 
Scott Weitzenkamp
SQA and Release Manager
Data Center Access Engineering
Cisco Systems


 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] ib-bonding release 23

[Scott Weitzenkamp (sweitzen)]

Can you elaborate on "improve failover mechanism", will it improve the
problems I see in https://bugs.openfabrics.org/show_bug.cgi?id=541?
 
Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems


 




From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Moni Shoua
Sent: Thursday, February 28, 2008 5:36 AM
To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED]
Subject: [ewg] ib-bonding release 23



 

Hi,

I have put a new release of the ib-bonding RPM (file latest.txt
is up-to-date)


Release content
1) Bug fix with bonding interface and multicast traffic
2) Improve failover mechanism.


thanks

   MoniS

___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] OFED 1.3 RC5 release is available

[Scott Weitzenkamp (sweitzen)]

I created version 1.3rc5 in the OF bugzilla.

Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems


 

> -Original Message-
> From: [EMAIL PROTECTED] 
> [mailto:[EMAIL PROTECTED] On Behalf Of Tziporet Koren
> Sent: Thursday, February 21, 2008 6:37 AM
> To: ewg@lists.openfabrics.org
> Subject: [ewg] OFED 1.3 RC5 release is available
> 
> Hi, 
> OFED 1.3 RC5 release is available on
> http://www.openfabrics.org/downloads/OFED/ofed-1.3/OFED-1.3-rc5.tgz
> 
> To get BUILD_ID run ofed_info 
> 
> Please report any issues in bugzilla https://bugs.openfabrics.org/ 
> 
> The GA release is expected on February 27
> 
> Tziporet & Vlad 
> 
> ==
> ==
> 
> Release information: 
>  
> Linux Operating Systems:
> - RedHat EL4 up4:   2.6.9-42.ELsmp
> - RedHat EL4 up5:   2.6.9-55.ELsmp
> - RedHat EL4 up6:   2.6.9-67.ELsmp  *
> - RedHat EL5:   2.6.18-8.el5
> - RedHat EL5 up1:   2.6.18-53.el5
> - Fedora C6:2.6.18-8.fc6*
> - SLES10:   2.6.16.21-0.8-smp
> - SLES10 SP1:   2.6.16.46-0.12-smp
> - SLES10 SP1 up1:   2.6.16.53-0.16-smp
> - OpenSuSE 10.3:2.6.22-*-*  *
> - kernel.org:   2.6.23 and 2.6.24
> 
>   * OSes that are partially tested
> 
> Systems: 
>   * x86_64 
>   * x86 
>   * ia64 
>   * ppc64 
> 
> Main Changes from OFED 1.3-RC4
> === 
> * Fixed 44 Bugs (see attachment)
> * MPI packages update: 
>   * mvapich-1.0.0-2090
>   * mvapich2-1.0.2-2
> * Updated libraries:
>   * libibverbs 1.1.1-0.11
>   * uDAPL 1.2.5 and 2.0.7
>   * librdmacm 1.0.6
> 
> Note: In the attached tgz file you can find git-diff of all changes.
> 
> Tasks that should be completed for the gold package: 
> 
> 1. Fix blocker bugs (if any) 
> 2. Update all documents
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [Fwd: Re: [ofa-general] IPOIB/CM increase retry counts]

[Scott Weitzenkamp (sweitzen)]

I don't think I've ever seen problems running IPoIB between mlx4 and
mthca.

Scott

 

> -Original Message-
> From: Or Gerlitz [mailto:[EMAIL PROTECTED] 
> Sent: Tuesday, February 12, 2008 11:08 PM
> To: Scott Weitzenkamp (sweitzen); Betsy Zeller
> Cc: OpenFabrics EWG; Shirley Ma
> Subject: [Fwd: Re: [ofa-general] IPOIB/CM increase retry counts]
> 
> Did anyone at Cisco, Qlogic, Mellanox, Voltaire noticed the phenomena 
> reported by Shirley on their testing?
> 
> Or.
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] is OF bugzilla down?

[Scott Weitzenkamp (sweitzen)]

It's back up now.
 




From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Scott
Weitzenkamp (sweitzen)
Sent: Monday, January 28, 2008 10:57 AM
To: ewg@lists.openfabrics.org; [EMAIL PROTECTED]
Subject: [ofa-general] is OF bugzilla down?


I can't seem to get to it
 
Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems


 

___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] is OF bugzilla down?

[Scott Weitzenkamp (sweitzen)]

I can't seem to get to it
 
Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems


 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ofa-general] RE: [ewg] Not seeing any SDP performance changes inOFED 1.3 beta, and I get Oops when enabling sdp_zcopy_thresh

[Scott Weitzenkamp (sweitzen)]

I've tested on RHEL4 and RHEL5, and see no sdp_zcopy_thresh improvement
for any message size, as measured with netperf, for any Arbel or
ConnectX HCA.

Scott

 
> -Original Message-
> From: Jim Mott [mailto:[EMAIL PROTECTED] 
> Sent: Thursday, January 24, 2008 7:57 AM
> To: Weikuan Yu; Scott Weitzenkamp (sweitzen)
> Cc: ewg@lists.openfabrics.org; [EMAIL PROTECTED]
> Subject: RE: [ofa-general] RE: [ewg] Not seeing any SDP 
> performance changes inOFED 1.3 beta, and I get Oops when 
> enabling sdp_zcopy_thresh
> 
> Hi,
>   64K is borderline for seeing bzcopy effect.  Using an AMD 
> 6000+ (3 Ghz
> dual core) in Asus M2A-VM motherboard with ConnectX running 
> 2.3 firmware
> and OFED 1.3-rc3 stack running on 2.6.23.8 kernel.org kernel, 
> I ran the
> test for 128K:
>   5546  sdp_zcopy_thresh=0 (off)
>   8709  sdp_zcopy_thresh=65536
> 
> For these tests, I just have LD_PRELOAD set in my environment.
> 
> ===
> 
> I see that TCP_MAXSEG is not being handled by libsdp and will 
> look into
> it.
> 
> 
> [EMAIL PROTECTED] ~]# modprobe ib_sdp
> [EMAIL PROTECTED] ~]# netperf -v2 -4 -H 193.168.10.198 -l 30 -t TCP_STREAM -c
> -C -- -m 128K
> TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 
> 193.168.10.198
> (193.168.10.198) port 0 AF_INET
> netperf: get_tcp_info: getsockopt TCP_MAXSEG: errno 92
> Recv   SendSend  Utilization   Service
> Demand
> Socket Socket  Message  Elapsed  Send Recv Send
> Recv
> Size   SizeSize Time Throughput  localremote   local
> remote
> bytes  bytes   bytessecs.10^6bits/s  % S  % S  us/KB
> us/KB
> 
>  87380  16384 13107230.01  5545.69   51.4714.431.521
> 1.706  
> 
> Alignment  Offset BytesBytes   Sends   Bytes
> Recvs
> Local  Remote  Local  Remote  Xfered   Per Per
> Send   RecvSend   Recv Send (avg)  Recv (avg)
> 8   8  0   0 2.08e+10  131072.00158690   33135.60
> 627718
> 
> Maximum
> Segment
> Size (bytes)
> -1
> [EMAIL PROTECTED] ~]# echo 65536
> >/sys/module/ib_sdp/parameters/sdp_zcopy_thresh 
> [EMAIL PROTECTED] ~]# netperf -v2 -4 -H 193.168.10.198 -l 30 -t TCP_STREAM -c
> -C -- -m 128K
> TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 
> 193.168.10.198
> (193.168.10.198) port 0 AF_INET
> netperf: get_tcp_info: getsockopt TCP_MAXSEG: errno 92
> Recv   SendSend  Utilization   Service
> Demand
> Socket Socket  Message  Elapsed  Send Recv Send
> Recv
> Size   SizeSize Time Throughput  localremote   local
> remote
> bytes  bytes   bytessecs.10^6bits/s  % S  % S  us/KB
> us/KB
> 
>  87380  16384 13107230.01  8708.58   50.6314.550.953
> 1.095  
> 
> Alignment  Offset BytesBytes   Sends   Bytes
> Recvs
> Local  Remote  Local  Remote  Xfered   Per Per
> Send   RecvSend   Recv Send (avg)  Recv (avg)
> 8   8  0   0 3.267e+10  131072.00249228   26348.30
> 1239807
> 
> Maximum
> Segment
> Size (bytes)
> -1
> 
> Thanks,
> JIm
> 
> Jim Mott
> Mellanox Technologies Ltd.
> mail: [EMAIL PROTECTED]
> Phone: 512-294-5481
> 
> 
> -Original Message-
> From: Weikuan Yu [mailto:[EMAIL PROTECTED] 
> Sent: Thursday, January 24, 2008 9:09 AM
> To: Scott Weitzenkamp (sweitzen)
> Cc: Jim Mott; ewg@lists.openfabrics.org; [EMAIL PROTECTED]
> Subject: Re: [ofa-general] RE: [ewg] Not seeing any SDP performance
> changes inOFED 1.3 beta, and I get Oops when enabling sdp_zcopy_thresh
> 
> Hi, Scott,
> 
> I have been running SDP tests across two woodcrest nodes with 4x DDR 
> cards using OFED-1.2.5.4. The card/firmware info is below.
> 
> CA 'mthca0'
>  CA type: MT25208
>  Number of ports: 2
>  Firmware version: 5.1.400
>  Hardware version: a0
>  Node GUID: 0x0002c90200228e0c
>  System image GUID: 0x0002c90200228e0f
> 
> I could not get a bandwidth more than 5Gbps like you have shown here. 
> Wonder if I need to upgrade to the latest software or firmware? Any 
> suggestions?
> 
> Thanks,
> --Weikuan
> 
> 
> TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 
> 192.168.225.77 
> (192.168
> .225.77) port 0 AF_INET
> Recv   SendSend  Utilization  
>  Service 
> Demand
> Socket Socket  Message  Elapsed  Send Recv Send
> Recv
> Size   SizeSize Time Throughput  

RE: [ewg] Re: Can you send explanation how to work with bonding and the standard bonding setting

[Scott Weitzenkamp (sweitzen)]

[EMAIL PROTECTED] ~]# ofed_info | grep OFED
OFED-1.3-20080116-0600
[EMAIL PROTECTED] ~]# ib-bond --version
ib-bonding-0.9.0-21
[EMAIL PROTECTED] ~]# rpm -qli ib-bonding
Name: ib-bonding   Relocations: (not
relocatable)
Version : 0.9.0 Vendor: Voltaire Inc.
Release : 2.6.9_55.ELsmpBuild Date: Wed 16 Jan 2008
10:09:02
 AM PST
Install Date: Wed 16 Jan 2008 01:51:43 PM PST  Build Host:
svbu-qa1850-1.cis
co.com
Group   : Applications/System   Source RPM:
ib-bonding-0.9.0-2.6.9_5
5.ELsmp.src.rpm
Size: 144278   License: GPL
Signature   : (none)
Summary : ib_bonding patch and modules.
Description :
This package provides a bonding device which is capable of enslaving
IP over InfiniBand (IPoIB) network devices.
/lib/modules/2.6.9-55.ELsmp/updates/kernel/drivers/net/bonding/bonding.k
o
/usr/bin/ib-bond
/usr/share/doc/ib-bonding-0.9.0/ib-bonding.txt

 

> -Original Message-
> From: Moni Shoua [mailto:[EMAIL PROTECTED] 
> Sent: Thursday, January 17, 2008 6:44 AM
> To: Scott Weitzenkamp (sweitzen)
> Cc: Or Gerlitz; [EMAIL PROTECTED]; Moni Levy; EWG
> Subject: Re: [ewg] Re: Can you send explanation how to work 
> with bonding and the standard bonding setting
> 
> Scott Weitzenkamp (sweitzen) wrote:
> > Or,
> > 
> > I don't see /sbin/call_ifenslave in my 
> OFED-1.3-20080115-0600 ib-bonding
> > package.
> > 
> Also, please run ib-bond --version. /sbin/call_ifenslave 
> should be there only from release 16 and higher.
> 
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] Re: Can you send explanation how to work with bonding and the standard bonding setting

[Scott Weitzenkamp (sweitzen)]

Or,

I don't see /sbin/call_ifenslave in my OFED-1.3-20080115-0600 ib-bonding
package.

[EMAIL PROTECTED] ~]# uname -a
Linux svbu-qa1850-1 2.6.9-55.ELsmp #1 SMP Fri Apr 20 16:36:54 EDT 2007
x86_64 x8
6_64 x86_64 GNU/Linux
[EMAIL PROTECTED] ~]# rpm -ql ib-bonding
/lib/modules/2.6.9-55.ELsmp/updates/kernel/drivers/net/bonding/bonding.k
o
/usr/bin/ib-bond
/usr/share/doc/ib-bonding-0.9.0/ib-bonding.txt

Scott

 

> -Original Message-
> From: [EMAIL PROTECTED] 
> [mailto:[EMAIL PROTECTED] On Behalf Of Or Gerlitz
> Sent: Wednesday, January 16, 2008 2:32 AM
> To: [EMAIL PROTECTED]
> Cc: Moni Levy; EWG
> Subject: [ewg] Re: Can you send explanation how to work with 
> bonding and the standard bonding setting
> 
> Tziporet Koren wrote:
> > We wish to test in this way and also add this explanation  
> to OFED docs
> 
> sure, its all documented in the ib-bonding.txt file that 
> comes with the 
> ib-bonding package, so I suggest just to add a note in the 
> docs pointing 
> to it.
> 
> Or.
> 
> > # rpm -ql ib-bonding
> > /etc/sysconfig/network-scripts/ifup-pre-ibbond
> > 
> /lib/modules/2.6.9-55.ELsmp/updates/kernel/drivers/net/bonding
> /bonding.ko
> > /sbin/call_ifenslave
> > /usr/bin/ib-bond
> > /usr/share/doc/ib-bonding-0.9.0/ib-bonding.txt
> > /usr/share/doc/ib-bonding-0.9.0/redhat4-initscripts.patch
> > /usr/share/doc/ib-bonding-0.9.0/series
> > 
> 
> 
> ___
> ewg mailing list
> ewg@lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] OFED 1.3 RC2 release is available

[Scott Weitzenkamp (sweitzen)]

Isn't RHEL4 up6 supported, too?

I have added Version 1.3rc2 to bugzilla.

Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems


 

> -Original Message-
> From: [EMAIL PROTECTED] 
> [mailto:[EMAIL PROTECTED] On Behalf Of 
> Tziporet Koren
> Sent: Wednesday, January 16, 2008 8:23 AM
> To: ewg@lists.openfabrics.org
> Cc: [EMAIL PROTECTED]
> Subject: [ofa-general] OFED 1.3 RC2 release is available
> 
> 
> Hi, 
> OFED 1.3 RC2 release is available on 
> http://www.openfabrics.org/builds/ofed-1.3/release/OFED-1.3-rc2.tgz
> 
> To get BUILD_ID run ofed_info 
> 
> Please report any issues in bugzilla https://bugs.openfabrics.org/ 
> The RC3 release is expected on January 30
> 
> Tziporet & Vlad 
> 
> 
> 
> ==
> ==
> 
> Release information: 
>  
> OS support: 
>   Novell: 
>   - SLES10 
>   - SLES10 SP1 and up1 
>   Redhat: 
>   - Redhat EL4 up4 and up5
>   - Redhat EL5 and up1 
>   kernel.org: 
>   - 2.6.23 and 2.6.24-rc5
> 
> Compilation only checks:
>   - Fedora Core 6
>   - openSuSE 10.3
>   - Redhat EL4 up6
>  
> Systems: 
>   * x86_64 
>   * x86 
>   * ia64 
>   * ppc64 
> 
> Main Changes from OFED 1.3-RC1
> === 
> * Fixed 21 Bugs (see attachment)
> * Added support for RHEL4.6 and openSuSE10.3 
> * Install: Added vendor's pre/post install scripts support
> * MPI packages update: 
>   *   openmpi-1.2.5-1
>   *   mvapich-1.0.0-1844
>   *   mvapich2-1.0.1-2
>   *   Added support for Qlogic new HCA: 
> 
> Specific module changes:
> 
> ULPs:
> -
> SDP:
> * Executing netperf with TCP_CORK enabled never ends
> * poll() always returns POLLOUT on non-blocking socket
> * SDP connect() only allows AF_INET (2), not AF_INET_SDP (27)
> iSER: 
> * Separate open-iscsi and iSER patches for different distros
> IPoIB:
> * Fix IPOIB LSO support: turn on the QP_CREATE_LSO flag to let the
> hw layer know and take proper actions
> 
> Libraries:
> --
> libibverbs: 
> * Preserve backwards binary compatibility.
> librdmacm:
> * Release 1.0.5
> 
> Utilities:
> --
> Opensm: 
> * Fixing core dump in fat-tree routing
> * Use valid pkey index value for gsi mads
> * osm_sa_slvl_record: fix overflow crash
> * Fixing a seg. fault in processing mcast groups
> * mcast mgr improvements
> * QoS policy - increased stability
> mstflint: 
> * Convert project to autoconf tools
> Performance tests: 
> * Fix bug rdma_lat.c. Messages up to 400 bytes will be sent Inline
> * Added multicast support to ib_send_bw and ib_send_lat tests
> Diagnostic tools:
> * Enhanced saquery to support: 
>   VLArb and PKey Table Records
>   Ports with LinkRecord query
>   SL2VLTableRecord attribute
>   Attribute names support
> * checkerrors: fix port errors count and query only single ports
> in CAs
> ibutils:
> * vsGetGeneralInfo function now dumps the correct data
> * Fixed stack-smashing bug in ibis gid typemaps, which could cause
> crashes on ppc64
> 
> Low level drivers:
> --
> mlx4: 
> * max_recv_wr must be > 0 for non-SRQ QPs. 
> * Fix the value of the pkey_index in the completion to get a valid
> value for GSI QPs.
> * Do not use memcpy when copying to the BlueFlame buffer
> * Fix pkey_index processing in cq polling
> mthca: 
> * Ensure an Rx WQE is in memory before linking
> cxgb: 
> * library release 1.1.2
> ipath:
> * Added support for the new HCA iba7220
> Nes: 
> * fix virtual WQ mapping and size
> 
> 
> Tasks that should be completed for RC3: 
> == 
> 1. XRC enhanced API 
> 2. Fix bugs 
> 
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ofa-general] RE: [ewg] Not seeing any SDP performance changes inOFED 1.3 beta, and I get Oops when enabling sdp_zcopy_thresh

[Scott Weitzenkamp (sweitzen)]

Jim,

I am trying OFED-1.3-20071231-0600 and RHEL4 x86_64 on a dual CPU
(single core each CPU) Xeon system.  I do not see any performance
improvement (either throughput or CPU utilization) using netperf when I
set /sys/module/ib_sdp/sdp_zcopy_thresh to 16384.  Can you elaborate on
your HCA type, and performance improvement you see?

Here's an example netperf command line when using a Cheetah DDR HCA and
1.2.917 firmware (I have also tried ConnectX and 2.3.000 firmware too):

[EMAIL PROTECTED] ~]$ LD_PRELOAD=libsdp.so netperf241 -v2 -4 -H
192.168.1.201 -l 30 -t TCP_STREAM -c -C --   -m 65536
TCP STREAM TEST from 0.0.0.0 (0.0.0.0) port 0 AF_INET to 192.168.1.201
(192.168.1.201) port 0 AF_INET : histogram : demo

Recv   SendSend  Utilization   Service
Demand
Socket Socket  Message  Elapsed  Send Recv Send
Recv
Size   SizeSize Time Throughput  localremote   local
remote
bytes  bytes   bytessecs.10^6bits/s  % S  % S  us/KB
us/KB

 87380  16384  6553630.01  7267.70   55.0661.271.241
1.381 

Alignment  Offset BytesBytes   Sends   Bytes
Recvs
Local  Remote  Local  Remote  Xfered   Per Per
Send   RecvSend   Recv Send (avg)  Recv (avg)
8   8  0   0 2.726e+10  65536.00415942   48106.01
566648

Maximum
Segment
Size (bytes)
-1


Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems


 

> -Original Message-
> From: Jim Mott [mailto:[EMAIL PROTECTED] 
> Sent: Wednesday, December 12, 2007 6:29 PM
> To: Scott Weitzenkamp (sweitzen)
> Cc: [EMAIL PROTECTED]
> Subject: RE: [ofa-general] RE: [ewg] Not seeing any SDP 
> performance changes inOFED 1.3 beta, and I get Oops when 
> enabling sdp_zcopy_thresh
> 
> I am traveling for the next 2 weeks and not able to test 
> anymore.  That
> said, I believe all outstanding problems are fixed and it is safe to
> re-enable by default.  My testing shows the crossover size 
> where bzcopy
> is always a win at about 16K.  The patch goes in sdp_main.c and looks
> something like:
>   -static int sdp_zcopy_thresh = 0; 
>   +static int sdp_zcopy_thresh = 16384;
> 
> -Original Message-
> From: Scott Weitzenkamp (sweitzen) [mailto:[EMAIL PROTECTED] 
> Sent: Wednesday, December 12, 2007 5:26 PM
> To: Jim Mott; ewg@lists.openfabrics.org
> Cc: [EMAIL PROTECTED]
> Subject: RE: [ofa-general] RE: [ewg] Not seeing any SDP performance
> changes inOFED 1.3 beta, and I get Oops when enabling sdp_zcopy_thresh
> 
> Jim, when do you plan to enably bzcopy by default?
> 
> Scott Weitzenkamp
> SQA and Release Manager
> Server Virtualization Business Unit
> Cisco Systems
> 
> 
>  
> 
> > -Original Message-
> > From: [EMAIL PROTECTED] 
> > [mailto:[EMAIL PROTECTED] On Behalf Of Jim Mott
> > Sent: Friday, November 30, 2007 12:04 PM
> > To: ewg@lists.openfabrics.org
> > Cc: [EMAIL PROTECTED]
> > Subject: [ofa-general] RE: [ewg] Not seeing any SDP 
> > performance changes inOFED 1.3 beta, and I get Oops when 
> > enabling sdp_zcopy_thresh
> > 
> > Hi,
> >   This kernel Oops is new and I will look at it.  Dotan and 
> > the Mellanox regression tests have been keeping me busy 
> > recently.  There
> > was a problem like this, but only in multi-threaded apps 
> > using a single socket or when doing cleanup after ^C.
> > 
> >   I will re-enable default bzcopy behavior once all the 
> > important Mellanox regression tests are passing.  Until then, 
> > setting the
> > sdp_zcopy_threah variable by hand (8192 and up should give 
> > better performance) and running simple tests like netperf should be
> > working fine.  You should not be seeing any problem here.  [I 
> > have only tested locally with x86_64 rhat4u4, rhat5, 2.6.23.8, and
> > 2.6.24-rc2.  Mellanox regression tests everything and they 
> > have not submitted this Oops yet.]
> > 
> >   I have opened bugs in the openfabrics bugzilla for 
> > everything I am currently working on.  It is down right now 
> > or I would add
> > pointers.
> > 
> > 
> > Here is my work list; additions or priority changes welcome:
> > 
> > SDP OPEN ISSUES LIST (Priority order)
> > =
> > 1) DONE: BUG: Unload of mlx4 and ib_sdp fails while SDP active
> >   11/6 [PATCH 1/1 V2] SDP - Fix reference count bug ...
> > 
> > 2) DONE: BUG: Many data corruption failures
> >   11/11 [PATCH 1/1] SDP - Fix bug where zcopy bcopy returns ...
> > 
> > 3) DONE: Bug 793 - kernel BUG at net/core/skbuff.c:95!
> >   11/26 [PATCH 1/1] SDP - bug793;

[ewg] RE: [ofa-general] OFED 1.3-rc1 release is available

[Scott Weitzenkamp (sweitzen)]

I have added version 1.3rc1 to bugzilla, sorry for the delay.
 
Scott
 




From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Tziporet
Koren
Sent: Thursday, December 13, 2007 8:40 AM
To: ewg@lists.openfabrics.org
Cc: [EMAIL PROTECTED]
Subject: [ofa-general] OFED 1.3-rc1 release is available



Hi, 

OFED 1.3 RC1 release is available on 

http://www.openfabrics.org/downloads/OFED/ofed-1.3/OFED-1.3-rc1.tgz
  
To get BUILD_ID run ofed_info 

Please report any issues in bugzilla
https://bugs.openfabrics.org/   

The RC2 release is expected on December 27 

Tziporet & Vlad 





Release information: 
 
OS support: 
Novell: 
- SLES10 
- SLES10 SP1 and up1 
Redhat: 
- Redhat EL4 up4 and up5 
- Redhat EL5 and up1 
kernel.org: 
- 2.6.23 and 2.6.24-rc2 

Systems: 
* x86_64 
* x86 
* ia64 
* ppc64 

Main Changes from OFED 1.3-beta 
=== 

*   Fix SDP stability issues 
*   Force 32bit libraries installation on the SLES10 SP1 U1 
*   Open MPI: Enable compilation when using compilers that
were not installed as RPMs. 
*   RDS: clean up handling of congested destinations vs poll

*   RDS: Fix download issue when removing low level driver
(fix was in CMA) 
*   IPoIB: Fix kernel Oops resulting from xmit following
dev_down. 
*   MPI packages update: 

*   mvapich-1.0.0-1639.src.rpm 
*   openmpi-1.2.5rc1-1.src.rpm 
*   mpitests-3.0-773.src.rpm 


mlx4 specific changes: 

*   Fix segmentation fault in mlx4_clear_xrc_srq. 
*   Fix max_eq's read from FW in QUERY_DEV_CAP. 
*   Post send in the kernel is now using WQE building block.

*   Set default CQ moderation parameters for IPoIB 


ehca specific changes: 

*   Fix error of sense context opts with multiple adapter 
*   Add files for older abi_versions 



Tasks that should be completed for RC2 release: 
=== 
1. IPoIB performance improvements for small messages 
2. Fix bugs 




___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ofa-general] RE: [ewg] Not seeing any SDP performance changes inOFED 1.3 beta, and I get Oops when enabling sdp_zcopy_thresh

[Scott Weitzenkamp (sweitzen)]

Jim, when do you plan to enably bzcopy by default?

Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems


 

> -Original Message-
> From: [EMAIL PROTECTED] 
> [mailto:[EMAIL PROTECTED] On Behalf Of Jim Mott
> Sent: Friday, November 30, 2007 12:04 PM
> To: ewg@lists.openfabrics.org
> Cc: [EMAIL PROTECTED]
> Subject: [ofa-general] RE: [ewg] Not seeing any SDP 
> performance changes inOFED 1.3 beta, and I get Oops when 
> enabling sdp_zcopy_thresh
> 
> Hi,
>   This kernel Oops is new and I will look at it.  Dotan and 
> the Mellanox regression tests have been keeping me busy 
> recently.  There
> was a problem like this, but only in multi-threaded apps 
> using a single socket or when doing cleanup after ^C.
> 
>   I will re-enable default bzcopy behavior once all the 
> important Mellanox regression tests are passing.  Until then, 
> setting the
> sdp_zcopy_threah variable by hand (8192 and up should give 
> better performance) and running simple tests like netperf should be
> working fine.  You should not be seeing any problem here.  [I 
> have only tested locally with x86_64 rhat4u4, rhat5, 2.6.23.8, and
> 2.6.24-rc2.  Mellanox regression tests everything and they 
> have not submitted this Oops yet.]
> 
>   I have opened bugs in the openfabrics bugzilla for 
> everything I am currently working on.  It is down right now 
> or I would add
> pointers.
> 
> 
> Here is my work list; additions or priority changes welcome:
> 
> SDP OPEN ISSUES LIST (Priority order)
> =
> 1) DONE: BUG: Unload of mlx4 and ib_sdp fails while SDP active
>   11/6 [PATCH 1/1 V2] SDP - Fix reference count bug ...
> 
> 2) DONE: BUG: Many data corruption failures
>   11/11 [PATCH 1/1] SDP - Fix bug where zcopy bcopy returns ...
> 
> 3) DONE: Bug 793 - kernel BUG at net/core/skbuff.c:95!
>   11/26 [PATCH 1/1] SDP - bug793; skbuff changes ...
> 
> 4) TODO: BUG: kernel oops in SDP regression 
>   Replicated problem by hitting ^C during a transfer.  I have 
> created a patch that fixes the problem, but it needs more work
> to move into production.  There are some side effects I do not
> yet understand.
>   This is the one I am working on now.  I hope to drop it soon.
> There is a bug open tracking it.
> 
> 5) TODO: BUG: libsdp returns good RC when it should fail
> 
> 6) TODO: BUG: aio_test fails in SDP regression
> 
> 7) TODO: Bug 779 - Lock ordering problem during accept on 1.2.5
>   After building a 2.6.23.8 kernel with lock checking enabled, I
> can not reproduce this problem.  Looks like I'll need more input
> from the reporter.  (Bug updated to say this).  I will continue to
> code review though.
> 
> 8) DONE: Bug 294 - connect does not allow AF_INET_SDP
>   [fix in bugzilla dropped] 
> 
> 9) DONE: Backport work needed to support 2.6.24
> 
> 10) TODO: Package user space libsdp for Redhat
>   This is supposed to be easy to do, but it will take me some time
> to figure out the detail.  
> 
> 11) DONE: BUG: Memory leak
>   11/20 [PATCH 1/1 v2] SDP - Fix a memory leak in bzcopy
> -Original Message-
> From: [EMAIL PROTECTED] 
> [mailto:[EMAIL PROTECTED] On Behalf Of Scott 
> Weitzenkamp (sweitzen)
> Sent: Friday, November 30, 2007 12:37 PM
> To: Jim Mott; Scott Weitzenkamp (sweitzen); ewg@lists.openfabrics.org
> Cc: [EMAIL PROTECTED]
> Subject: [ewg] Not seeing any SDP performance changes in OFED 
> 1.3 beta, and I get Oops when enabling sdp_zcopy_thresh
> 
> Jim,
> 
> Using netperf with TCP_STREAM and TCP_RR, I'm not seeing any 
> changes in
> SDP throughput or CPU utilization comparing OFED 1.3 beta and OFED
> 1.2.5.  Looks like I need to set a non-zero value in
> /sys/module/ib_sdp/sdp_zcopy_thresh?  Do you plan to enable this by
> default soon?
> 
> I tried "echo 4096 > /sys/module/ib_sdp/sdp_zcopy_thresh" on RHEL4 and
> then tried netperf, and got an Oops.
> 
> Unable to handle kernel NULL pointer deref
> erence at  RIP:
> {put_page+0}
> PML4 1a3047067 PGD 1a7a6d067 PMD 0
> Oops:  [1] SMP
> CPU 0
> Modules linked in: parport_pc lp parport autofs4
> i2c_dev i2c_co
> re nfs lockd nfs_acl sunrpc rdma_ucm(U) rds(U) ib_sdp(U) rdma_cm(U)
> iw_cm(U) ib_
> addr(U) mlx4_ib(U) mlx4_core(U) ds yenta_socket pcmcia_core dm_mirror
> dm_multipa
> th dm_mod joydev button battery ac uhci_hcd ehci_hcd shpchp 
> ib_mthca(U)
> ib_ipoib
> (U) ib_umad(U) ib_ucm(U) ib_uverbs(U) ib_cm(U) ib_sa(U) ib_mad(U)
> ib_core(U) md5
>  ipv6 e1000 floppy ata_piix libata sg ext3 jbd mptscsih mptsas mptspi
> mptscsi mp
> tbase sd_mod scsi_mod
> Pid: 6802, comm: netperf241 Not tainted
> 2.6

RE: [ewg] change in diags in OFED 1.3? (2 ports; only1supportedcurrently)

[Scott Weitzenkamp (sweitzen)]

> > Did not see this problem with OFED 1.2 or 1.2.5.
> 
> Are you 100% sure ? Same HCAs and firmware ?

100% sure.
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] change in diags in OFED 1.3? (2 ports; only 1supportedcurrently)

[Scott Weitzenkamp (sweitzen)]

> That's what I was afraid of and asked about on the list a while ago
> (about whether there was such a use case and there is) :-(
> 
> Not sure exactly why this wasn't a problem prior to this change.
> When was the last time you tried this on a subnet which 
> included one or
> more of these HCAs ?

Did not see this problem with OFED 1.2 or 1.2.5.

> So...
> 
> How important is fixing this (for OFED 1.3) ?

It's a regression, so I think it must be fixed.

Scott
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] change in diags in OFED 1.3? (2 ports; only 1 supportedcurrently)

[Scott Weitzenkamp (sweitzen)]

I'll open a bug.

> All two port HCAs ? Are all of them the same 2 port PCIe model or are
> there others ?

All type of 2 port PCIe HCAs (LionCub, LionMini, and Eagle).

> Can you provide:
> 
> smpquery nodedesc
> smpquery nodeinfo
> and most importantly
> perfquery -de
> 
> for a failed node/port ?


[EMAIL PROTECTED] ~]# perfquery -de
ibwarn: [18050] smp_query: attr 0x11 mod 0x0 route DR path 0
ibwarn: [18050] mad_rpc: data offs 64 sz 64
mad data
0101 0102 0005 ad00 0100 d050 0005 ad00
0020 0848 0005 ad00 0020 0849 0040 6282
 00a0 0100 05ad    
       
ibwarn: [18050] smp_query: attr 0x15 mod 0x0 route DR path 0
ibwarn: [18050] mad_rpc: data offs 64 sz 64
mad data
    fe80   
0005 0002 0251 0a68  000f 0103 0302
1452 0011 4040 0008 0804 f240  
 2008 10f0     
ibwarn: [18050] pma_query: lid 5 port 1
ibwarn: [18050] mad_rpc: data offs 64 sz 192
mad data
0101   0014    
       
       
       
       
       
       
       
       
       
       
       
ibwarn: [18050] main: PerfMgt ClassPortInfo 0x0 extended counters not
indicated

ibwarn: [18050] pma_query: lid 5 port 1
ibwarn: [18050] mad_rpc: MAD completed with error status 0xc
perfquery: iberror: [pid 18050] main: failed: perfextquery
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] change in diags in OFED 1.3? (2 ports; only 1 supported currently)

[Scott Weitzenkamp (sweitzen)]

This seems new in OFED 1.3:
 
[EMAIL PROTECTED] ~]# ibcheckerrors
perfquery: iberror: failed: smp query nodeinfo: 2 ports; only 1
supported currently
Error check on lid 8 (svbu-qa-pcie-2 HCA-1) port all: FAILED
perfquery: iberror: failed: perfquery
Error check on lid 8 (svbu-qa-pcie-2 HCA-1) port 1: FAILED
# Checked Ca: nodeguid 0x0005ad200860 with failure
...
 
I see these errors with all two-port HCAs.
Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems


___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] Not seeing any SDP performance changes in OFED 1.3 beta, and I get Oops when enabling sdp_zcopy_thresh

[Scott Weitzenkamp (sweitzen)]

Jim,

Using netperf with TCP_STREAM and TCP_RR, I'm not seeing any changes in
SDP throughput or CPU utilization comparing OFED 1.3 beta and OFED
1.2.5.  Looks like I need to set a non-zero value in
/sys/module/ib_sdp/sdp_zcopy_thresh?  Do you plan to enable this by
default soon?

I tried "echo 4096 > /sys/module/ib_sdp/sdp_zcopy_thresh" on RHEL4 and
then tried netperf, and got an Oops.

Unable to handle kernel NULL pointer deref
erence at  RIP:
{put_page+0}
PML4 1a3047067 PGD 1a7a6d067 PMD 0
Oops:  [1] SMP
CPU 0
Modules linked in: parport_pc lp parport autofs4
i2c_dev i2c_co
re nfs lockd nfs_acl sunrpc rdma_ucm(U) rds(U) ib_sdp(U) rdma_cm(U)
iw_cm(U) ib_
addr(U) mlx4_ib(U) mlx4_core(U) ds yenta_socket pcmcia_core dm_mirror
dm_multipa
th dm_mod joydev button battery ac uhci_hcd ehci_hcd shpchp ib_mthca(U)
ib_ipoib
(U) ib_umad(U) ib_ucm(U) ib_uverbs(U) ib_cm(U) ib_sa(U) ib_mad(U)
ib_core(U) md5
 ipv6 e1000 floppy ata_piix libata sg ext3 jbd mptscsih mptsas mptspi
mptscsi mp
tbase sd_mod scsi_mod
Pid: 6802, comm: netperf241 Not tainted
2.6.9-55.ELlargesmp
RIP: 0010:[]
{put_page+0}
RSP: 0018:0101a7bcbbc0  EFLAGS: 00010203
RAX:  RBX: 0001 RCX:
02
02
RDX: 0101b0b43e80 RSI: 0202 RDI:
00
00
RBP: 0101b85761c0 R08:  R09:
00
00
R10: 0246 R11: a02e0e36 R12:
0101a4b330
80
R13: 0101a7bcbd58 R14:  R15:
000100
00
FS:  002a95696940() GS:80500380()
knlGS:000
0
CS:  0010 DS:  ES:  CR0: 8005003b
CR2:  CR3: 00101000 CR4:
06
e0
Process netperf241 (pid: 6802, threadinfo
0101a7bca000, tas
k 0101a70df030)
Stack: a02e110a 0100
 0
0529780
   00010246 0246
8013feac 0
800ffe0
    0101a7bcbe88
Call Trace:{:ib_sdp:sdp_sendmsg+724}
{queue_delayed_work+101}
   {:ib_addr:queue_req+122}
{sock_sendmsg+271}
   {do_no_page+916}
{au
toremove_wake_function+0}
   {sockfd_lookup+16}
{
sys_sendto+195}
   {do_page_fault+577}

{dnotify_parent+34}
   {vfs_read+248}
{syst
em_call+126}


Code: 8b 07 48 89 fa f6 c4 80 74 3b 48 8b 57 10 8b 02
48 89 d1
f6
RIP {put_page+0} RSP
<0101a7bcbbc0>
CR2: 
 <0>Kernel panic - not syncing: Oops

Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] how to use Intel MPI with dapl2?

[Scott Weitzenkamp (sweitzen)]

> How did you configure your servers to run Intel MPI with v2 
> libraries? 

I only installed the DAPL 2.0 libs.

Scott
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] how to use Intel MPI with dapl2?

[Scott Weitzenkamp (sweitzen)]

I am using Intel MPI 3.1 build 26 with OFED 1.3 beta2 on RHEL4 x86_64.
Intel MPI works as before with dapl1, but I see very slow performance
with dapl2.  Are there extra command-line params I need to use dapl2?
 
For example:
 
$ /data/software/qa/MPI/intel_mpi/intelmpi-3.1-`uname -m`/bin/mpiexec
-genv I_MPI_DEBUG 3 -n 2  osu_latency.x
[1] MPI startup(): DAPL provider  on rank 1:svbu-qa1850-2
[0] MPI startup(): socket data transfer mode
[0] MPI Startup(): process is pinned to CPU00 on node svbu-qa1850-1
[1] MPI startup(): socket data transfer mode
[1] MPI Startup(): process is pinned to CPU00 on node svbu-qa1850-2
[0] RankPid Node name
[0] 0   9605svbu-qa1850-1
[0] 1   8547svbu-qa1850-2
# OSU MPI Latency Test (Version 2.1)
# Size  Latency (us)
0   124.96
1   124.98
2   99.62
4   63.04
8   62.98

 
Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems

 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] OFED 1.3 Beta release is available

[Scott Weitzenkamp (sweitzen)]

I have added version 1.3beta2 to the OF Bugzilla.
 
Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems


 




From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Tziporet
Koren
Sent: Thursday, November 22, 2007 7:46 AM
To: ewg@lists.openfabrics.org
Cc: [EMAIL PROTECTED]
Subject: [ofa-general] OFED 1.3 Beta release is available



Hi, 

OFED 1.3 Beta release is available on 

http://www.openfabrics.org/downloads/OFED/ofed-1.3/OFED-1.3-beta2.tgz


To get BUILD_ID run ofed_info 

Please report any issues in bugzilla
https://bugs.openfabrics.org/   

The RC1 release is expected on December 5 

Tziporet & Vlad 





Release information: 
 
OS support: 
Novell: 
- SLES10 
- SLES10 SP1 and up1 
Redhat: 
- Redhat EL4 up4 and up5 
- Redhat EL5 and up1 
kernel.org: 
- 2.6.23 and 2.6.24-rc2 

Systems: 
* x86_64 
* x86 
* ia64 
* ppc64* 

Main Changes from OFED 1.3-alpha 
 

*   Kernel code based on 2.6.24-rc2 
*   New packages: 

*   SRP target 
*   qperf test from Qlogic 
*   ibsim package 
*   uDAPL 2.0 library (1.0 & 2.0 are coexist) 

*   New OSes Support: 

*   RHEL 5 up1 
*   SLES10 SP1 up1 

*   Compilation issues resolved: 

*   Open MPI compilation on SLES10 SP1 
*   ibutils compiles on SLES10 PPC64 (64 bits) 
*   Apply patches that fix warning of backport
patches 
*   Prefix is now supported properly 

*   RDS implementation for API version 2 was updated form
1.2.5 branch 
*   Fix binary compatibility of libibverbs caused by XRC
implementation 
*   Uninstall is now working properly 
*   ib-bonding update to release 19 
*   MPI packages update: 

*   mvapich-1.0.0-1625.src.rpm 
*   mvapich2-1.0.1-1.src.rpm 
*   openmpi-1.2.4-1.src.rpm 


Mlx4 driver specific changes: 

*   Enable changing the default of HCA resource limits with
module parameters 
*   Default number of maximum QPs is now 128K (was 64K) 
*   Fixing max_cqe's (not adding an extra cqe) 
*   Fix state check in mlx4_qp_modify 
*   Sanity check userspace send queue sizes 
*   Several bug fixes in XRC 



Tasks that should be completed for the beta release: 
 
1. 32-bit libraries to be supported on SLES10 SP1 Update1. 
2. Fix SDP stability issues 
3. IPoIB performance improvements for small messages 
4. Fix bugs 

___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] Compile error in latest daily build

[Scott Weitzenkamp (sweitzen)]

I opened https://bugs.openfabrics.org//show_bug.cgi?id=756 for this
issue earlier today.

Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems
 

> -Original Message-
> From: [EMAIL PROTECTED] 
> [mailto:[EMAIL PROTECTED] On Behalf Of 
> Woodruff, Robert J
> Sent: Wednesday, October 24, 2007 1:09 PM
> To: Tziporet Koren; Vladimir Sokolovsky
> Cc: EWG
> Subject: [ewg] Compile error in latest daily build
> 
> 
> I ran into this compile error in today's daily build,
> not sure who this should be assigned to...
> 
> Running rpm -iv
> /root/OFED-1.3-20071024-0645/RPMS/redhat-release-4AS-5.5/sdpne
> tstat-1.60
> -0.1.ofed20070909.x86_64.rpm
> Build srptools RPM
> ibis_wrap.c: In function `_wrap_sacClassPortInfo_resp_time_val_set':
> ibis_wrap.c:22491: error: structure has no member named 
> `resp_time_val'
> ibis_wrap.c:22491: warning: left-hand operand of comma 
> expression has no
> effect
> ibis_wrap.c: In function `_wrap_sacClassPortInfo_resp_time_val_get':
> ibis_wrap.c:22543: error: structure has no member named 
> `resp_time_val'
> make[3]: *** [ibis_wrap.lo] Error 1
> make[3]: Leaving directory
> `/var/tmp/OFED_topdir/BUILD/ibutils-1.2/ibis/src'
> ___
> ewg mailing list
> ewg@lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: bugzilla ipoib bugs

[Scott Weitzenkamp (sweitzen)]

Done.

Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems
 

> -Original Message-
> From: Eli Cohen [mailto:[EMAIL PROTECTED] 
> Sent: Thursday, October 18, 2007 2:00 AM
> To: Scott Weitzenkamp (sweitzen)
> Subject: bugzilla ipoib bugs
> 
> Hi Scott,
> 
> could you please have me get bugs regarding IPOIB?
> 
> thanks.
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] RE: [ofa-general] OFED 1.3 Alpha release is available

[Scott Weitzenkamp (sweitzen)]

> >> 4. SDP - these are not yet in the alpha release
> >>o Keep-alive
> >>o Asynch IO
> >>o Send Zero Copy
> >> 
> >
> > If it didn't make it into alpha, perhaps it should not go 
> into 1.3, so
> > we can hold the release date better?
> >   
> Since the code is running and tested and Jim just has not succeed to 
> arrange it all in the git on time I think it should be in
> I cc Jim so he can answer in more details on the status.

I don't object to it going in, but new features often take some time to
stabilize (has the new SDP been tested on ppc64, for example?), so any
new major features going in beyond this point have a high probability of
delaying the release.

Scott
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] OFED 1.3 Alpha release is available

[Scott Weitzenkamp (sweitzen)]

> 3. IPoIB
>o Stateless offloads
>o NAPI is enabled default

How does one measure these changes using tools like netperf or iperf?
Do I need a specific HCA type?

> 4. SDP - these are not yet in the alpha release
>o Keep-alive
>o Asynch IO
>o Send Zero Copy

If it didn't make it into alpha, perhaps it should not go into 1.3, so
we can hold the release date better?

What ever happened to NFS RDMA?

Scott 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] OFA_KERNEL_PARAMS is missing from OFED 1.3 install.pl

[Scott Weitzenkamp (sweitzen)]

Vlad, I opened bug 740 for this, can you please fix?
 
Scott
 




From: Scott Weitzenkamp (sweitzen) 
Sent: Sunday, October 14, 2007 11:10 PM
To: Scott Weitzenkamp (sweitzen); OpenFabricsEWG; Vladimir
Sokolovsky
Cc: [EMAIL PROTECTED]
Subject: RE: [ofa-general] OFA_KERNEL_PARAMS is missing from
OFED 1.3 install.pl


I also don't see a way to use K_VER to compile for a kernel
other than the currently booted kernel, like I could in 1.2.5 and
earlier.
 
Scott




From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Scott
Weitzenkamp (sweitzen)
Sent: Sunday, October 14, 2007 10:57 PM
To: OpenFabricsEWG; Vladimir Sokolovsky
Cc: [EMAIL PROTECTED]
Subject: [ofa-general] OFA_KERNEL_PARAMS is missing from
OFED 1.3 install.pl


Vlad, 
 
I don't see a way to configure OFED 1.3 during
installation with OFA_KERNEL_PARAMS like I could in 1.2.5 and earlier.
I am specifically looking for the params --without-modprobe,
--without-ipoibconf, and --with-madeye-mod.
 
Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems
 

___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] OFED 1.3 Alpha release is available

[Scott Weitzenkamp (sweitzen)]

I have added version 1.3alpha2 to bugzilla.

Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems
 

> -Original Message-
> From: [EMAIL PROTECTED] 
> [mailto:[EMAIL PROTECTED] On Behalf Of 
> Tziporet Koren
> Sent: Monday, October 15, 2007 7:31 AM
> To: ewg@lists.openfabrics.org
> Cc: [EMAIL PROTECTED]
> Subject: [ofa-general] OFED 1.3 Alpha release is available
> 
> Hi, 
> 
> OFED 1.3 Alpha release is available on
> http://www.openfabrics.org/builds/ofed-1.3/release/
> File: OFED-1.3-alpha2.tgz 
> To get BUILD_ID run ofed_info 
> 
> Please report any issues in bugzilla https://bugs.openfabrics.org/
> 
> The beta release is expected on 29 October
> 
> Tziporet & Vlad 
> 
> ==
> ==
> 
> Release information: 
> 
> OS support: 
> Novell: 
> - SLES10 
> - SLES10 SP1
> Redhat: 
> - Redhat EL4 up4 and up5 
> - Redhat EL5 
> kernel.org: 
> - 2.6.23 
> 
> Note: Fedora C6 and Open SUSE 10.2 and Redhat EL4 up3 are not part of
> the 
> official list. We keep the backport patches for these OSes 
> and make sure
> 
> OFED compile and loaded properly but will not do full QA cycle.
> 
> Systems: 
> * x86_64 
> * x86 
> * ia64 
> * ppc64*
> 
> *Note: On PPC64 installation fails on the packages: ibutils, 
> mvapich2, 
>MPI tests over Open MPI.
> 
> 
> Main Changes from OFED 1.2.5
> 
> 1. General changes
>o Kernel code based on 2.6.23
>o Quality of Service support in OpenSM, CMA, IPoIB, SRP
>o Added Neteffect driver (nes)
> 
> 2. Package and install
>o There is a new install script. See 
> OFED_Installation_Guide.txt for
>  more details on the new installation and build procedures.
>  Note: There is an easy way to install in one command line 
>without a conf file, and without the interactive mode.
>  Example:  ./install.pl --all --prefix /usr/local 
>o User space packages are now in different source RPMs (as 
> opposed to
>  one source RPM in previous OFED releases).
>o The option for a build without installing is not supported any
> more.
>o Added an option to generate tarball with kernel sources for each
>  kernel.
> 
> 3. IPoIB
>o Stateless offloads
>o IGMP for user-space multicast IB
>o NAPI is enabled default
>o High availability is supported via the bonding module 
> only (removed
>  ipoib tool scripts)
> 
> 4. SDP - these are not yet in the alpha release
>o Keep-alive
>o Asynch IO
>o Send Zero Copy
> 
> 5. iSER
>o ???
> 
> 6. qlgc_vnic
>o Update for PathScale HCA
> 
> 7. RDS
>o RDMA API (using FMRs) - under work
> 
> 8. uDAPL - these are not yet in the alpha release
>o Add DAT 2.0 API run-time library and development support.
>  uDAPL 2.0 will include IB extensions for IB rdma write with
> immediate
>  data and IB atomic operations.
>o Both uDAPL 1.2 and 2.0 packages will be provided and 
> will co-exist
> 
> 9. Libraries
>a. libibverbs 1.1.1
>   o Added Extended RC transport type
>b. librdmacm (uCMA) 1.0.3
> 
> 10. OSM
> o More routing performance improvements
> o Even more speedups
> o Better packaging/installation
> o "Native" daemon mode
> o Performance management
> o Quality of Service manager: Based on IBTA annex
> 
> 11. Management
> o Multiple partitions
> 
> 12. MPI:
> a. OSU MVAPICH
>o Version is 0.9.9 - same as in 1.2.5 - to be replaced later
> b. Open MPI
>o Version is 1.2.2-1 - same as in 1.2.5 - to be replaced later
> c. OSU MVAPICH2
>o Version was updated to 1.0-1.
>  
> 
> 
> Tasks that should be completed for the beta release:
> 
> 1. Integrate all SDP features
> 2. Complete RDS work
> 3. Apply patches that fix warning of backport patches
> 4. Fix compilation problems on PPC
> 5. Add qperf test from Qlogic
> 6. Rebase kernel code on 2.6.24 rc1 (depending it's availability)
> 7. Support RHEL 5 up1
> 8. SPEC files should be part of each user space package
> 
> 
> ___
> general mailing list
> [EMAIL PROTECTED]
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
> 
> To unsubscribe, please visit 
> http://openib.org/mailman/listinfo/openib-general
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] OFA_KERNEL_PARAMS is missing from OFED 1.3 install.pl

[Scott Weitzenkamp (sweitzen)]

I also don't see a way to use K_VER to compile for a kernel other than
the currently booted kernel, like I could in 1.2.5 and earlier.
 
Scott




From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Scott
Weitzenkamp (sweitzen)
Sent: Sunday, October 14, 2007 10:57 PM
To: OpenFabricsEWG; Vladimir Sokolovsky
Cc: [EMAIL PROTECTED]
Subject: [ofa-general] OFA_KERNEL_PARAMS is missing from OFED
1.3 install.pl


Vlad, 
 
I don't see a way to configure OFED 1.3 during installation with
OFA_KERNEL_PARAMS like I could in 1.2.5 and earlier.  I am specifically
looking for the params --without-modprobe, --without-ipoibconf, and
--with-madeye-mod.
 
Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems
 

___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] some RDS related issues in OFED 1.3

[Scott Weitzenkamp (sweitzen)]

I have changed the owner of the RDS component to Vlad.

Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems
 

> -Original Message-
> From: [EMAIL PROTECTED] 
> [mailto:[EMAIL PROTECTED] On Behalf Of Or Gerlitz
> Sent: Wednesday, October 10, 2007 4:46 AM
> To: Vladimir Sokolovsky; EWG
> Subject: [ewg] some RDS related issues in OFED 1.3
> 
> Hi Vlad,
> 
> Opening a bug on the ofa bugzilla whose component is RDS results in 
> [EMAIL PROTECTED] being assigned to it ...
> 
> I understand it should be assigned to you? if yes, can you fix it?
> 
> For the mean time I have re-assigned the two RDS problems reported by 
> Voltaire (https://bugs.openfabrics.org/show_bug.cgi?id=724 
> and id=723) 
> to you, where 724 is actually quite disturbing since RDS can 
> not be used 
> without a following oops on the module unload.
> 
> Or.
> 
> 
> ___
> ewg mailing list
> ewg@lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] RH4.5 and OFED 1.2.5 build problem with ib-bonding

[Scott Weitzenkamp (sweitzen)]

You are hitting https://bugs.openfabrics.org/show_bug.cgi?id=651, which
was present in 1.2 and 1.2.5.
 
Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems
 




From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Benninghoff,
John
Sent: Wednesday, October 03, 2007 10:44 AM
To: ewg@lists.openfabrics.org
Cc: [EMAIL PROTECTED]
Subject: [ofa-general] RH4.5 and OFED 1.2.5 build problem with
ib-bonding


I'm building OFED 1.2.5 using the build.sh script.  All went
fine except ib-bonding.  
 
OFED release notes indicate my RH release is supported:
- RedHat EL4 up5: 2.6.9-55.ELsmp

 
[EMAIL PROTECTED] OFED-1.2.5]# uname -a
Linux logon 2.6.9-55.0.2.ELlargesmp #1 SMP Tue Jun 12 18:09:16
EDT 2007 x86_64 x86_64 x86_64 GNU/Linux
[EMAIL PROTECTED] OFED-1.2.5]# cat /etc/*release
Red Hat Enterprise Linux AS release 4 (Nahant Update 5)

 
Errors clip from the build log:
 
+ cd linux/drivers/net/bonding/
++ pwd
+ make -C /lib/modules/2.6.9-55.0.2.ELlargesmp/build modules
M=/var/tmp/OFEDRPM/BUILD/ib-bonding-0.9.0/linux/drivers/net/bon
ding
make: Entering directory
`/usr/src/kernels/2.6.9-55.0.2.EL-largesmp-x86_64'
  CC [M]
/var/tmp/OFEDRPM/BUILD/ib-bonding-0.9.0/linux/drivers/net/bonding/bond_m
ain.o
In file included from
/var/tmp/OFEDRPM/BUILD/ib-bonding-0.9.0/linux/drivers/net/bonding/bond_m
ain.c:78:

/var/tmp/OFEDRPM/BUILD/ib-bonding-0.9.0/linux/drivers/net/bonding/bondin
g.h: In function `bond_set_slave_inactive_flags':

/var/tmp/OFEDRPM/BUILD/ib-bonding-0.9.0/linux/drivers/net/bonding/bondin
g.h:263: error: `IFF_SLAVE_NEEDARP' undeclared (firs
t use in this function)

/var/tmp/OFEDRPM/BUILD/ib-bonding-0.9.0/linux/drivers/net/bonding/bondin
g.h:263: error: (Each undeclared identifier is repor
ted only once

/var/tmp/OFEDRPM/BUILD/ib-bonding-0.9.0/linux/drivers/net/bonding/bondin
g.h:263: error: for each function it appears in.)

/var/tmp/OFEDRPM/BUILD/ib-bonding-0.9.0/linux/drivers/net/bonding/bondin
g.h: In function `bond_set_slave_active_flags':

/var/tmp/OFEDRPM/BUILD/ib-bonding-0.9.0/linux/drivers/net/bonding/bondin
g.h:269: error: `IFF_SLAVE_NEEDARP' undeclared (firs
t use in this function)


___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] RFC: OFED-1.3-20070823-1130 - first build

[Scott Weitzenkamp \(sweitzen\)]

If install.pl can do the same things install.sh can do, fine by me.

Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems
 

> -Original Message-
> From: [EMAIL PROTECTED] 
> [mailto:[EMAIL PROTECTED] On Behalf Of 
> Vladimir Sokolovsky
> Sent: Thursday, August 23, 2007 12:24 PM
> To: OpenFabricsEWG
> Subject: [ewg] RFC: OFED-1.3-20070823-1130 - first build
> 
> Hi.
> The first build of OFED-1.3 is available for download:
> 
> http://www.openfabrics.org/builds/ofed-1.3/OFED-1.3-20070823-1130.tgz
> 
> Installation:
> # cd OFED-1.3-20070823-1130
> # ./install.pl
> 
>   Usage: ./install.pl [-c  config_file>|--all|--hpc|--basic] [-n|--net ]
> 
> -c|--config . Example of 
> the config file can be found under docs.
> -p|--print-available Print available packages for 
> current platform.
>  And create corresponding 
> ofed.conf file.
> -k|--kernel . Default on this 
> system: 2.6.9-42.ELsmp
> -s|--kernel-sources . 
> Default on this system: /lib/modules/2.6.9-42.ELsmp/build
> --build32Build 32-bit libraries. Relevant 
> for x86_64 and ppc64 platforms
> -v|-vv|-vvv. Set verbosity level
> -q. Set quiet - no messages will be printed
> 
> --all|--hpc|--basic Install all,hpc or basic 
> packages correspondently
> 
> 
> Known Issues:
> IPoIB configuration is not supported yet.
> 
> Please comment.
> 
> Regards,
> Vladimir
> ___
> ewg mailing list
> ewg@lists.openfabrics.org
> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] OFED 1.2.c status & plans

[Scott Weitzenkamp \(sweitzen\)]

Cisco has been testing 1.2.c-10 IPoIB/SDP/MPI successfully on a 32-node
cluster.  We are still working on tvflash, though.
 
Scott




From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Tziporet Koren
Sent: Tuesday, August 07, 2007 12:06 PM
To: EWG
Cc: OpenFabrics General
Subject: [ewg] OFED 1.2.c status & plans


Hi All,

I wish to update on OFED 1.2.c status and plans to synch
everybody:


*   OFED 1.2.c-11 is going out tomorrow 
*   This release should be the base for the GA release 
*   Need an approval from Steve (Chelsio) & Nam (IBM) that
everything is in place from their perspective. 
Also please send me the release notes for ehca and cxgb3

*   Need an approval from the companies that are testing
this release that it can go to GA
>From Mellanox perspective (mlx4 readiness) we are ready
for GA.


I have one question: do we prefer to stay with the name 1.2.c or
1.2.5?

Thanks,
Tziporet


___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] created version "1.3" in bugzilla

[Scott Weitzenkamp \(sweitzen\)]

This allows me to REOPEN some RESOLVED LATER bugs from 1.2.
 
Scott
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] Re: RFC OFED-1.3 installation

[Scott Weitzenkamp \(sweitzen\)]

> >  > I don't really think we want customers to run beta code
> > 
> > What's the point of a beta then??
> 
> Donnu.
> In previous OFED releases, we had "release candidates" rather 
> than "beta".
> Openfabrics members were running RCs and reporting issues on 
> the list and in
> bugzilla. Do you really ask your customers to do this for you?

You say toMAYto, I say toMAHto.

We had many customers running various OFED 1.2 pre-GA builds for
testing, sometimes we had to use a daily build because of certain bug
fixes.

Scott
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] Re: RFC OFED-1.3 installation

[Scott Weitzenkamp \(sweitzen\)]

> > So you need to be able to
> > tell the difference between a customer running libibverbs-1.0.4 from
> > OFED-1.3-beta1 and libibverbs-1.0.4 from OFED-1.3 final.
> 
> I don't really think we want customers to run beta code, or 
> intend to support
> such configurations.

But we still need to tell the difference, so we can tell the customer
they are running beta code and should upgrade.

Scott
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] Re: [ofa-general] OFED-1.2 release download link

[Scott Weitzenkamp \(sweitzen\)]

> > Need to add mlx4 as a component too
> 
> who has the permission to do so?

I can add it, who is the default owner for mlx4 bugs?

Scott
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] Re: [ofa-general] OFED-1.2 release download link

[Scott Weitzenkamp \(sweitzen\)]

> It will be good if we can unify 1.2.c with 1.2.1 that was 
> requested in 
> the same time frame
> Any thoughts on this?

I am in favor of unifying them.

Scott
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] RE: [ofa-general] Toward next OFED release (1.3)

[Scott Weitzenkamp \(sweitzen\)]

> I hope there will be some attempt to get these drivers merged 
> upstream too.

How about SDP, are we ready to try to merge it upstream?

Scott
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] Re: development process post ofed-1.2 gold.

[Scott Weitzenkamp \(sweitzen\)]

> My suggestion is that we keep the ofed_1_2 branch alive, thus 
> new fixes 
> should be applied to the repository.
> In this way we will be able to do a stable release when we decide.
> Another question is regarding the daily build - I don't think we need 
> them any more. We can do a weekly build, or run build in case of need 
> (new patches submitted). What other people think about this?

Weekly and on-demand builds sound OK to me.

Scott
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] RE: [ofa-general] OFED 1.2 rc5 release

[Scott Weitzenkamp \(sweitzen\)]

I have created 1.2rc5 in bugzilla.

Tziporet, I'm not sure how you created your "fixed in rc5" list, but
some of the bugs on it are still open (for example,
https://bugs.openfabrics.org/show_bug.cgi?id=577).

Scott Weitzenkamp
SQA and Release Manager
Server Virtualization Business Unit
Cisco Systems
 

> -Original Message-
> From: [EMAIL PROTECTED] 
> [mailto:[EMAIL PROTECTED] On Behalf Of 
> Tziporet Koren
> Sent: Wednesday, June 13, 2007 7:26 AM
> To: ewg@lists.openfabrics.org
> Cc: [EMAIL PROTECTED]
> Subject: [ofa-general] OFED 1.2 rc5 release
> 
> Hi, 
> 
> OFED 1.2-RC5 is available on
> http://www.openfabrics.org/builds/ofed-1.2/ 
> File: OFED-1.2-rc5.tgz 
> To get BUILD_ID run ofed_info 
> 
> Please report any issues in bugzilla https://bugs.openfabrics.org/
> 
> The GA release is expected next Wed (June 20) based on RC5 tests
> 
> Tziporet & Vlad 
> 
> ==
> ==
> 
> Release information: 
> 
> OS support: 
> Novell: 
> - SLES 9.0 SP3 
> - SLES10 
> - SLES10 SP1 RC5
> Redhat: 
> - Redhat EL4 up3, up4 and up5 
> - Redhat EL5 
> kernel.org: 
> - 2.6.20 
> - 2.6.19 
> 
> Note: Fedora C6 and SuSE Pro 10 are not part of the official list. 
> We keep the backport patches for these OSes and make sure OFED compile
> and loaded properly but will not do full QA cycle.
> 
> Systems: 
> * x86_64 
> * x86 
> * ia64 
> * ppc64 
> 
> Main changes from OFED-1.1-rc4: 
> ===
> 1. Fixed 8 bugs (see attached for fixed issues)
> 2. Added support for SLES10 SP1 RC5 (tvflash is disabled for now)
> 3. Added support for iSER on RHEL 4
> 4. Updated documents - all owners please review to make sure docs of
> your component is updated.
> 
> See bugzilla for all open issues. 
> 
> Tasks that should be completed for the GA release: 
> 1. Complete all documentation (release notes, README, etc.) 
> 2. Run all QA tests on all platforms
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] ib-bonding on RHEL4 errata kernels

[Scott Weitzenkamp \(sweitzen\)]

It's failing on any of the 2.6.9-*-0.*.EL errata kernels (for example
2.6.9-42.0.2.EL).

Scott

> -Original Message-
> From: Tziporet Koren [mailto:[EMAIL PROTECTED] 
> Sent: Wednesday, June 13, 2007 6:06 AM
> To: Scott Weitzenkamp (sweitzen)
> Cc: OpenFabrics EWG
> Subject: Re: [ewg] ib-bonding on RHEL4 errata kernels
> 
> Scott Weitzenkamp (sweitzen) wrote:
> > Moni and Tziporet, can we get 
> > https://bugs.openfabrics.org//show_bug.cgi?id=651 fixed yet 
> for OFED 
> > 1.2 rc5?  It's fixed for RHEL5 but not RHEL4.
> >  
> > Scott
> What is the exact kernel its failing on?
> We must have this kernel to make sure its fixed
> 
> Tziporet
> 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

[ewg] ib-bonding on RHEL4 errata kernels

[Scott Weitzenkamp \(sweitzen\)]

Moni and Tziporet, can we get
https://bugs.openfabrics.org//show_bug.cgi?id=651 fixed yet for OFED 1.2
rc5?  It's fixed for RHEL5 but not RHEL4.
 
Scott
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ofa-general] Re: [ewg] OFED teleconference today - meeting summary

[Scott Weitzenkamp \(sweitzen\)]

You missed the joke, it's *tvflash* not *tvflush*.
 
I have asked Roland about tvflash.
 
Scott




From: Tziporet Koren [mailto:[EMAIL PROTECTED] 
Sent: Monday, June 11, 2007 9:35 AM
    To: Scott Weitzenkamp (sweitzen); Tziporet Koren; EWG;
OpenFabrics General
Subject: RE: [ofa-general] Re: [ewg] OFED teleconference today -
meeting summary


Vlad,
please disable tvflush on SLES10 SP1
 
Thanks,
Tziporet



From: Scott Weitzenkamp (sweitzen) [mailto:[EMAIL PROTECTED] 
Sent: Monday, June 11, 2007 7:30 PM
To: Tziporet Koren; Tziporet Koren; EWG; OpenFabrics General
Subject: RE: [ofa-general] Re: [ewg] OFED teleconference today -
meeting summary


I'm not touching tvflush! :-)




From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Tziporet
Koren
Sent: Monday, June 11, 2007 9:29 AM
To: Tziporet Koren; EWG; OpenFabrics General
Subject: [ofa-general] Re: [ewg] OFED teleconference
today - meeting summary




Agenda for the meeting today:
- Review open bugs and decide on the release

567  blocker [EMAIL PROTECTED]   RHEL5 ppc64 UD verbs
failures
577  critical[EMAIL PROTECTED]   SRP multipath failover
too slow (minutes, not seconds) 
629  major   [EMAIL PROTECTED]   ib-bonding: sometimes slow
failover is noticed 
541  major   [EMAIL PROTECTED]   slow failover with IPoIB CM
bonding/ipoibtools HA   
642  major   [EMAIL PROTECTED]   Failed to build mvapich with
PGI compiler


My suggestion wait only for Bonding and MPI
fixes and have RC5 done on Wed.
This RC5 should become the official release





In the meeting today we decided the following:
For RC5 we will fix only 2 more issues:
629 - new bonding module is already ready
642 - got approval from OSU so we will enhance MPI to
support PGI compiler
558 - Scott should find with Roland if there is a fix
for tvflush for SLES10 SP1 and if its fixed we can take this one too.

RC5 will be published on Wed June 13, and it is targeted
to become the GA release.
GA release will be published after a week of QA - target
date is June 20.

Tziporet



___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ofa-general] Re: [ewg] OFED teleconference today - meeting summary

[Scott Weitzenkamp \(sweitzen\)]

I'm not touching tvflush! :-)




From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Tziporet
Koren
Sent: Monday, June 11, 2007 9:29 AM
To: Tziporet Koren; EWG; OpenFabrics General
Subject: [ofa-general] Re: [ewg] OFED teleconference today -
meeting summary




Agenda for the meeting today:
- Review open bugs and decide on the release

567  blocker [EMAIL PROTECTED]   RHEL5 ppc64 UD verbs
failures
577  critical[EMAIL PROTECTED]   SRP multipath failover
too slow (minutes, not seconds) 
629  major   [EMAIL PROTECTED]   ib-bonding: sometimes slow
failover is noticed 
541  major   [EMAIL PROTECTED]   slow failover with IPoIB CM
bonding/ipoibtools HA   
642  major   [EMAIL PROTECTED]   Failed to build mvapich with
PGI compiler


My suggestion wait only for Bonding and MPI fixes and
have RC5 done on Wed.
This RC5 should become the official release





In the meeting today we decided the following:
For RC5 we will fix only 2 more issues:
629 - new bonding module is already ready
642 - got approval from OSU so we will enhance MPI to support
PGI compiler
558 - Scott should find with Roland if there is a fix for
tvflush for SLES10 SP1 and if its fixed we can take this one too.

RC5 will be published on Wed June 13, and it is targeted to
become the GA release.
GA release will be published after a week of QA - target date is
June 20.

Tziporet



___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

RE: [ewg] OFED teleconference today

[Scott Weitzenkamp \(sweitzen\)]

My suggestion wait only for Bonding and MPI fixes and have RC5 done on
Wed.
This RC5 should become the official release

[Scott Weitzenkamp (sweitzen)] Sounds good to me.
 
Scott 
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg