Re: [openib-general] RHEL5 and OFED ...
[EMAIL PROTECTED] wrote on 10/16/2006 01:50:49 PM: On Mon, 2006-10-16 at 15:25 +0200, Michael S. Tsirkin wrote: Quoting r. Maestas, Christopher Daniel [EMAIL PROTECTED]: Subject: Re: [openib-general] RHEL5 and OFED ... Now for userspace - does RHEL5 include at least libibverbs-1.0? This has been released a while back, and Roland makes regular bugfix releases. Here's what I see on a rhel4 u4 system: --- $ rpm -q libibverbs libibverbs-1.0.3-1 --- So I would think rhel5 would have at least that or greater. When I compiled rpms for 1.1rc7 it generated: --- # ls libibverbs-* libibverbs-1.0.4-0.x86_64.rpmlibibverbs-utils-1.0.4-0.x86_64.rpm libibverbs-devel-1.0.4-0.x86_64.rpm Dough, would it be possible to update this + libmthca? Possibly. What's the justification? What's in 1.0.4 that is the primary reason for wanting to update from 1.0.3? -- Doug Ledford [EMAIL PROTECTED] I am not sure whether this already has an answer. The justification is madvise(..., MADV_DONTFORK) is used to make fork() work for verbs consumers in the recent packages. I hope same patch will be in libehca. thanks Shirley Ma IBM Linux Technology Center___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Shirley Ma wrote: [EMAIL PROTECTED] wrote on 10/16/2006 01:50:49 PM: On Mon, 2006-10-16 at 15:25 +0200, Michael S. Tsirkin wrote: Quoting r. Maestas, Christopher Daniel [EMAIL PROTECTED]: So I would think rhel5 would have at least that or greater. When I compiled rpms for 1.1rc7 it generated: --- # ls libibverbs-* libibverbs-1.0.4-0.x86_64.rpm libibverbs-utils-1.0.4-0.x86_64.rpm libibverbs-devel-1.0.4-0.x86_64.rpm Dough, would it be possible to update this + libmthca? Possibly. What's the justification? What's in 1.0.4 that is the primary reason for wanting to update from 1.0.3? I am not sure whether this already has an answer. The justification is madvise(..., MADV_DONTFORK) is used to make fork() work for verbs consumers in the recent packages. I hope same patch will be in libehca. Just to crlarify: libibverbs-1.X does not include the madvise(...,MADV_DONTFORK) fork() support, it was integrated into libibverbs1.1 which is not released yet. Or. ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting r. Doug Ledford [EMAIL PROTECTED]: Hmm, no, I really want to take a srpm from amd64 and get a 32 bit gcc executable that will build 64 bit binaries that match these built on native amd64 system exectly. Between just i386 and x86_64, you might be able to do that. I guess what I would like is for redhat to enable -m64 is gcc/binutils from 32 bit distribution. Then once I have a 64 bit machine, I could boot a 32 bit distro but change just the kernel to 64 bit. -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting r. Doug Ledford [EMAIL PROTECTED]: Subject: Re: RHEL5 and OFED ... On Sat, 2006-10-14 at 22:14 +0200, Michael S. Tsirkin wrote: Quoting r. Doug Ledford [EMAIL PROTECTED]: Sorry. RHEL5 Beta1 has been out for a while, but OFED 1.1 still isn't done yet. Obviously, I wasn't able to get something in RHEL5 that didn't even exist prior to freeze. Would it be possible to include patches backporting fixes in infiniband kernel components from 2.6.18/OFED 1.1 to modules that already ship with RHEL5? Maybe. It would depend on the patch. Of course, keep in mind that RHEL5 Beta1 *has* a 2.6.18 kernel. I looked here ftp://ftp.redhat.com/pub/redhat/linux/beta/RHEL5-Beta1/server/source/ and it seems to be 2.6.17 based. Is something wrong? -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting r. Doug Ledford [EMAIL PROTECTED]: Subject: Re: RHEL5 and OFED ... On Tue, 2006-10-17 at 15:35 +0200, Michael S. Tsirkin wrote: Quoting r. Doug Ledford [EMAIL PROTECTED]: Subject: Re: RHEL5 and OFED ... On Sat, 2006-10-14 at 22:14 +0200, Michael S. Tsirkin wrote: Quoting r. Doug Ledford [EMAIL PROTECTED]: Sorry. RHEL5 Beta1 has been out for a while, but OFED 1.1 still isn't done yet. Obviously, I wasn't able to get something in RHEL5 that didn't even exist prior to freeze. Would it be possible to include patches backporting fixes in infiniband kernel components from 2.6.18/OFED 1.1 to modules that already ship with RHEL5? Maybe. It would depend on the patch. Of course, keep in mind that RHEL5 Beta1 *has* a 2.6.18 kernel. I looked here ftp://ftp.redhat.com/pub/redhat/linux/beta/RHEL5-Beta1/server/source/ and it seems to be 2.6.17 based. Is something wrong? Yeah, this is the rolling updates thing I was telling you about. The Beta1 kernel was 2.6.17+several git repos and patches. We've since updated to 2.6.18, but that was released as an update to the Beta1 isos and trees via RHN. So, I don't think you'll see the kernel unless you either 1) use up2date to refresh the beta system Will that get me the sources too? or 2) download later iso images and look at the kernel present. The current kernel version is 2.6.18-1.2717.el5. So, I'd like to help, but how can one get the updated kernel source? Are the iso's with updated sources available somewhere? -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
On Tue, 2006-10-17 at 17:09 +0200, Michael S. Tsirkin wrote: Yeah, this is the rolling updates thing I was telling you about. The Beta1 kernel was 2.6.17+several git repos and patches. We've since updated to 2.6.18, but that was released as an update to the Beta1 isos and trees via RHN. So, I don't think you'll see the kernel unless you either 1) use up2date to refresh the beta system Will that get me the sources too? Evidently, I was mistaken and rhn is still populated with the beta1 rpms. So, I've made the latest kernel available on my web page as referenced below (amongst other rpms as well). However, it may still be a while before the rpms are fully populated as I've had to request an increase to my quota limit on that web server in order to hold the kernel rpms tree. or 2) download later iso images and look at the kernel present. The current kernel version is 2.6.18-1.2717.el5. So, I'd like to help, but how can one get the updated kernel source? Are the iso's with updated sources available somewhere? -- Doug Ledford [EMAIL PROTECTED] GPG KeyID: CFBFF194 http://people.redhat.com/dledford Infiniband specific RPMs available at http://people.redhat.com/dledford/Infiniband signature.asc Description: This is a digitally signed message part ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting Doug Ledford [EMAIL PROTECTED]: Evidently, I was mistaken and rhn is still populated with the beta1 rpms. So, I've made the latest kernel available on my web page as referenced below (amongst other rpms as well). However, it may still be a while before the rpms are fully populated as I've had to request an increase to my quota limit on that web server in order to hold the kernel rpms tree. When available, I gather they will be here: http://people.redhat.com/dledford/Infiniband/kernel/2.6.18/1.2729.el5/src/ is that right? -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
On a tangent, is there a way to set up a cross-build environment that will build kernel modules for e.g. RHEL amd64 kernel on a 32 bit machine? I'm doing this now with gcc and kernel.org kernel I built myself from source. I guess I mostly need to get gcc and binutils SRPMs to generate cross-compiling tools - has anyone done that? -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
On Tue, 2006-10-17 at 22:23 +0200, Michael S. Tsirkin wrote: Quoting Doug Ledford [EMAIL PROTECTED]: Evidently, I was mistaken and rhn is still populated with the beta1 rpms. So, I've made the latest kernel available on my web page as referenced below (amongst other rpms as well). However, it may still be a while before the rpms are fully populated as I've had to request an increase to my quota limit on that web server in order to hold the kernel rpms tree. When available, I gather they will be here: http://people.redhat.com/dledford/Infiniband/kernel/2.6.18/1.2729.el5/src/ is that right? Yep. -- Doug Ledford [EMAIL PROTECTED] GPG KeyID: CFBFF194 http://people.redhat.com/dledford Infiniband specific RPMs available at http://people.redhat.com/dledford/Infiniband signature.asc Description: This is a digitally signed message part ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
On Tue, 2006-10-17 at 22:28 +0200, Michael S. Tsirkin wrote:
On a tangent, is there a way to set up a cross-build environment that will
build kernel modules for e.g. RHEL amd64 kernel on a 32 bit machine?
I'm doing this now with gcc and kernel.org kernel I built myself from source.
I guess I mostly need to get gcc and binutils SRPMs to generate
cross-compiling tools - has anyone done that?
At least for Red Hat, rpm already mostly supports this with only a few
examples of breakage (apps needing gfortran like openmpi are an example
that might break depending on usage). This is one of the reason I
totally ignore the install.sh script in the OFED releases. For any arch
that supports multiple run time variants, the default installation
installs compilers for all supported run time variants, but not
necessarily for other variants (aka, on x86_64 gcc will support x86_64
or ia32, but ia32 won't necessarily support x86_64, and neither will
necessarily support building ppc or ppc64 or ia64 or s390(x)). You can
call rpmbuild with the --target option to specify the mode you want the
package built as, and in the process that automatically changes all of
the configure options present as part of the %configure macro of rpm to
the right paths (hence why I also strip out all of the %_libdir and
friends settings from the spec file, rpm gets this right itself) and
changes the CFLAGS and CPPFLAGS environment variables to force compiling
in the right mode.
Now, that being said, kernel modules in particular are a different
beast. I originally had a module build kit for the 2.4 kernels that
would cross build kernel modules. That's long since deprecated though.
Now a days, the rule is to build a proper kernel looking source tree,
install the kernel-devel package, then the build command is basically
something like:
cd /lib/modules/`uname -r`/build
make SUBDIRS=src-directory-path
In order to cross compile, you would likely need to pass ARCH= to the
make command line. In addition, for a cross compile you very well may
need to install the kernel-devel from that arch instead of the native
one. However, given the limitations I listed above about cross
compiling, it's likely that you can only cross compile from certain
arches to certain other arches.
All that being said, a kernel-ib spec file could include something like
this:
BuildConflicts: kernel-devel (I'm not sure build conflicts is a proper
tag, if not, you might have to script a little more carefully in %setup)
%prep
%setup -q
rpm -i /usr/src/redhat/RPMS/%{arch}/kernel-devel-`uname -r`.%{arch}.rpm
%build
cd /lib/modules/`uname -r`/build
make ARCH=%{arch} SUBDIRS=${RPM_BUILD_DIR}/%{name}-%{version} modules
%install
cd /lib/modules/`uname -r`/build
make ARCH=%{arch} SUBDIRS=${RPM_BUILD_DIR}/%{name}-%{version}
INSTALL_MOD_PATH=${RPM_BUILD_ROOT} modules_install
%clean
rm -fr ${RPM_BUILD_ROOT}
rpm -e kernel-devel
Then, to cross compile, you would simply run rpmbuild multiple times:
for i in i686 x86_64; do
rpmbuild --ba --target=$i kernel-ib.spec
done
BTW, all the rpms are live on my site now.
--
Doug Ledford [EMAIL PROTECTED]
GPG KeyID: CFBFF194
http://people.redhat.com/dledford
Infiniband specific RPMs available at
http://people.redhat.com/dledford/Infiniband
signature.asc
Description: This is a digitally signed message part
___
openib-general mailing list
openib-general@openib.org
http://openib.org/mailman/listinfo/openib-general
To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting r. Doug Ledford [EMAIL PROTECTED]: Subject: Re: RHEL5 and OFED ... On Tue, 2006-10-17 at 22:28 +0200, Michael S. Tsirkin wrote: On a tangent, is there a way to set up a cross-build environment that will build kernel modules for e.g. RHEL amd64 kernel on a 32 bit machine? I'm doing this now with gcc and kernel.org kernel I built myself from source. I guess I mostly need to get gcc and binutils SRPMs to generate cross-compiling tools - has anyone done that? At least for Red Hat, rpm already mostly supports this with only a few examples of breakage (apps needing gfortran like openmpi are an example that might break depending on usage). So, you are saying I shuld rpmbuild binutils and gcc rpms? Hmm, I'll give it a try. You can call rpmbuild with the --target option to specify the mode you want the package built as Hmm, no, I really want to take a srpm from amd64 and get a 32 bit gcc executable that will build 64 bit binaries that match these built on native amd64 system exectly. -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
On Tue, 2006-10-17 at 23:48 +0200, Michael S. Tsirkin wrote: Quoting r. Doug Ledford [EMAIL PROTECTED]: Subject: Re: RHEL5 and OFED ... On Tue, 2006-10-17 at 22:28 +0200, Michael S. Tsirkin wrote: On a tangent, is there a way to set up a cross-build environment that will build kernel modules for e.g. RHEL amd64 kernel on a 32 bit machine? I'm doing this now with gcc and kernel.org kernel I built myself from source. I guess I mostly need to get gcc and binutils SRPMs to generate cross-compiling tools - has anyone done that? At least for Red Hat, rpm already mostly supports this with only a few examples of breakage (apps needing gfortran like openmpi are an example that might break depending on usage). So, you are saying I shuld rpmbuild binutils and gcc rpms? Hmm, I'll give it a try. No. To build an i686 binary on an x86_64 only requires passing -m32 to the compiler. It will then build the 32bit variant instead of the 64bit. I'm not saying rpmbuild gcc and binutils, because the variants installed will already do what you want (assuming building 32bit on 64bit is what you want, but I see that isn't the case on down). You can call rpmbuild with the --target option to specify the mode you want the package built as Hmm, no, I really want to take a srpm from amd64 and get a 32 bit gcc executable that will build 64 bit binaries that match these built on native amd64 system exectly. Between just i386 and x86_64, you might be able to do that. However, in general, byte for byte identical cross compiling can't be done. That's one of the reasons we build all the packages on the arch they are being built for, so if a user rebuilds a package on the arch then it will most likely match the package we built. If we cross compiled, that would be false more often than true. Minor things like variance in how CPUs handle floating point math and precision of said math effect gcc optimization decisions and change the generated byte code. In any case, I'm certainly no gcc build expert, so I don't know the magic incantations to get the gcc sources to spit out a 32bit binary that builds 64bit code. Far easier would be to go the other way around, run on x86_64 and build for i386, in which case gcc supports that out of the box. -- Doug Ledford [EMAIL PROTECTED] GPG KeyID: CFBFF194 http://people.redhat.com/dledford Infiniband specific RPMs available at http://people.redhat.com/dledford/Infiniband signature.asc Description: This is a digitally signed message part ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting r. Doug Ledford [EMAIL PROTECTED]: Far easier would be to go the other way around, run on x86_64 and build for i386, in which case gcc supports that out of the box. All that's left is to convince Lenovo there's a market for x86_64 thinkpads. -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
On Wed, 2006-10-18 at 06:01 +0200, Michael S. Tsirkin wrote: Quoting r. Doug Ledford [EMAIL PROTECTED]: Far easier would be to go the other way around, run on x86_64 and build for i386, in which case gcc supports that out of the box. All that's left is to convince Lenovo there's a market for x86_64 thinkpads. I would place that behind convincing them not to ship exploding batteries (thankfully, they actually saw the light on that after some spectacular examples of why they should). -- Doug Ledford [EMAIL PROTECTED] GPG KeyID: CFBFF194 http://people.redhat.com/dledford Infiniband specific RPMs available at http://people.redhat.com/dledford/Infiniband signature.asc Description: This is a digitally signed message part ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting r. Doug Ledford [EMAIL PROTECTED]: Subject: Re: RHEL5 and OFED ... On Wed, 2006-10-18 at 06:01 +0200, Michael S. Tsirkin wrote: Quoting r. Doug Ledford [EMAIL PROTECTED]: Far easier would be to go the other way around, run on x86_64 and build for i386, in which case gcc supports that out of the box. All that's left is to convince Lenovo there's a market for x86_64 thinkpads. I would place that behind convincing them not to ship exploding batteries (thankfully, they actually saw the light on that after some spectacular examples of why they should). Sigh. BTW, the utility they supplied to check the battery didn't run under wine, had to open the case, copy the S/N to their web page manually. And I wandered - what does the utility do on windows? Heats the thing up and tests whether it explodes? -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting r. Maestas, Christopher Daniel [EMAIL PROTECTED]: Subject: Re: [openib-general] RHEL5 and OFED ... Now for userspace - does RHEL5 include at least libibverbs-1.0? This has been released a while back, and Roland makes regular bugfix releases. Here's what I see on a rhel4 u4 system: --- $ rpm -q libibverbs libibverbs-1.0.3-1 --- So I would think rhel5 would have at least that or greater. When I compiled rpms for 1.1rc7 it generated: --- # ls libibverbs-* libibverbs-1.0.4-0.x86_64.rpmlibibverbs-utils-1.0.4-0.x86_64.rpm libibverbs-devel-1.0.4-0.x86_64.rpm Dough, would it be possible to update this + libmthca? -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting r. Roland Dreier [EMAIL PROTECTED]: Subject: Re: RHEL5 and OFED ... Michael 1. The first thing would be to list fixes between 2.6.18 Michael and 2.6.19-rc1 and backport these. Some of them are in Michael OFED. If you want to do this, I think it would be great to also submit the patches to -stable for inclusion in 2.6.18.x. OKay. -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting r. Doug Ledford [EMAIL PROTECTED]: 1. The first thing would be to list fixes between 2.6.18 and 2.6.19-rc1 and backport these. Some of them are in OFED. That would be helpful. Since 2.6.19-rc looks to have integrated the iWARP merge, the fixes are no doubt mixed in with a bunch of new code, so I didn't pull anything from 2.6.19-rc since I was likely to break things. Targeted fixes that skip the iWARP changes from someone that knows them would be helpful. OK. BTW, -stable is a good place to kae things from. Already, you might want to take d083f6d9648646833aed11ce81009128baf897f9 from 2.6.18.1: IB/mthca: Fix lid used for sending traps http://kernel.org/pub/linux/kernel/v2.6/ChangeLog-2.6.18.1 this fixes a regression from 2.6.17. -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting r. Doug Ledford [EMAIL PROTECTED]: Dough, would it be possible to update this + libmthca? Possibly. What's the justification? What's in 1.0.4 that is the primary reason for wanting to update from 1.0.3? Hmm, Roland, I went to look into Changelog and I note that you don't label svn versions or release versions there. So it's hard to see what was fixed in what version, or to map to svn versions. I'll dig that info up but I thin we want it in ChangeLog. -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Michael Hmm, Roland, I went to look into Changelog and I note Michael that you don't label svn versions or release versions Michael there. So it's hard to see what was fixed in what Michael version, or to map to svn versions. Michael I'll dig that info up but I thin we want it in ChangeLog. I do put the releases into the changelog. There has not been a libibverbs 1.0.4 release yet, but you can find the entry 2006-05-02 Roland Dreier [EMAIL PROTECTED] * Release version 1.0.3. in the libibverbs ChangeLog. Everything after that is the changes pending for 1.0.4 (which I really want to do soon). I guess I should change svn right after the release to be 1.0.4-pre until the actual release, rather than bumping to 1.0.4 immediately, to reduce the possibility of confusion. - R. ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting r. Roland Dreier [EMAIL PROTECTED]: I do put the releases into the changelog. There has not been a libibverbs 1.0.4 release yet, but you can find the entry 2006-05-02 Roland Dreier [EMAIL PROTECTED] * Release version 1.0.3. in the libibverbs ChangeLog. Everything after that is the changes pending for 1.0.4 (which I really want to do soon). Thanks, mised that, sorry. I guess I should change svn right after the release to be 1.0.4-pre until the actual release, rather than bumping to 1.0.4 immediately, to reduce the possibility of confusion. OK, thanks. -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting r. Doug Ledford [EMAIL PROTECTED]: Subject: Re: RHEL5 and OFED ... On Sat, 2006-10-14 at 22:14 +0200, Michael S. Tsirkin wrote: Quoting r. Doug Ledford [EMAIL PROTECTED]: Sorry. RHEL5 Beta1 has been out for a while, but OFED 1.1 still isn't done yet. Obviously, I wasn't able to get something in RHEL5 that didn't even exist prior to freeze. Would it be possible to include patches backporting fixes in infiniband kernel components from 2.6.18/OFED 1.1 to modules that already ship with RHEL5? Maybe. It would depend on the patch. Of course, keep in mind that RHEL5 Beta1 *has* a 2.6.18 kernel. Really? That's way cool. How does one generate patches for you? Patch against vanilla 2.6.18? There are three kind of patches we might want: 1. The first thing would be to list fixes between 2.6.18 and 2.6.19-rc1 and backport these. Some of them are in OFED. 2. I think in cma module there are 2 main interfaces in OFED 1.1 missing in 2.6.18: API to set timeouts and retry count, and rdma_establish to handle passive side 3. Finally, OFED has some out of kernel modules (mostly UCMA and SDP) that it would be nice to add Where does the line pass, approximately? Backporting does take work, so I'd like to get a feeling on what's likely to get accepted before I commit to this. Now for userspace - does RHEL5 include at least libibverbs-1.0? This has been released a while back, and Roland makes regular bugfix releases. -- MST ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Now for userspace - does RHEL5 include at least libibverbs-1.0? This has been released a while back, and Roland makes regular bugfix releases. Here's what I see on a rhel4 u4 system: --- $ rpm -q libibverbs libibverbs-1.0.3-1 --- So I would think rhel5 would have at least that or greater. When I compiled rpms for 1.1rc7 it generated: --- # ls libibverbs-* libibverbs-1.0.4-0.x86_64.rpmlibibverbs-utils-1.0.4-0.x86_64.rpm libibverbs-devel-1.0.4-0.x86_64.rpm --- ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
On Sun, 2006-10-15 at 17:59 +0200, Michael S. Tsirkin wrote: Quoting r. Doug Ledford [EMAIL PROTECTED]: Subject: Re: RHEL5 and OFED ... On Sat, 2006-10-14 at 22:14 +0200, Michael S. Tsirkin wrote: Quoting r. Doug Ledford [EMAIL PROTECTED]: Sorry. RHEL5 Beta1 has been out for a while, but OFED 1.1 still isn't done yet. Obviously, I wasn't able to get something in RHEL5 that didn't even exist prior to freeze. Would it be possible to include patches backporting fixes in infiniband kernel components from 2.6.18/OFED 1.1 to modules that already ship with RHEL5? Maybe. It would depend on the patch. Of course, keep in mind that RHEL5 Beta1 *has* a 2.6.18 kernel. Really? That's way cool. How does one generate patches for you? Patch against vanilla 2.6.18? The best way is to install the kernel src.rpm, then go into /usr/src/redhat/SPECS and rpmbuild --bp kernel-2.6.spec and then go into /usr/src/redhat/BUILD/kernel-2.6.18/linux-2.6.18.noarch and patch the appropriate files there. Save off originals with a unique extension, then use gendiff to create the patch. There are three kind of patches we might want: 1. The first thing would be to list fixes between 2.6.18 and 2.6.19-rc1 and backport these. Some of them are in OFED. That would be helpful. Since 2.6.19-rc looks to have integrated the iWARP merge, the fixes are no doubt mixed in with a bunch of new code, so I didn't pull anything from 2.6.19-rc since I was likely to break things. Targeted fixes that skip the iWARP changes from someone that knows them would be helpful. 2. I think in cma module there are 2 main interfaces in OFED 1.1 missing in 2.6.18: API to set timeouts and retry count, and rdma_establish to handle passive side OK. 3. Finally, OFED has some out of kernel modules (mostly UCMA and SDP) that it would be nice to add The UCMA module is indeed missing. The SDP module is present, but it's the older OFED 1.0 code that could stand to be updated. Where does the line pass, approximately? Backporting does take work, so I'd like to get a feeling on what's likely to get accepted before I commit to this. Right now I already have a bugzilla against RHEL5 beta about the missing UCMA, so that needs fixing anyway. A reproducer for the SDP problems in the OFED 1.0 stack will give me the ability to open an SDP bugzilla against RHEL5 and fix it up. Now for userspace - does RHEL5 include at least libibverbs-1.0? This has been released a while back, and Roland makes regular bugfix releases. It includes the OFED 1.0 libibverbs (which makes openmpi complain about lack of out of band data support, but otherwise seems to work). As a side note, it includes the OFED 1.0 libehca and ib_ehca kernel module. I didn't update the kernel code to the OFED 1.1 ehca because I didn't know if it would introduce compatibility problems with the user space library. However, it might be worthwhile to update that as well given the amount of change that has occurred and the difference in testing between the two. -- Doug Ledford [EMAIL PROTECTED] GPG KeyID: CFBFF194 http://people.redhat.com/dledford Infiniband specific RPMs available at http://people.redhat.com/dledford/Infiniband signature.asc Description: This is a digitally signed message part ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Michael 1. The first thing would be to list fixes between 2.6.18 Michael and 2.6.19-rc1 and backport these. Some of them are in Michael OFED. If you want to do this, I think it would be great to also submit the patches to -stable for inclusion in 2.6.18.x. - R. ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Re: [openib-general] RHEL5 and OFED ...
Quoting r. Doug Ledford [EMAIL PROTECTED]: Sorry. RHEL5 Beta1 has been out for a while, but OFED 1.1 still isn't done yet. Obviously, I wasn't able to get something in RHEL5 that didn't even exist prior to freeze. Would it be possible to include patches backporting fixes in infiniband kernel components from 2.6.18/OFED 1.1 to modules that already ship with RHEL5? -- MST ___ openfabrics-ewg mailing list [EMAIL PROTECTED] http://openib.org/mailman/listinfo/openfabrics-ewg ___ openib-general mailing list openib-general@openib.org http://openib.org/mailman/listinfo/openib-general To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
