Re: [ewg] Version of OFED in RHEL6?

2010-04-22 Thread Andy Grover
Roland Dreier wrote:
> Yes, this shows all the unfortunate confusion caused by trying to
> "brand" OFED as something special.  What version of, say, the IP stack
> does RHEL contain?  You don't care, right?  In general, RHEL is going to
> contain version XYZ of the kernel, plus patches A, B, C, along with
> version UVW of libfoo and version MNO of libbar, etc.  The
> InfiniBand/RDMA world shouldn't be special -- the rest of the world
> deals with that just fine, without having to tie RHEL's versioning to
> someone else's distribution.

Very true. So Red Hat isn't going for the Combo Meal any more, they're 
ordering a la carte. :) I'd think this is a good sign for how far OFED 
has come, but some people are still going to want the OFED package.

Are the canonical upstreams for rpms in OFED listed somewhere? Upstream 
kernel is obvious, but it's not clear to me which other packages OFED is 
packaging, and which it *is* the upstream for.

If more distros move to the a la carte model for IB-related packages, I 
think this is an important distinction to make. For packages where OFED 
is not the upstream (again, like the kernel) we'll need to more 
aggressively push changes up, since distros will be going there 
directly. There are changes that have been in ofa_kernel for more than a 
year that have not been pushed up, and now they won't be in RHEL6.

Regards -- Andy
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg


Re: [ewg] Version of OFED in RHEL6?

2010-04-22 Thread Roland Dreier
 > > I think this whole discussion is kind of ridiculous.

 > I'm the OP. It might be naive but I don't think it's ridiculous,

Yes, I wasn't replying to your original question.  Just the continuing
discussion seemed silly -- once the answer "RHEL6 won't contain OFED"
came, continuing to ask, "OK, but what version of OFED will it contain?"
is ridiculous I think.

 > > OFED is a
 > > distribution of RDMA software, with the kernel as one of its main
 > > upstream sources.  So you could ask what version of the kernel a given
 > > OFED release is based on.  But "getting OFED from the upstream kernel"
 > > is nonsense -- RHEL6 is getting RDMA drivers from the upstream kernel.

 > When I looked at an OFED 1.4 release, I saw a ton
 > of stuff that didn't look like it had much to do
 > with RDMA. For example, consider all the commands whose name
 > begins with "ib".

Sorry, I was using "RDMA" as a generic term to cover both iWARP and
InfiniBand.  It's true that OFED contains a lot of stuff not strictly
having to do with "remote direct memory access."

 > The reason I asked this in the first place is that
 > the cluster software package I use, Rocks, needs help
 > in how it supports IB. I was trying to do something
 > about this. One approach would be to just use whatever
 > comes with RHEL, but the talk mentioned below doesn't
 > say anything about what version of OFED this will be.

 > Getting up to speed with IB sure is difficult.

Yes, this shows all the unfortunate confusion caused by trying to
"brand" OFED as something special.  What version of, say, the IP stack
does RHEL contain?  You don't care, right?  In general, RHEL is going to
contain version XYZ of the kernel, plus patches A, B, C, along with
version UVW of libfoo and version MNO of libbar, etc.  The
InfiniBand/RDMA world shouldn't be special -- the rest of the world
deals with that just fine, without having to tie RHEL's versioning to
someone else's distribution.
-- 
Roland Dreier  || For corporate legal information go to:
http://www.cisco.com/web/about/doing_business/legal/cri/index.html
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg


Re: [ewg] Version of OFED in RHEL6?

2010-04-22 Thread Jon Forrest
On 4/22/2010 8:01 AM, Roland Dreier wrote:

> I think this whole discussion is kind of ridiculous.

I'm the OP. It might be naive but I don't think it's ridiculous,
for two reasons:

1) When I install CentOS 5 (and RHEL 5 I guess, although
I've never installed it) one of the choices I'm given
is whether I want to install OFED.

2) At the Open Fabrics Conference last month a talk
was given (see #1 below) that discussed what version
of OFED was going to be in what version of RHEL.

So, people much much wiser than me are telling
me that some distribution of OFED is contained in
RHEL. I'm the first to admit that I really don't
know what that means since I'm very new to IB.

> OFED is a
> distribution of RDMA software, with the kernel as one of its main
> upstream sources.  So you could ask what version of the kernel a given
> OFED release is based on.  But "getting OFED from the upstream kernel"
> is nonsense -- RHEL6 is getting RDMA drivers from the upstream kernel.

When I looked at an OFED 1.4 release, I saw a ton
of stuff that didn't look like it had much to do
with RDMA. For example, consider all the commands whose name
begins with "ib".

The reason I asked this in the first place is that
the cluster software package I use, Rocks, needs help
in how it supports IB. I was trying to do something
about this. One approach would be to just use whatever
comes with RHEL, but the talk mentioned below doesn't
say anything about what version of OFED this will be.

Getting up to speed with IB sure is difficult.

#1 
http://www.openfabrics.org/archives/spring2010sonoma/Tuesday/11.30%20Tziporet%20Koren%20OFED%20Linux%20Next%20Steps/2010-03-16-11.30-OFED_For_Linux_4.pptx

Cordially,
-- 
Jon Forrest
Research Computing Support
College of Chemistry
173 Tan Hall
University of California Berkeley
Berkeley, CA
94720-1460
510-643-1032
jlforr...@berkeley.edu
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg


Re: [ewg] Version of OFED in RHEL6?

2010-04-22 Thread Brian J. Murrell
On Thu, 2010-04-22 at 16:57 +0200, Peter Kjellstrom wrote: 
> 
> I interpret Dougs comment as: no version of OFED. The infiniband stack will 
> be 
> a different set of infiniband packages than any specific OFED release.

OK.  That's fair enough.  I'm not sure if the OP was looking for this in
particular, but my interest is more about what's in the kernel itself
rather than the userspace packages.  Is it fair to try to put a single
version on the portion of the stack that lives in the kernel or is it
just as difficult as it could come from many places as well?

b.



signature.asc
Description: This is a digitally signed message part
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

Re: [ewg] Version of OFED in RHEL6?

2010-04-22 Thread Roland Dreier
 > So what is the answer to the OP's original question though?  Probably
 > this is not really a question for this list, but surely, somebody here
 > knows...  Given the above statement about getting OFED from the upstream
 > kernel rather than an OFA release, what does that mean in terms of which
 > actual version of OFED will be in RHEL6?

I think this whole discussion is kind of ridiculous.  OFED is a
distribution of RDMA software, with the kernel as one of its main
upstream sources.  So you could ask what version of the kernel a given
OFED release is based on.  But "getting OFED from the upstream kernel"
is nonsense -- RHEL6 is getting RDMA drivers from the upstream kernel.

So asking what version of OFED will be in RHEL6 is a bit like asking
what version of SLES will be in RHEL6.

 - R.
-- 
Roland Dreier  || For corporate legal information go to:
http://www.cisco.com/web/about/doing_business/legal/cri/index.html
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg


Re: [ewg] Version of OFED in RHEL6?

2010-04-22 Thread Peter Kjellstrom
On Thursday 22 April 2010, Brian J. Murrell wrote:
> On Wed, 2010-04-21 at 15:50 -0700, Andy Grover wrote:
> > Jon Forrest wrote:
> > > What version of OFED should we expect to
> > > find in RHEL6?
> >
> > It looks like RHEL6 will not include all of OFED, but pick things from
> > OFED's upstream. see https://bugzilla.redhat.com/show_bug.cgi?id=463454
> >
> > "All of the SGI package requests are met as of the Beta. However, please
> > note that the packages are pulled from upstream, and not from OFED.
> > Going forward in RHEL6 we will be pulling all InfiniBand related code
> > from upstream (from the upstream Linus kernel for kernel code and from
> > the various upstream package maintainers for individual packages). So if
> > people have specific requests for a certain feature in a certain
> > package, then they need to request that specific package be updated."
>
> So what is the answer to the OP's original question though?  Probably
> this is not really a question for this list, but surely, somebody here
> knows...  Given the above statement about getting OFED from the upstream
> kernel rather than an OFA release, what does that mean in terms of which
> actual version of OFED will be in RHEL6?

I interpret Dougs comment as: no version of OFED. The infiniband stack will be 
a different set of infiniband packages than any specific OFED release.

/Peter

> An additional note on the above mentioned bug notes:
>
> According to the latest builds, the following package version
> are in 6.0:
>
> infiniband-diags-1.5.3-1.el6
> perftest-1.2.3-1.el6
> qperf-0.4.6-1.el6
>
> That first one kinda indicates to me that it might be OFED (core) 1.5.3.
> Would that be an unreasonable conclusion?
>
> b.


signature.asc
Description: This is a digitally signed message part.
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

Re: [ewg] Version of OFED in RHEL6?

2010-04-22 Thread Brian J. Murrell
On Wed, 2010-04-21 at 15:50 -0700, Andy Grover wrote: 
> Jon Forrest wrote:
> > What version of OFED should we expect to
> > find in RHEL6?
> 
> It looks like RHEL6 will not include all of OFED, but pick things from 
> OFED's upstream. see https://bugzilla.redhat.com/show_bug.cgi?id=463454
> 
> "All of the SGI package requests are met as of the Beta. However, please 
> note that the packages are pulled from upstream, and not from OFED. 
> Going forward in RHEL6 we will be pulling all InfiniBand related code 
> from upstream (from the upstream Linus kernel for kernel code and from 
> the various upstream package maintainers for individual packages). So if 
> people have specific requests for a certain feature in a certain 
> package, then they need to request that specific package be updated."

So what is the answer to the OP's original question though?  Probably
this is not really a question for this list, but surely, somebody here
knows...  Given the above statement about getting OFED from the upstream
kernel rather than an OFA release, what does that mean in terms of which
actual version of OFED will be in RHEL6?

An additional note on the above mentioned bug notes:

According to the latest builds, the following package version
are in 6.0:

infiniband-diags-1.5.3-1.el6
perftest-1.2.3-1.el6
qperf-0.4.6-1.el6

That first one kinda indicates to me that it might be OFED (core) 1.5.3.
Would that be an unreasonable conclusion?

b.



signature.asc
Description: This is a digitally signed message part
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg

Re: [ewg] Version of OFED in RHEL6?

2010-04-21 Thread Andy Grover
Jon Forrest wrote:
> What version of OFED should we expect to
> find in RHEL6?

It looks like RHEL6 will not include all of OFED, but pick things from 
OFED's upstream. see https://bugzilla.redhat.com/show_bug.cgi?id=463454

"All of the SGI package requests are met as of the Beta. However, please 
note that the packages are pulled from upstream, and not from OFED. 
Going forward in RHEL6 we will be pulling all InfiniBand related code 
from upstream (from the upstream Linus kernel for kernel code and from 
the various upstream package maintainers for individual packages). So if 
people have specific requests for a certain feature in a certain 
package, then they need to request that specific package be updated."

Regards -- Andy
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg


[ewg] Version of OFED in RHEL6?

2010-04-21 Thread Jon Forrest
What version of OFED should we expect to
find in RHEL6?

Cordially,
-- 
Jon Forrest
Research Computing Support
College of Chemistry
173 Tan Hall
University of California Berkeley
Berkeley, CA
94720-1460
510-643-1032
jlforr...@berkeley.edu
___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/ewg