Quoting r. Sean Hefty <[EMAIL PROTECTED]>:
> If you look at Woody's backport patches, I believe that he moves the RDMA CM
> files to /sys/class/infiniband/rdma_cm and updates the librdmacm to read the
> abi_version from there.
Maybe the librdmacm part should be merged to svn?
So librdmacm could tr
Quoting r. Sean Hefty <[EMAIL PROTECTED]>:
> And even with these proposed changes, there's a race condition where the CM
> can timeout a connection after data is received over it, but before this event
> can be processed.
Hmm. And what happens then?
--
MST
__
>I have some rdma_cm test code and when I run with the OFED 1.1 code (running on
>2.6.9 U3 based kernel) I got the following error.
>
>librdmacm: couldn't read ABI version.
>librdmacm: assuming: 2
The RDMA CM places the abi_version file in /sys/class/misc/rdma_cm. The misc
class didn't exist in 2
This patch makes libipathverbs backward compatible with old ib_ipath kernel
drivers.
Signed-off-by: Ralph Campbell <[EMAIL PROTECTED]>
Index: src/userspace/libipathverbs/src/verbs.c
===
--- src/userspace/libipathverbs/src/verbs.c
On Wed, Aug 23, 2006 at 04:25:38PM -0700, Roland Dreier wrote:
> Greg, please pull from
>
> master.kernel.org:/pub/scm/linux/kernel/git/roland/infiniband.git
> for-linus
>
> This tree is also available from kernel.org mirrors at:
>
> git://git.kernel.org/pub/scm/linux/kernel/git/roland/
I have some rdma_cm test code and when I run with the OFED 1.1 code (running on
2.6.9 U3 based kernel) I got the following error.
librdmacm: couldn't read ABI version.
librdmacm: assuming: 2
The code seems to run (as it really does nothing) fine but I was wondering if I
could fix this just to cle
>Actually, that leads me to a question: does the vendor of that adaptor
>say that this is actually safe?
I believe so.
>most of the time doesn't mean it does it all of the time. So it it
>really smart to write non-standard-conforming programs unless the
>vendor stands behind that behavior?
I'm n
Greg> Actually, that leads me to a question: does the vendor of
Greg> that adaptor say that this is actually safe? Just because
Greg> something behaves one way most of the time doesn't mean it
Greg> does it all of the time. So it it really smart to write
Greg> non-standard-confo
On Wed, Aug 23, 2006 at 09:29:18AM -0700, Sean Hefty wrote:
> I don't believe that there is any ordering guarantee by the architecture.
> However, specific adapters may behave this way, and I've seen applications
> make
> use of this by polling the last memory byte for a completion, for example
Greg, please pull from
master.kernel.org:/pub/scm/linux/kernel/git/roland/infiniband.git for-linus
This tree is also available from kernel.org mirrors at:
git://git.kernel.org/pub/scm/linux/kernel/git/roland/infiniband.git
for-linus
to get a few fixes for the 2.6.18 tree:
Jack Morgens
>Donnu. I'm just speaking on the general principle that we should deny by
>default, not allow by default. Which queries do you want to perform?
At a minimum, I would expect the following queries:
PathRecord
MultiPathRecord
MCMemberRecord
ServiceRecord
Support for ServiceRecord set/delete and In
Ralph> Not quite. If the kernel driver is old, libipathverbs is
Ralph> using the old functions which make system calls instead of
Ralph> doing the newer mmap stuff. libipathverbs doesn't need to
Ralph> attempt calling mmap() if it knows the driver doesn't
Ralph> support it.
You
On Wed, 2006-08-23 at 14:50 -0700, Roland Dreier wrote:
> I applied this, but I'm wondering if this:
>
> > +int ipath_resize_cq(struct ibv_cq *ibcq, int cqe)
> > {
> > + struct ipath_cq*cq = to_icq(ibcq);
> > + struct ibv_resize_cqcmd;
> > + struct ipath_resize
Roland Dreier wrote:
> It's unfortunate that we have to add a special-case event hook for the
> CM, but I guess the iWARP CM changes are so ugly anyway it doesn't
> matter much. So I think committing this is OK.
We also have the alternative of pushing the responsibility of notifying the CM
of th
Thanks, applied.
___
openib-general mailing list
openib-general@openib.org
http://openib.org/mailman/listinfo/openib-general
To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Quoting r. Sean Hefty <[EMAIL PROTECTED]>:
> Subject: Re: [PATCH] libibsa: userspace SA query and multicast support
>
> > Yea I had the same question. Shouldn't interface expose
> > just the specific queries that we need?
>
> I don't know what queries a user will want, and I'd rather not change t
I applied this, but I'm wondering if this:
> +int ipath_resize_cq(struct ibv_cq *ibcq, int cqe)
> {
> +struct ipath_cq*cq = to_icq(ibcq);
> +struct ibv_resize_cqcmd;
> +struct ipath_resize_cq_resp resp;
> +size_t size;
Thanks, applied.
___
openib-general mailing list
openib-general@openib.org
http://openib.org/mailman/listinfo/openib-general
To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Quoting r. Roland Dreier <[EMAIL PROTECTED]>:
> Subject: Re: [PATCH] mthca: various bug fixes for mthca_query_qp
>
> Michael> The other four bullets make sense however, do they not?
>
> I guess so, although I wonder if anyone will ever care about the
> sq_sig_type() field.
It's not in IB spe
> Yea I had the same question. Shouldn't interface expose
> just the specific queries that we need?
I don't know what queries a user will want, and I'd rather not change the
kernel
ABI with every new query, but that is a possibility. Which queries are of
concern?
- Sean
_
Quoting r. Greg Lindahl <[EMAIL PROTECTED]>:
> Subject: Re: Rollup patch for ipath and OFED
>
> On Wed, Aug 23, 2006 at 06:01:32PM +0300, Michael S. Tsirkin wrote:
>
> > So this seems to be ripping out chunks of upstream code (ipath_ht400)
> > replacing them with something else (ipath_iba6110, ip
Michael> The other four bullets make sense however, do they not?
I guess so, although I wonder if anyone will ever care about the
sq_sig_type() field.
- R.
___
openib-general mailing list
openib-general@openib.org
http://openib.org/mailman/listinf
Sean> The ibv_sa_send_mad() routine can only be used to issue the
Sean> following methods:
Sean> GET, SEND, GET_TABLE, GET_MULTI, and GET_TRACE_TABLE
OK, I missed that -- it's kind of hidden inside is_send_req().
- R.
___
openib-general m
Thanks, queued for 2.6.19
___
openib-general mailing list
openib-general@openib.org
http://openib.org/mailman/listinfo/openib-general
To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Quoting r. Roland Dreier <[EMAIL PROTECTED]>:
> Subject: Re: [PATCH] libibsa: userspace SA query and multicast support
>
> What's the plan for how this would be used? We can't let unprivileged
> userspace processes talk to the SA, because they could cause problems
> like deleting someone else's m
Roland Dreier wrote:
> What's the plan for how this would be used? We can't let unprivileged
> userspace processes talk to the SA, because they could cause problems
> like deleting someone else's multicast group membership. And I don't
> think we want to try to do some elaborate filtering in the
Thanks, applied and queued for 2.6.19.
___
openib-general mailing list
openib-general@openib.org
http://openib.org/mailman/listinfo/openib-general
To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
Quoting r. Roland Dreier <[EMAIL PROTECTED]>:
> Subject: Re: [PATCH] mthca: various bug fixes for mthca_query_qp
>
> > 5. Return the send_cq, receive cq and srq handles.
>
> I really disagree with this change.
The other four bullets make sense however, do they not?
--
MST
__
What's the plan for how this would be used? We can't let unprivileged
userspace processes talk to the SA, because they could cause problems
like deleting someone else's multicast group membership. And I don't
think we want to try to do some elaborate filtering in the kernel, do we?
- R.
__
> Please consider the following for 2.6.18 - hopefully this will reduce
> the number of support requests from people with old Sinai firmware.
Makes sense -- this is the sort of thing we want as current as
possible. Applied to svn and for-2.6.18
___
o
> > It gives the page size for the user memory described by the struct.
> > The idea was that if/when someone tries to optimize for huge pages,
> > then the low-level driver can know that a region is using huge pages
> > without having to walk through the page list and search for the
> > minim
> 5. Return the send_cq, receive cq and srq handles. ib_query_qp() needs them
>(required by IB Spec). ibv_query_qp() overwrites these values in
> user-space
>with appropriate user-space values.
> +qp_init_attr->send_cq = ibqp->send_cq;
> +qp_init_attr->recv_cq =
Sean> This patch set appears to be the preferred approach. Any
Sean> objection to committing this?
It's unfortunate that we have to add a special-case event hook for the
CM, but I guess the iWARP CM changes are so ugly anyway it doesn't
matter much. So I think committing this is OK.
-
On Wed, 2006-08-23 at 14:00 -0500, Tang, Changqing wrote:
> Thanks for all your replies. So my general question is, why only 4bytes
> immediate data can
> Generate completion event on B side, Why RDMA-write with any data size
> does not generate
> A completion event on B side? basic there are the s
Hi Hal,
On 01:34 Wed 23 Aug , Sasha Khapyorsky wrote:
> On 18:26 Tue 22 Aug , Hal Rosenstock wrote:
> > On Tue, 2006-08-22 at 18:22, Sasha Khapyorsky wrote:
> > > On 17:54 Tue 22 Aug , Hal Rosenstock wrote:
> > > > Hi Sasha,
> > > >
> > > > On Tue, 2006-08-22 at 17:18, Sasha Khapyorsk
Thanks for all your replies. So my general question is, why only 4bytes
immediate data can
Generate completion event on B side, Why RDMA-write with any data size
does not generate
A completion event on B side? basic there are the same thing, the only
different is, one
Copy 4bytes to completion str
On Wed, 2006-08-23 at 12:28 -0500, Tang, Changqing wrote:
> >
> >Actually, A knows the data is in B's memory when A gets the
> >completion notice. B can't rely on anything unless A uses the
> >RDMA write with immediate which puts a completion event in B's CQ.
>
> Ralph:
>
> Can you give a few
Bryan O'Sullivan wrote:
> SVN is not a high priority for me personally. Fixing things so that I
> can send meaningful patches upstream in a timely manner us.
Why not remove your code from SVN?
- Sean
___
openib-general mailing list
openib-general@open
On Wed, 2006-08-23 at 10:58 -0700, Woodruff, Robert J wrote:
> I hate to tell you I told you so, but this is exactly why you guys
> should not be off working behind closed doors and then submit some
> mongo patch.
That's precisely what I'm working to avoid. It's not as if I didn't
know this.
>
Bryan wrote,
>On Wed, 2006-08-23 at 18:01 +0300, Michael S. Tsirkin wrote:
>> Guys, I just looked at ipath-fixes.patch in ofed. With 36 files
changed, 4623
>> insertions, 4774 deletions, it's quite a biggie with no description
what it does
>> whatsoever. Can't this be split to smaller chunks doi
Tang, Changqing wrote:
> Can you give a few more words on 'immediate', I know A will have
> A completion event in its CQ, Does B receive a CQ event on the
> Same RDMA operation as well ?
He means and RDMA write with immediate data. B will see a completion event for
that operation.
- Sean
>
>Actually, A knows the data is in B's memory when A gets the
>completion notice. B can't rely on anything unless A uses the
>RDMA write with immediate which puts a completion event in B's CQ.
Ralph:
Can you give a few more words on 'immediate', I know A will have
A completion event in its
Woody wrote,
>Ok, I was able to install the RC2 on EL4-U3 and get intel MPI working
on uDAPL.
>Did have one issue with the install that maybe you could fix for the
next
>RC. It appears that the rdma_ucm and rdma_cm are not being loaded at
startup
>time and I had to manually modprobe rdma_ucm, after
Sean Hefty wrote:
> The following set of patches forwards communication related events to the IB
> CM
> for processing. Communication events of interest are communication
> established
> and path migration, with only the former is currently handled by the IB CM.
>
> This removes the need for us
On Wed, 2006-08-23 at 09:47 -0700, Caitlin Bestler wrote:
> [EMAIL PROTECTED] wrote:
> > Quoting r. john t <[EMAIL PROTECTED]>:
> >> Subject: basic IB doubt
> >>
> >> Hi
> >>
> >> I have a very basic doubt. Suppose Host A is doing RDMA write (say 8
> >> MB) to Host B. When data is copied into Hos
Hi Eitan,
> Who is freeing the request MAD?
> If it is NULL then the flow aborts earlier.
Sorry; My bad :-(
-- Hal
___
openib-general mailing list
openib-general@openib.org
http://openib.org/mailman/listinfo/openib-general
To unsubscribe, please vi
Or Gerlitz wrote:
> I have tested the patch against an iser target based on our Gen1 CM -
> it works as expected.
This has been committed in 9088.
- Sean
___
openib-general mailing list
openib-general@openib.org
http://openib.org/mailman/listinfo/openi
[EMAIL PROTECTED] wrote:
> Quoting r. john t <[EMAIL PROTECTED]>:
>> Subject: basic IB doubt
>>
>> Hi
>>
>> I have a very basic doubt. Suppose Host A is doing RDMA write (say 8
>> MB) to Host B. When data is copied into Host B's local
> buffer, is it guaranteed that data will be copied starting
>
Michael S. Tsirkin wrote:
> so I am wandering why is it not sufficient to wait for
> the window of time as described above to expire?
> Is something broken in CM that this patch is papering over?
Yes. There are a couple of issues. The CM doesn't time when a REQ was
received, and the local comm
Or Gerlitz wrote:
> OK. Now, if this (RC, UD, MCAST) turns to be too much for your
> schedule before 2.6.19 opens up, does it make sense for you to push a
> char device which supports only the CMA RC functionality and the UD
> and multicast in the future?
Yes - and the fact that I can pull the OF
On Wed, Aug 23, 2006 at 06:01:32PM +0300, Michael S. Tsirkin wrote:
> So this seems to be ripping out chunks of upstream code (ipath_ht400)
> replacing them with something else (ipath_iba6110, ipath_iba6120.o)
To answer this piece of the question, we were acquired last April, and
of course we hav
john t wrote:
> I have a very basic doubt. Suppose Host A is doing RDMA write (say 8
> MB) to Host B. When data is copied into Host B's local buffer, is it
> guaranteed that data will be copied starting from the first location
> (first buffer address) to the last location (last buffer address)?
With the OFED1.1-rc2 when I run the RDMA CM on RedHat EL4 - Update 3
I get the following warning. The application seems to work OK,
but the warnings are concerning.
librdmacm: couldn't read ABI version.
librdmacm: assuming: 1
It appears that the backport of the kernel module does not create th
Fixed various bugs in mthca_query_qp:
1. correct port_num was not being returned for unconnected QPs.
2. Incorrect number of bits was taken for static_rate field.
3. When default static rate is returned for Tavor, forgot to translate it
to an ib rate value.
4. Return sq signalling attribute in q
Who is freeing the request MAD?
If it is NULL then the flow aborts earlier.
> -Original Message-
> From: Hal Rosenstock [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, August 23, 2006 6:35 PM
> To: Eitan Zahavi
> Cc: openib-general@openib.org
> Subject: Re: [PATCH] osm: fix memory leak in ve
Hi Eitan,
I'm not getting openib-general email today but got this off a web site:
Index: libvendor/osm_vendor_ibumad_sa.c
===
--- libvendor/osm_vendor_ibumad_sa.c(revision 9087)
+++ libvendor/osm_vendor_ibumad_sa.c(working co
On Wed, 2006-08-23 at 18:01 +0300, Michael S. Tsirkin wrote:
> Guys, I just looked at ipath-fixes.patch in ofed. With 36 files changed, 4623
> insertions, 4774 deletions, it's quite a biggie with no description what it
> does
> whatsoever. Can't this be split to smaller chunks doing one thing at
Guys, I just looked at ipath-fixes.patch in ofed. With 36 files changed, 4623
insertions, 4774 deletions, it's quite a biggie with no description what it does
whatsoever. Can't this be split to smaller chunks doing one thing at a time,
please? You'll have to do this for upstream inclusion anyway
Quoting r. Or Gerlitz <[EMAIL PROTECTED]>:
> Subject: Re: [PATCH] ib_cm: randomize starting local comm IDs
>
> On 8/23/06, Michael S. Tsirkin <[EMAIL PROTECTED]> wrote:
> > Quoting r. Or Gerlitz <[EMAIL PROTECTED]>:
>
> > > So the CM at the target side rejects the first REQ after the client
> > >
On 8/23/06, Michael S. Tsirkin <[EMAIL PROTECTED]> wrote:
> Quoting r. Or Gerlitz <[EMAIL PROTECTED]>:
> > So the CM at the target side rejects the first REQ after the client
> > reboot with STALE reason (and deliveres a disconnect event to the
> > ULP). The second REQ is processed fine and a new
Sean Hefty wrote:
> Randomize the starting local comm ID to avoid getting a rejected connection
> due to a stale connection after a system reboot or reloading of the ib_cm.
Hi Sean,
As i wrote you patching the CM it works fine and the problem i could
reproduce with our iser target is solved.
Ho
Quoting r. Or Gerlitz <[EMAIL PROTECTED]>:
> Subject: Re: [PATCH] ib_cm: randomize starting local comm IDs
>
> On 8/22/06, Sean Hefty <[EMAIL PROTECTED]> wrote:
> > Randomize the starting local comm ID to avoid getting a rejected connection
> > due to a stale connection after a system reboot or re
Hi Hal
These are two trivial fixes for memory leaks in the
ibumad vendor.
Thanks
Eitan
Signed-off-by: Eitan Zahavi <[EMAIL PROTECTED]>
Index: libvendor/osm_vendor_ibumad_sa.c
===
--- libvendor/osm_vendor_ibumad_sa.c(revision
On 8/22/06, Sean Hefty <[EMAIL PROTECTED]> wrote:
> >What about pushing the char device to support user space CMA, i recall
> >that you have mentioned the API was not mature enough when the 2.6.18
> >feature merge window was open.
>
> I will look at doing this. I need to verify what functionality
On 8/23/06, Sean Hefty <[EMAIL PROTECTED]> wrote:
> To recap (since it's been a couple of weeks), we have two general solutions
> for
> how to support the passive/server/target side of a connection:
>
> 1. One method requires that the passive side queue send WRs until they get a
> connection estab
On 8/23/06, john t <[EMAIL PROTECTED]> wrote:
> What does the config option
> "CONFIG_INFINIBAND_ADDR_TRANS=y" indicate? The code does
> not seem to use this.
No, the code does use it to build and install the rdma_cm (CMA)
and the ib_addr modules, see linux-2.6.18-rc4/drivers/infiniband/core/Make
Quoting r. john t <[EMAIL PROTECTED]>:
> Subject: CONFIG_INFINIBAND_ADDR_TRANS
>
> Hi,
>
> What does the config option "CONFIG_INFINIBAND_ADDR_TRANS=y" indicate? The
> code does not seem to use this.
>
> Regards,
> John T.
Builds CMA modules.
--
MST
___
On 8/22/06, Sean Hefty <[EMAIL PROTECTED]> wrote:
> Randomize the starting local comm ID to avoid getting a rejected connection
> due to a stale connection after a system reboot or reloading of the ib_cm.
Hi Sean,
I have tested the patch against an iser target based on our Gen1 CM -
it works as e
Hi,
What does the config option "CONFIG_INFINIBAND_ADDR_TRANS=y" indicate? The code does not seem to use this.
Regards,
John T.
___
openib-general mailing list
openib-general@openib.org
http://openib.org/mailman/listinfo/openib-general
To unsubscribe
Quoting r. Roland Dreier <[EMAIL PROTECTED]>:
> Subject: Re: question: ib_umem page_size
>
> Michael> Roland, could you please clarify what does the page_size
> Michael> field in struct ib_mem do?
>
> It gives the page size for the user memory described by the struct.
> The idea was that
On Fri, 2006-08-18 at 15:23 +0200, Robert Rex wrote:
> Hello,
>
> I've also worked on the same topic. Here is what I've done so far as I
> successfully tested it on mthca and ehca. I'd appreciate for comments and
> suggestions.
>
> + down_read(¤t->mm->mmap_sem);
> + if (is_vm_hugetlb_p
http://openib.org/bugzilla/show_bug.cgi?id=203
[EMAIL PROTECTED] changed:
What|Removed |Added
Severity|major |critical
Summary|Crash on shu
Yes, I have reproduced the connection refusal problem and I am looking into it.
Thanks!
MST
Quoting r. zhu shi song <[EMAIL PROTECTED]>:
Subject: Re: why sdp connections cost so much memory
I haven't met kernel crashes using rc2. But there
always occurred connection refusal when max concurrent
http://openib.org/bugzilla/show_bug.cgi?id=203
[EMAIL PROTECTED] changed:
What|Removed |Added
CC||[EMAIL PROTECTED]
--- Comment #1
I haven't met kernel crashes using rc2. But there
always occurred connection refusal when max concurrent
connections set above 200. All is right when max
concurrent connections is set to below 200. ( If
using TCP to take the same test, there is no problem.)
(1)
This is ApacheBench, Version 2.0.41
75 matches
Mail list logo
