You may find additional information here :
https://svn.open-mpi.org/trac/ompi/ticket/1900
Using the information there you may calculate actual memory consumption.
Pavel (Pasha) Shamis
---
Application Performance Tools Group
Computer Science and Math Division
Oak Ridge National Laboratory
On
On 13-Jan-12 12:23 AM, Nathan Hjelm wrote:
> I would start by adjusting btl_openib_receive_queues . The default uses
> a per-peer QP which can eat up a lot of memory. I recommend using no
> per-peer and several shared receive queues.
> We use S,4096,1024:S,12288,512:S,65536,512
And here's the FAQ
I would start by adjusting btl_openib_receive_queues . The default uses a
per-peer QP which can eat up a lot of memory. I recommend using no per-peer and
several shared receive queues. We use S,4096,1024:S,12288,512:S,65536,512
-Nathan
On Thu, 12 Jan 2012, V. Ram wrote:
Open MPI IB Gurus,
I
Open MPI IB Gurus,
I have some slightly older InfiniBand-equipped nodes with IB which have
less RAM than we'd like, and on which we tend to run jobs that can span
16-32 nodes of this type. The jobs themselves tend to run on the heavy
side in terms of their own memory requirements.
When we used t
