Re: [OMPI users] Icreasing OFED registerable memory

2015-01-08 Thread Waleed Lotfy
Alexandrina From: users [users-boun...@open-mpi.org] on behalf of Gus Correa [g...@ldeo.columbia.edu] Sent: Tuesday, January 06, 2015 9:11 PM To: Open MPI Users Subject: Re: [OMPI users] Icreasing OFED registerable memory Hi Waleed As Devendar said (and I

Re: [OMPI users] Icreasing OFED registerable memory

2015-01-06 Thread Gus Correa
Hi Waleed As Devendar said (and I tried to explain before), you need to allow the locked memory limit to be unlimited for user processes (in /etc/security/limits.conf), *AND* somehow the daemon/job_script/whatever that launches the mpiexec command must request "ulimit -l unlimited" (directly or

Re: [OMPI users] Icreasing OFED registerable memory

2015-01-06 Thread Deva
Can you read this thread and see if following grid engine param setting is missing? http://marc.info/?l=npaci-rocks-discussion=135844781420954=2 --- Check that your GridEngine configuration has the following: execd_params H_MEMORYLOCKED=infinity The command qconf -sconf

Re: [OMPI users] Icreasing OFED registerable memory

2015-01-06 Thread Deva
Hi Waleed, -- Memlock limit: 65536 -- such a low limit should be due to per-user lock memory limit . Can you make sure it is set to "unlimited" on all nodes ( "ulimit -l unlimited")? -Devendar On Tue, Jan 6, 2015 at 3:42 AM, Waleed Lotfy wrote: >

Re: [OMPI users] Icreasing OFED registerable memory

2015-01-06 Thread Waleed Lotfy
Hi guys, Sorry for getting back so late, but we ran into some problems during the installation process and as soon as the system came up I tested the new versions for the problem but it showed another memory related warning.

Re: [OMPI users] Icreasing OFED registerable memory

2014-12-31 Thread Waleed Lotfy
From: users [users-boun...@open-mpi.org] on behalf of Gus Correa [g...@ldeo.columbia.edu] Sent: Tuesday, December 30, 2014 8:01 PM To: Open MPI Users Subject: Re: [OMPI users] Icreasing OFED registerable memory Hi Waleed Even before any OFED upgrades, you could try the items in the list below

Re: [OMPI users] Icreasing OFED registerable memory

2014-12-30 Thread Gus Correa
] on behalf of Deva [devendar.bure...@gmail.com] Sent: Monday, December 29, 2014 8:29 PM To: Open MPI Users Subject: Re: [OMPI users] Icreasing OFED registerable memory Hi Waleed, It is highly recommended to upgrade to latest OFED. Meanwhile, Can you try latest OMPI release (v1.8.4), where

Re: [OMPI users] Icreasing OFED registerable memory

2014-12-30 Thread Waleed Lotfy
From: users [users-boun...@open-mpi.org] on behalf of Deva [devendar.bure...@gmail.com] Sent: Monday, December 29, 2014 8:29 PM To: Open MPI Users Subject: Re: [OMPI users] Icreasing OFED registerable memory Hi Waleed, It is highly recommended to upgrade to latest OFED. Meanwhile, Can you try

Re: [OMPI users] OMPI users] Icreasing OFED registerable memory

2014-12-30 Thread Gilles Gouaillardet
FWIW ompi does not yet support XRC with OFED 3.12. Cheers, Gilles Deva さんのメール: >Hi Waleed, > > >It is highly recommended to upgrade to latest OFED.  Meanwhile, Can you try >latest OMPI release (v1.8.4), where this warning is ignored on older OFEDs > > >-Devendar  >

Re: [OMPI users] Icreasing OFED registerable memory

2014-12-29 Thread Deva
Hi Waleed, It is highly recommended to upgrade to latest OFED. Meanwhile, Can you try latest OMPI release (v1.8.4), where this warning is ignored on older OFEDs -Devendar On Sun, Dec 28, 2014 at 6:03 AM, Waleed Lotfy wrote: > I have a bunch of 8 GB memory nodes in a

[OMPI users] Icreasing OFED registerable memory

2014-12-28 Thread Waleed Lotfy
I have a bunch of 8 GB memory nodes in a cluster who were lately upgraded to 16 GB. When I run any jobs I get the following warning: -- WARNING: It appears that your OpenFabrics subsystem is configured to only allow