What is the NIC you use? What OFED build? Are you sure about wellness of provider lib/drivers..?
It is strange that you get out of mem in all to all tests... should not happen on 32G system,..!!! -polk. On 4/23/09, viral....@gmail.com <viral....@gmail.com> wrote: > > or any link which helps to understand system reuirement for certain test > scenario .. > > On Apr 23, 2009 12:42pm, viral....@gmail.com wrote: > > Hi > > Thanks for your response. > > However, I am running > > mpiexec .... -ppn 24 -n 192 /opt/IMB-MPI1 alltaoll -msglen /root/temp > > > > And file /root/temp contains entry upto 65535 size only. That means > alltoall test will run upto 65K size only > > > > So, in that case I will require very less memory but then in that case > also test is running out-of-memory. Please help someone to understand the > scenario. > > Or do I need to switch to some algorithm or do I need to set some other > environment variables ? or anything like that ? > > > > On Apr 22, 2009 6:43pm, Ashley Pittman ash...@pittman.co.uk> wrote: > > > On Wed, 2009-04-22 at 12:40 +0530, vkm wrote: > > > > > > > > > > > > > The same amount of memory required for recvbuf. So at the least each > > > > > > > node should have 36GB of memory. > > > > > > > > > > > > > > Am I calculating right ? Please correct. > > > > > > > > > > > > Your calculation looks correct, the conclusion is slightly wrong > > > > > > however. The Application buffers will consume 36Gb of memory, the rest > > > > > > of the application, any comms buffers and the usual OS overhead will be > > > > > > on top of this so putting only 36Gb of ram in your nodes will still > > > > > > leave you short. > > > > > > > > > > > > Ashley, > > > > > > > > > > > _______________________________________________ > users mailing list > us...@open-mpi.org > http://www.open-mpi.org/mailman/listinfo.cgi/users >
