Dear all I tried to increase speed of a program with openmpi-1.1.3 by adding following 4 parameters into openmpi-mca-params.conf file.
mpi_leave_pinned=1 btl_openib_eager_rdma_num=128 btl_openib_max_eager_rdma=128 btl_openib_eager_limit=1024 and then, I ran my program twice(124 processes on 31 nodes). one with "mpi_leave_pinned=1", another with "mpi_leave_pinned=0". All of them were stopped abnormally with "ctrl+c" and "killall -9 <program>". After that, I couldn't start to run that program again. I checked every nodes with "free -m" and I found that huge amount of cached memory were used in each nodes. Could this situation be caused by those 4 parameters? IS there anyway to free theme? Best regard T. H. Hsieh MS. Student, NTU, Taiwan.