Thanks for your reply:) Follow your advice I tried to set the TMPDIR to /var/tmp and /dev/shm and even reset to /tmp (I get the system permission), the problem still occur (CPU utilization still lower than 20%). I have no idea why and ready to give up OpenMPI instead of using other MPI library.
--------Old Message------------- List-Post: users@lists.open-mpi.org Date: Tue, 21 Oct 2014 22:21:31 -0400 From: Brock Palen <bro...@umich.edu> To: Open MPI Users <us...@open-mpi.org> Subject: Re: [OMPI users] low CPU utilization with OpenMPI Message-ID: <cc54135d-0cfe-440a-8df2-06b587e17...@umich.edu> Content-Type: text/plain; charset=us-ascii Doing special files on NFS can be weird, try the other /tmp/ locations: /var/tmp/ /dev/shm (ram disk careful!) Brock Palen www.umich.edu/~brockp CAEN Advanced Computing XSEDE Campus Champion bro...@umich.edu (734)936-1985 > On Oct 21, 2014, at 10:18 PM, Vinson Leung <lwhvinson1...@gmail.com> wrote: > > Because of permission reason (OpenMPI can not write temporary file to the default /tmp directory), I change the TMPDIR to my local directory (export TMPDIR=/home/user/tmp ) and then the MPI program can run. But the CPU utilization is very low under 20% (8 MPI rank running in Intel Xeon 8-core CPU). > > And I also got some message when I run with OpenMPI: > [cn3:28072] 9 more processes have sent help message help-opal-shmem-mmap.txt / mmap on nfs > [cn3:28072] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages > > Any idea? > Thanks > > VIncent > _______________________________________________ > users mailing list > us...@open-mpi.org > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > Link to this post: http://www.open-mpi.org/community/lists/users/2014/10/25548.php