hi there,

on redhat things work a little different. in particular there are separate 
packages for mpi.


you have to install opm-simulators-openmpi-bin


and load the mpi/openmpi-x86_64 module in the shell where you want to execute 
flow.


arnem

________________________________
Fra: saudiara...@gmail.com <saudiara...@gmail.com> på vegne av sindimo 
<sind...@gmail.com>
Sendt: 4. mai 2018 11:15:36
Til: Arne Morten Kvarving; opm@opm-project.org
Emne: Re: [Opm] OPM Flow RedHat 7 Binary Package Build with MPI Support

Hi Arne,

Thank you for your clarification, I really appreciate it.

I have updated to the latest OPM release of Flow 2018.04 and tested again on 
RedHat 7. I still don't see any performance improvement with the new RedHat 7 
binaries as if MPI was still not working. On Ubuntu it works fine.

For example I ran the Norne model once on 1 processor and once on 2 processors 
on the RedHat 7 machine and the Ubuntu machine (identical machines on Amazon 
AWS m4.2xlarge instances) and these are the timings I get:


Norne on RedHat:
1 processor:  769.437 seconds
2 processors: 839.285 seconds

Norne on Ubuntu:
1 processor:  889.158 seconds
2 processors: 585 seconds


If I do "top" command on RedHat while job is launched on 2 processors, I can 
see 2 processors running. However it doesn't seem that they are running in 
parallel, it seems as if each process is running a separate serial copy of 
flow, hence the run on 2 processors is even slower than the serial run.

Also a quick check using "ldd" on the flow binaries on both Ubuntu and RedHat 
shows that the Ubuntu executable is indeed linked to the MPI library, while the 
RedHat binary still doesn't show any linked MPI libraries:


On Ubuntu:

ubuntu@ip-172-31-15-200:~$ ldd /usr/bin/flow | grep -i mpi
libmpi_cxx.so.1 => /usr/lib/libmpi_cxx.so.1 (0x00007f350423c000)
libmpi.so.12 => /usr/lib/libmpi.so.12 (0x00007f3503f66000)


On RedHat:

[ec2-user@ip-172-31-15-201 ~]$ ldd /usr/bin/flow | grep mpi
[ec2-user@ip-172-31-15-201 ~]$

[ec2-user@ip-172-31-15-201 ~]$ rpm -qa | grep opm
libopm-common1-2018.04-0.x86_64
opm-upscaling-devel-2018.04-0.x86_64
opm-simulators-bin-2018.04-0.x86_64
libopm-grid1-2018.04-0.x86_64
libopm-upscaling1-2018.04-0.x86_64
libopm-simulators1-2018.04-0.x86_64
opm-upscaling-2018.04-0.x86_64


I would appreciate any help with this please to get the parallel version of 
Flow working on RedHat.

Thank you for all of your help.

Sincerely,

Mohamad


On Thu, Apr 26, 2018 at 2:26 AM, Arne Morten Kvarving 
<arne.morten.kvarv...@sintef.no<mailto:arne.morten.kvarv...@sintef.no>> wrote:

hi,


currently the rpm's are not mpi enabled. this will change in the upcoming 
2018.04 release.


it's a bit involved building on rhel, as you need some packages not in base or 
epel. in particular, you need to trilinos (or rather, just zoltan which is part 
of trilinos) to get efficient mpi support, as well as dune and such. if it's 
not extremely pressing i would suggest waiting for the release.


arnem

________________________________
Fra: Opm <opm-boun...@opm-project.org<mailto:opm-boun...@opm-project.org>> på 
vegne av M. S. <sind...@gmail.com<mailto:sind...@gmail.com>>
Sendt: 25. april 2018 22:46:33
Til: opm@opm-project.org<mailto:opm@opm-project.org>
Emne: [Opm] OPM Flow RedHat 7 Binary Package Build with MPI Support

Dear All,

I am interested in running OPM Flow with MPI support on RedHat 7.

I've installed the binary packages on 2 different machines, one with RedHat 7 
and the other with Ubuntu 16.04 using these instructions:

https://opm-project.org/?page_id=245

The Ubuntu packages ran fine with MPI and I can see performance improvement 
when running some of the SPE models, however the RedHat 7 version doesn't seem 
to have been built with MPI support.

RedHat 7 currently has native mpi package that can be easily installed by yum 
(based on mpich-3):

sudo yum -y install mpich-devel

Would someone be able please to build the Flow binaries for RedHat 7 with MPI 
support, or perhaps if they already exist can you please point me to where to 
get them?

I attempted building from source code but the Flow third party library 
prerequisite installation seems overwhelming.

If anyone already has their RedHat 7 build environment setup and would be able 
to help I would truly appreciate it. From the instructions on the website, it 
says to enable MPI support you just need to pass this option to cmake during 
the build “-DUSE_MPI=1” .

Thank you for all of your help, I really appreciate it.

Sincerely,

Mohamad Sindi
MIT

_______________________________________________
Opm mailing list
Opm@opm-project.org
https://opm-project.org/cgi-bin/mailman/listinfo/opm

Reply via email to