[OMPI devel] Need help on the distribution process

[saisilpa b via devel]

  Hi all, 
I need one help.. 
I am using openmpi library for my project,  which is very old version and uses 
the commands like orterun and orted.. 
I written one script and passing the input in the text file, which has 22lakhs 
lines..  The script has to read one by one and generate output and write it 
into the file.. The process is taking quite a long time. 
If I tired to add multiple hosts for distribution to execute this program then 
each input line read by all the hosts and generate the same output from all the 
hosts..  I am getting duplicate output and it is expected to take additional 
time..  I don't want like that...  Can you please let us know is there anyway 
we can split the work between the hosts..  
Thanks for your help. 
Best regards,  Silpa___
devel mailing list
devel@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/devel

Re: [OMPI devel] hwloc 2 thing

[saisilpa b via devel]

Hi all, 
I need one help.. 
I am using openmpi library for my project,  which is very old version and uses 
the commands like orterun and orted.. 
I written one script and passing the input in the text file, which has 22lakhs 
lines..  The script has to read one by one and generate output and write it 
into the file.. The process is taking quite a long time. 
If I tired to add multiple hosts for distribution to execute this program then 
each input line read by all the hosts and generate the same output from all the 
hosts..  I am getting duplicate output and it is expected to take additional 
time..  I don't want like that...  Can you please let us know is there anyway 
we can split the work between the hosts..  
Thanks for your help. 
Best regards,  Silpa

Sent from Yahoo Mail on Android 
 
  On Sat, Jul 22, 2017 at 6:28 PM, r...@open-mpi.org<r...@open-mpi.org> wrote:  
 You’ll have to be a little clearer than that - what “issues” are you talking 
about?

On Jul 21, 2017, at 10:06 PM, saisilpa b via devel <devel@lists.open-mpi.org> 
wrote:
Hi , Can some one provide the configuration to build the openmpi libraries to 
avoid the issues on ld libraries while running. thanks,silpa   

On Friday, 21 July 2017 8:52 AM, "r...@open-mpi.org" <r...@open-mpi.org> 
wrote:
 

 Yes - I have a PR about cleared that will remove the hwloc2 install. It needs 
to be redone

On Jul 20, 2017, at 8:18 PM, Howard Pritchard <hpprit...@gmail.com> wrote:
Hi Folks,
I'm noticing that if I pull a recent version of master with hwloc 2 support 
into my local repo, that my autogen,pl  run fails unless I do the following:
mkdir $PWD/opal/mca/hwloc/hwloc2x/hwloc/include/private/autogen
where PWD is the top level of my work area.
I did a
git clean -df
but that did not help.
Is anyone else seeing this?
Just curious,
Howard
___
devel mailing list
devel@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/devel

___
devel mailing list
devel@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/devel

   ___
devel mailing list
devel@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/devel

  
___
devel mailing list
devel@lists.open-mpi.org
https://lists.open-mpi.org/mailman/listinfo/devel

Re: [OMPI devel] hwloc 2 thing

[saisilpa b via devel]

Hi , Can some one provide the configuration to build the openmpi libraries to 
avoid the issues on ld libraries while running. thanks,silpa   

On Friday, 21 July 2017 8:52 AM, "r...@open-mpi.org"  
wrote:
 

 Yes - I have a PR about cleared that will remove the hwloc2 install. It needs 
to be redone

On Jul 20, 2017, at 8:18 PM, Howard Pritchard  wrote:
Hi Folks,
I'm noticing that if I pull a recent version of master with hwloc 2 support 
into my local repo, that my autogen,pl  run fails unless I do the following:
mkdir $PWD/opal/mca/hwloc/hwloc2x/hwloc/include/private/autogen
where PWD is the top level of my work area.
I did a
git clean -df
but that did not help.
Is anyone else seeing this?
Just curious,
Howard
___
devel mailing list
devel@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/devel

___
devel mailing list
devel@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/devel

   ___
devel mailing list
devel@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/devel

Re: [OMPI devel] LD_LIBRARY_PATH and environment variables not getting set in remote hosts

[saisilpa b via devel]

HI Gilles,
Thanks for your immediate response.
I am using OpenMPI 1.2.8.tar.bz2 for my project and use orterun and orted 
binaries for distribution perspective.
I built openmpi binaries (orterun, orted) with this option 
--enable-orterun-prefix-by-default , but getting the error on orted that not 
able to find the file in the particular location while running.
we use the below command:orterun  --hostfile ~/hosts -np processes Binary  
.config
if the host file configured to one host then it is working fine.
if we configure to multiple hosts then we are getting the below error from 
remote nodes.
unable to load shared libraries: (this is specific to depend library for the 
application)
Note that: The library paths and environment variables are configured in the 
application config file and it is invoked by .bashrc.
I believe the patch updated for suse Linux is : 3.0.101-0.47.96
Please let me know if you require any specific details to help on this issue. 
Thanks.
Silpa








 

On Thursday, 20 July 2017 3:59 PM, Gilles Gouaillardet 
<gilles.gouaillar...@gmail.com> wrote:
 

 Hi,

you meant Open MPI 1.8.2, right ?


as far as i am concerned, i always configure Open MPI with
--enable-mpirun-prefix-by-default, so i do not need to set
LD_LIBRARY_PATH in my .bashrc

if you want us to investigate this issue, please post the full error message
- is the issue reported by mpirun ? orted ? or the MPI application ?
- should the missing library provided by Open MPI ? the system ? or
the application/a 3rd party library ?
- what is the one patch that caused your app to stop working ?

Cheers,

Gilles

On Thu, Jul 20, 2017 at 6:49 PM, saisilpa b via devel
<devel@lists.open-mpi.org> wrote:
> Hi All,
>
> I am Silpakala and using OpenMPI 1.2.8 for my project. We are using orterun
> and orted binaries to invoke the program exectable from multiple hosts and
> was working successfully. There was one patch applied in Suse Linux, after
> that the program is not working.
>
> We have multiple hosts are configured in NFS. The LD_LIBRARY_PATH and
> environment variables are configured in application configuration file and
> it is getting invoked from  .bashrc.
>
> After the patch installation in Suse Linux, we are getting the error as
> "error while loading shared libraries: cannot open shared libraries: no such
> file or directory"  when the executable try to invoke from remote hosts.
>
> Can you please let us know any solution for the same. Much appreciated for
> your resonse.
>
> Thanks, Silpa
>
> ___
> devel mailing list
> devel@lists.open-mpi.org
> https://rfd.newmexicoconsortium.org/mailman/listinfo/devel


   ___
devel mailing list
devel@lists.open-mpi.org
https://rfd.newmexicoconsortium.org/mailman/listinfo/devel