Hi Gus, Andrew, list No, I haven't tried 1.8.4. I'll give it a whirl and hope that it fixes the issue.
Thanks, Mike > -----Original Message----- > From: users [mailto:users-boun...@open-mpi.org] On Behalf Of Gus Correa > Sent: Thursday, January 08, 2015 4:45 PM > To: Open MPI Users > Subject: Re: [OMPI users] libpsm_infinipath issues? > > Hi Michael, Andrew, list > > knem is doesn't work in OMPI 1.8.3. > See this thread: > http://www.open-mpi.org/community/lists/users/2014/10/25511.php > > A fix was promised on OMPI 1.8.4: > http://www.open-mpi.org/software/ompi/v1.8/ > > Have you tried it? > > I hope this helps, > Gus Correa > > On 01/08/2015 04:36 PM, Friedley, Andrew wrote: > > Hi Mike, > > > > Have you contacted your admins, or the vendor that provided your True > > Scale and/or PSM installation? E.g. Redhat, or Intel via > > ibsupp...@intel.com <mailto:ibsupp...@intel.com>? They are normally > > the recommended path for True Scale support. > > > > That said, here's some things to look into: > > > > I think it's strange that you're hitting PSM linker problems while > > compiling an app with Open MPI. Normally only the PSM MTL is linked > > directly against PSM. Try verifying that nothing else is linking in > > PSM. Also, it's possible your OMPI build is different from normal too. > > > > PSM has optional KNEM support that can be compiled in, but it's off by > > default and I've never heard of it being used. It's possible that > > your PSM was changed or recompiled and part of your cluster upgrade, > > and the installation isn't quite right. It looks like your PSM was > > compiled with KNEM support, but the KNEM library isn't being linked in > > or is not being found. > > > > Andrew > > > > *From:* users [mailto:users-boun...@open-mpi.org] *On Behalf Of > > *VanEss.Michael > > *Sent:* Thursday, January 8, 2015 1:07 PM > > *To:* us...@open-mpi.org > > *Subject:* [OMPI users] libpsm_infinipath issues? > > > > Hello all, > > > > Our clusters were just upgraded to both a new version of PGI (14.9) as > > well as openmpi (1.8.3). Previous versions were 12.1 and 1.6 > > respectively, and those compiled and linked just fine. The newest > > versions are not linking my mpi applications at all. Here's the problem: > > > > /opt/scyld/openmpi/1.8.3/pgi/bin/mpif90 -C chemcode_mpi.o > > mod_mpichem.o plume_mpi.o amb2D_mpi.o fex.o jex.o use_tuv.o > > run_lsode.o mod_amb.o utmgeo.o lsode.o newamb.o plume.o amb2D.o > > solve.o mod_cdf.o calc_rates.o mod_tuv.o flux.o amb1D.o amb_com.o > > newamb2D.o vs_ccode.o ck_errors.o newamb1D.o doChem.o > mod_lsode.o > > stode.o plume_com.o typeSizes.o netcdf.o mod_parameters.o > mod_chem.o > > runfile.o com_codes.o mod_SLAM.o mod_CPUFF.o calc_za.o > mod_releases.o > > mod_site.o mod_distance.o nuclear_dates.o mod_luparms.o deposition.o > > diffusion.o getTJ.o mod_met.o met_data.o mod_h5tuv.o tuv10.o > > mod_h5camx.o cmxamb.o \ > > > > -L/ensco/apps/cm/CMSOL/linux/zlib-1.2.1/lib > > -L/ensco/apps/cm/CMSOL/linux/szip-2.1/lib -o \ > > > > chemcode_mpi -L/opt/pgi/linux86-64/14.9/lib -lpgf90 > > -lpgf90rtl \ > > > > -L/ensco/apps/cm/CMSOL/linux/hdf5-1.8.3/lib -lhdf5_fortran -l > > hdf5 -lz -lm > > > > /usr/lib64/libpsm_infinipath.so.1: undefined reference to `knem_put' > > > > /usr/lib64/libpsm_infinipath.so.1: undefined reference to > `knem_open_device' > > > > /usr/lib64/libpsm_infinipath.so.1: undefined reference to `knem_get' > > > > /usr/lib64/libpsm_infinipath.so.1: undefined reference to > > `knem_register_region' > > > > I've searched the net for any information on this and nothing has > > seemed to help. I'm fairly confident that all my variables and paths > > to the new software is correct. > > > > Any ideas? > > > > Regards, > > > > Mike > > > > ---------------------------------------------------------------------- > > -- > > > > The information contained in this email message is intended only for > > the use of the individual(s) to whom it is addressed and may contain > > information that is privileged and sensitive. If you are not the > > intended recipient, or otherwise have received this communication in > > error, please notify the sender immediately by email at the above > > referenced address and note that any further dissemination, > > distribution or copying of this communication is strictly prohibited. > > > > The U.S. Export Control Laws regulate the export and re-export of > > technology originating in the United States. This includes the > > electronic transmission of information and software to foreign > > countries and to certain foreign nationals. Recipient agrees to abide > > by these laws and their regulations -- including the U.S. Department > > of Commerce Export Administration Regulations and the U.S. Department > > of State International Traffic in Arms Regulations -- and not to > > transfer, by electronic transmission or otherwise, any content derived > > from this email to either a foreign national or a foreign destination > > in violation of such laws. > > > > > > > > _______________________________________________ > > users mailing list > > us...@open-mpi.org > > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > > Link to this post: > > http://www.open-mpi.org/community/lists/users/2015/01/26135.php > > > > _______________________________________________ > users mailing list > us...@open-mpi.org > Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/users > Link to this post: http://www.open- > mpi.org/community/lists/users/2015/01/26136.php The information contained in this email message is intended only for the use of the individual(s) to whom it is addressed and may contain information that is privileged and sensitive. If you are not the intended recipient, or otherwise have received this communication in error, please notify the sender immediately by email at the above referenced address and note that any further dissemination, distribution or copying of this communication is strictly prohibited. The U.S. Export Control Laws regulate the export and re-export of technology originating in the United States. This includes the electronic transmission of information and software to foreign countries and to certain foreign nationals. Recipient agrees to abide by these laws and their regulations -- including the U.S. Department of Commerce Export Administration Regulations and the U.S. Department of State International Traffic in Arms Regulations -- and not to transfer, by electronic transmission or otherwise, any content derived from this email to either a foreign national or a foreign destination in violation of such laws.
