Thanks for the info. Looking at the config.log file, I can see it is trying several different ways to look for libhcoll. Here's one of them:
configure:274258: gcc -std=gnu99 -std=gnu99 -o conftest -O3 -DNDEBUG -finline-functions -fno-strict-aliasing -mcx16 -pthread -I/install/u/tjcw/workspace/ompi/build/opal/mca/event/libevent2022/libevent/include -I/install/u/tjcw/workspace/ompi/opal/mca/event/libevent2022/libevent -I/install/u/tjcw/workspace/ompi/opal/mca/event/libevent2022/libevent/include -I/install/u/tjcw/workspace/ompi/build/opal/mca/hwloc/hwloc201/hwloc/include -I/install/u/tjcw/workspace/ompi/opal/mca/hwloc/hwloc201/hwloc/include -I/install/u/tjcw/workspace/ibm_smpi_toucan_ucx/ompibase/dependencies/mofed_400/opt/mellanox/hcoll/include -L/install/u/tjcw/workspace/ibm_smpi_toucan_ucx/ompibase/dependencies/mofed_400/opt/mellanox/hcoll/lib64 conftest.c -lhcoll -lrt -lm -lutil -lz >&5 Notably, it is look for libhcoll in /install/u/tjcw/workspace/ibm_smpi_toucan_ucx/ompibase/dependencies/mofed_400/opt/mellanox/hcoll/lib64, and it apparently finds it, because then it complains that libhcoll is looking for "sharp" symbols: /install/u/tjcw/workspace/ibm_smpi_toucan_ucx/ompibase/dependencies/bin/ld: warning: libsharp_coll.so.2, needed by /install/u/tjcw/workspace/ibm_smpi_toucan_ucx/ompibase/dependencies/mofed_400/opt/mellanox/hcoll/lib64/libhcoll.so, not found (try using -rpath or -rpath-link) This is no surprise, because in your original email, you said "One of my fellow developers at IBM is having problems building OpenMPI 4. The 'configure' command is failing trying to set up the mca hcoll '.so'. The error message is to the effect that libsharp.so is missing. Looking by hand, the sharp library is in the expected place in the MOFED install." Where exactly is the sharp library located? It apparently isn't in /install/u/tjcw/workspace/ibm_smpi_toucan_ucx/ompibase/dependencies/mofed_400/opt/mellanox/hcoll/lib64 (or lib). That's why configure is failing -- even if lib sharp is where you expect it to be, if a) it's not in default linker search paths, and b) Open MPI doesn't know where it is to list it in manual linker search paths, then the configure test will fail (as would linking later during the build process). If you need to add arbitrary directories to the linker search path, one way you can do it is like this: ./configure LDFLAGS=-L/additional/linker/path/to/search ... Sidenote: it's a little odd that you're using /install/u/tjcw/workspace/ibm_smpi_toucan_ucx/ompibase/dependencies/bin/ld -- is that expected? On Oct 15, 2019, at 5:23 AM, Chris Ward <t...@uk.ibm.com<mailto:t...@uk.ibm.com>> wrote: I have put the tarball requested on my web site here http://tjcw.freeshell.org/ompi-output.tar.bz2 ; it is too large to be posted to the mailing list. It has a 'typescript' from running configure, and the config.log file. My 'configure' command was ../configure --prefix=/install/u/tjcw/workspace/ompi_install --enable-shared --enable-mca-no-build=btl-uct --disable-static --enable-mpi-fortran=usempi --disable-libompitrace --enable-script-wrapper-compilers --enable-wrapper-rpath --with-hcoll=/install/u/tjcw/workspace/ibm_smpi_toucan_ucx/ompibase/dependencies/mofed_400/opt/mellanox/hcoll --with-ucx=/install/u/tjcw/workspace/ibm_smpi_toucan_ucx/ompibase/dependencies --with-ucx-libdir=/install/u/tjcw/workspace/ibm_smpi_toucan_ucx/ompibase/dependencies/lib I was trying to build the 'master' branch of ompi, at commit e1e6d8b85e2a27e4981566d8b110730857314c54 . The 'gcc' command which fails is at line 132820 of 'config.log' T J (Chris) Ward, IBM Research. Scalable Data-Centric Computing - IBM Spectrum MPI IBM United Kingdom Ltd., Hursley Park, Winchester, Hants, SO21 2JN 011-44-1962-818679 LinkedIn https://www.linkedin.com/in/tjcward/ ResearchGate https://www.researchgate.net/profile/Thomas_Ward16 IBM Research -- Data Centric Systems<http://www.research.ibm.com/artificial-intelligence/hardware/> IBM Supercomputer Marketing<https://www.ibm.com/it-infrastructure/power/scale-out> IBM Branded Products<https://www.ibm.com/products> IBM Branded Swag<https://logostore-globalid.us/> <Mail Attachment.jpeg><https://developer.ibm.com/articles/running-linux-and-ibm-spectrum-scale-on-ibm-supercomputers/> UNIX in the Cloud - Find A Place Where There's Room To Grow, with the original Open Standard. Free Trial Here Today<http://sdf.lonestar.org/index.cgi?telnet> Protein Folding by Supercomputer - BlueMatter<https://github.ibm.com/TJCW/BlueMatter> Molecular Dynamics package. Data Tables - In-memory key-value store<https://github.ibm.com/TJCW/tx-cics-tables> package. Linux on Windows - Virtualisation<https://w3-03.ibm.com/services/lighthouse/documents/124087> package. On the Lighthouse ! Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU Unless stated otherwise above: IBM United Kingdom Limited - Registered in England and Wales with number 741598. Registered office: PO Box 41, North Harbour, Portsmouth, Hampshire PO6 3AU -- Jeff Squyres jsquy...@cisco.com<mailto:jsquy...@cisco.com>
