Gilles is right, the script shows only what is used right after MPI_Init,
and it will disregard some of the less mainstreams type of modules, the
ones that are dynamically loaded as needed during the execution. It also
only shows only what is related to libmpi, and ignores everything related
to ORTE that is not in use inside the MPI library. However, it does allow
you to define a list of necessary modules, that you can then use during
configure to limit the size of your MPI library.
1. If your goal is to limit the size of the library for a limited set of
applications you can do the following. Instead of generating an app, use
the output of the script to generate a function. You can then link it with
your application(s). Calling the function right before your MPI_Finalize
will allow you to dump the entire list of used modules in your
application(s).
2. During configure use the option --enable-mca-no-build="list" to remove
all unnecessary modules from the build process. The configure will ignore
them, and therefore they will not endup in your libmpi.so
3. Some of the framework are dynamically selected for each communicator or
peer process (e.g. collective and BTL), so it might be difficult and error
prone to trim then down more.
George.
On Wed, Nov 2, 2016 at 12:28 AM, Gilles Gouaillardet
wrote:
> Did you strip the libraries already ?
>
>
> the script will show the list of frameworks and components used by MPI
> helloworld.
>
> from that, you can deduce a list of components that are not required,
> exclude them via the configure command line, and rebuild a trimmed Open MPI.
>
> note this is pretty painful and incomplete. for example, the ompi/io
> components are not explicitly required by MPI helloworld, but they are
> required
>
> if your app uses MPI-IO (e.g. MPI_File_xxx)
>
> some more components might be dynamically required by realworld MPI app.
>
>
> may i ask why you are focusing on reducing the lib size ?
>
> reducing the lib size by excluding (allegedly) useless components is a
> long and painful process, and you might end up having to debug
>
> new problems by your own ...
>
> as far as i am concerned, if a few MB libs is too big (filesystem ? memory
> ?), i do not see how a real world application can even run on your arm node
>
>
> Cheers,
>
>
> Gilles
> On 11/2/2016 12:49 PM, Mahesh Nanavalla wrote:
>
> HI George,
> Thanks for reply,
>
> By that above script ,how can i reduce* libmpi.so* size.
>
>
>
> On Tue, Nov 1, 2016 at 11:27 PM, George Bosilca
> wrote:
>
>> Let's try to coerce OMPI to dump all modules that are still loaded after
>> MPI_Init. We are still having a superset of the needed modules, but at
>> least everything unnecessary in your particular environment has been
>> trimmed as during a normal OMPI run.
>>
>> George.
>>
>> PS: It's a shell script that needs ag to run. You need to provide the
>> OMPI source directory. You will get a C file (named tmp.c) in the current
>> directory that contain the code necessary to dump all active modules. You
>> will have to fiddle with the compile line to get it to work, as you will
>> need to specify both source and build header files directories. For the
>> sake of completeness here is my compile line
>>
>> mpicc -o tmp -g tmp.c -I. -I../debug/opal/include -I../debug/ompi/include
>> -Iompi/include -Iopal/include -Iopal/mca/event/libevent2022/libevent
>> -Iorte/include -I../debug/opal/mca/hwloc/hwloc1113/hwloc/include
>> -Iopal/mca/hwloc/hwloc1113/hwloc/include -Ioshmem/include -I../debug/
>> -lopen-rte -l open-pal
>>
>>
>>
>> On Tue, Nov 1, 2016 at 7:12 AM, Jeff Squyres (jsquyres) <
>> jsquy...@cisco.com> wrote:
>>
>>> Run ompi_info; it will tell you all the plugins that are installed.
>>>
>>> > On Nov 1, 2016, at 2:13 AM, Mahesh Nanavalla <
>>> mahesh.nanavalla...@gmail.com> wrote:
>>> >
>>> > Hi Jeff Squyres,
>>> >
>>> > Thank you for your reply...
>>> >
>>> > My problem is i want to reduce library size by removing unwanted
>>> plugin's.
>>> >
>>> > Here libmpi.so.12.0.3 size is 2.4MB.
>>> >
>>> > How can i know what are the pluggin's included to build the
>>> libmpi.so.12.0.3 and how can remove.
>>> >
>>> > Thanks&Regards,
>>> > Mahesh N
>>> >
>>> > On Fri, Oct 28, 2016 at 7:09 PM, Jeff Squyres (jsquyres) <
>>> jsquy...@cisco.com> wrote:
>>> > On Oct 28, 2016, at 8:12 AM, Mahesh Nanavalla <
>>> mahesh.nanavalla...@gmail.com> wrote:
>>> > >
>>> > > i have configured as below for arm
>>> > >
>>> > > ./configure --enable-orterun-prefix-by-default
>>> --prefix="/home/nmahesh/Workspace/ARM_MPI/openmpi"
>>> CC=arm-openwrt-linux-muslgnueabi-gcc CXX=arm-openwrt-linux-muslgnueabi-g++
>>> --host=arm-openwrt-linux-muslgnueabi --enable-script-wrapper-compilers
>>> --disable-mpi-fortran --enable-dlopen --enable-shared --disable-vt
>>> --disable-java --disable-libompitrace --disable-static
>>> >
>>> > Note that there is a tradeoff here: --enable-dlopen will reduce the
>>> size of libmpi.so by splitting out all the plugins into separate DSOs
>>> (
