Hi Gilles,

I tested your patch on top of 1.8.1, and it fixes the cartesian comm leaks, 
thanks!

Meanwhile, I had a look at the leaks of 

#include <mpi.h>

int main (int argc, char *argv[]) {
    MPI_Init(&argc, &argv);
    MPI_Finalize();
}

which ideally should have no leaks at all, as this would simplify leak hunting 
very significantly, since it would make automated regression testing much 
easier (both on the mpi user side of thing, i.e. our main interest, but also 
from the devel side).

The summary is 

SUMMARY: LeakSanitizer: 29057 byte(s) leaked in 84 allocation(s).

with the full traces attached (against the slightly patched 1.8.1)

BTW, in case you wonder how to get these traces, just build openmpi with '-g 
-fno-omit-frame-pointer' and the application with  '-g -fno-omit-frame-pointer 
-fsanitize=leak' using gcc 4.9.0, it is very convenient.

Joost

________________________________________
From: devel [devel-boun...@open-mpi.org] on behalf of Gilles Gouaillardet 
[gilles.gouaillar...@iferc.org]
Sent: Wednesday, April 30, 2014 8:35 AM
To: Open MPI Developers
Subject: Re: [OMPI devel] memory leaks upon dup/split/create    of      
communicators?

Joost,

i created #4581 and attached a patch (for the trunk) in order to solve
this leak (and two similar ones)

Cheers,

Gilles

On 2014/04/29 5:18, VandeVondele Joost wrote:
> Hi,
>
> I applied the patch from ticket #4569 (to 1.8.1), and things improved (in 
> particular the reported issue is gone). The next big leaks seems to relate to 
> Cartesian communicators.
>
> Direct leak of 9600 byte(s) in 300 object(s) allocated from:
>     #0 0x7f7cd2c8e793 in __interceptor_calloc 
> ../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:89
>     #1 0x7f7cd3a92552 in mca_topo_base_cart_create 
> ../../../../ompi/mca/topo/base/topo_base_cart_create.c:89
>     #2 0x7f7cd3a52bfd in PMPI_Cart_create 
> /data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pcart_create.c:103
>     #3 0x7f7cd3d0f4bf in ompi_cart_create_f 
> /data/vjoost/openmpi-1.8.1/build/ompi/mpi/fortran/mpif-h/profile/pcart_create_f.c:82
>     #4 0x1bfdf6a in __message_passing_MOD_mp_cart_create 
> /data/vjoost/clean/cp2k/cp2k/src/common/message_passing.F:984
>
> Direct leak of 21600 byte(s) in 300 object(s) allocated from:
>     #0 0x7f7cd2c8e3a8 in __interceptor_malloc 
> ../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
>     #1 0x7f7cd3a3501f in opal_obj_new ../../opal/class/opal_object.h:467
>     #2 0x7f7cd3a3501f in ompi_group_allocate ../../ompi/group/group_init.c:63
>     #3 0x7f7cd3a2b192 in ompi_comm_fill_rest 
> ../../ompi/communicator/comm.c:1827
>     #4 0x7f7cd3a2b192 in ompi_comm_enable ../../ompi/communicator/comm.c:1782
>     #5 0x7f7cd3a924d2 in mca_topo_base_cart_create 
> ../../../../ompi/mca/topo/base/topo_base_cart_create.c:164
>     #6 0x7f7cd3a52bfd in PMPI_Cart_create 
> /data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pcart_create.c:103
>     #7 0x7f7cd3d0f4bf in ompi_cart_create_f 
> /data/vjoost/openmpi-1.8.1/build/ompi/mpi/fortran/mpif-h/profile/pcart_create_f.c:82
>     #8 0x1bfdf6a in __message_passing_MOD_mp_cart_create 
> /data/vjoost/clean/cp2k/cp2k/src/common/message_passing.F:984
>
> Joost
>

_______________________________________________
devel mailing list
de...@open-mpi.org
Subscription: http://www.open-mpi.org/mailman/listinfo.cgi/devel
Link to this post: 
http://www.open-mpi.org/community/lists/devel/2014/04/14658.php
=================================================================
==72519==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 8208 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b3ea6731 (+0x1da6731)
    #2 0x7f65ba2487b8 in opal_obj_run_constructors 
../../opal/class/opal_object.h:424
    #3 0x7f65ba2487b8 in opal_free_list_grow 
../../opal/class/opal_free_list.c:113
    #4 0x7f65b3ea29e2 (+0x1da29e2)
    #5 0x7f65bb438c54 in ompi_osc_base_find_available 
../../../../ompi/mca/osc/base/osc_base_frame.c:48
    #6 0x7f65bb3e9bc2 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:661
    #7 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #8 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #9 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 2400 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b61d1e56 
(/data/vjoost/gnu/gcc-4_9-branch/install/lib64/libstdc++.so.6.0.20+0x217e56)
    #2 0x7f65b61d1d59 
(/data/vjoost/gnu/gcc-4_9-branch/install/lib64/libstdc++.so.6.0.20+0x217d59)
    #3 0x7f65b48e3918 (+0x854918)
    #4 0x7f65ba26e3b2 in open_components 
../../../../opal/mca/base/mca_base_components_open.c:173
    #5 0x7f65ba26e3b2 in mca_base_framework_components_open 
../../../../opal/mca/base/mca_base_components_open.c:66
    #6 0x7f65bb43c31f in mca_pml_base_open 
../../../../ompi/mca/pml/base/pml_base_frame.c:187
    #7 0x7f65ba27757b in mca_base_framework_open 
../../../../opal/mca/base/mca_base_framework.c:150
    #8 0x7f65bb3e995e in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:568
    #9 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #10 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #11 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 2232 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65bb3d0392 in ompi_free_list_grow 
../../ompi/class/ompi_free_list.c:203
    #2 0x7f65b53b787c (+0x132087c)
    #3 0x7f65b57c1488 (+0x172a488)
    #4 0x7f65b48e1f99 (+0x84af99)
    #5 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #6 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #7 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #8 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 2232 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65bb3d0392 in ompi_free_list_grow 
../../ompi/class/ompi_free_list.c:203
    #2 0x7f65b53b78d3 (+0x13288d3)
    #3 0x7f65b57c1488 (+0x1732488)
    #4 0x7f65b48e1f99 (+0x852f99)
    #5 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #6 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #7 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #8 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 2232 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65bb3d0392 in ompi_free_list_grow 
../../ompi/class/ompi_free_list.c:203
    #2 0x7f65b53b7820 (+0x1320820)
    #3 0x7f65b57c1488 (+0x172a488)
    #4 0x7f65b48e1f99 (+0x84af99)
    #5 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #6 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #7 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #8 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 1208 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65bb3d0392 in ompi_free_list_grow 
../../ompi/class/ompi_free_list.c:203
    #2 0x7f65b48e1c00 (+0x852c00)
    #3 0x7f65bb43d003 in mca_pml_v_enable 
../../../../../ompi/mca/pml/v/pml_v_component.c:217
    #4 0x7f65bb3e9ceb in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:760
    #5 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #6 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #7 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 936 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba2486cc in opal_free_list_grow 
../../opal/class/opal_free_list.c:93
    #2 0x7f65b53b791e (+0x132091e)
    #3 0x7f65b57c1488 (+0x172a488)
    #4 0x7f65b48e1f99 (+0x84af99)
    #5 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #6 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #7 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #8 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 560 byte(s) in 5 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b69e82bf (+0x2052bf)
    #2 0x7f65ba28f534 in event_process_active_single_queue 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1367
    #3 0x7f65ba28f534 in event_process_active 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1437
    #4 0x7f65ba28f534 in opal_libevent2021_event_base_loop 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1645
    #5 0x7f65ba4fec0d in orte_progress_thread_engine 
../../../../orte/mca/ess/base/ess_base_std_app.c:456
    #6 0x3f924079d0 in start_thread (/lib64/libpthread.so.0+0x3f924079d0)

Direct leak of 464 byte(s) in 2 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b57c18a3 (+0x172a8a3)
    #2 0x7f65b48e1f99 (+0x84af99)
    #3 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #4 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #5 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #6 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 290 byte(s) in 6 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba25825c in opal_dss_unpack_value ../../opal/dss/dss_unpack.c:975
    #2 0x7f65ba255707 in opal_dss_unpack_buffer ../../opal/dss/dss_unpack.c:126
    #3 0x7f65ba25658a in opal_dss_unpack ../../opal/dss/dss_unpack.c:90
    #4 0x7f65ba50234a in orte_grpcomm_base_store_modex 
../../../../orte/mca/grpcomm/base/grpcomm_base_modex.c:246
    #5 0x7f65ba502e5e in app_recv 
../../../../orte/mca/grpcomm/base/grpcomm_base_receive.c:203
    #6 0x7f65ba51a1b5 in orte_rml_base_process_msg 
../../../../orte/mca/rml/base/rml_base_msg_handlers.c:172
    #7 0x7f65ba28f534 in event_process_active_single_queue 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1367
    #8 0x7f65ba28f534 in event_process_active 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1437
    #9 0x7f65ba28f534 in opal_libevent2021_event_base_loop 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1645
    #10 0x7f65ba4fec0d in orte_progress_thread_engine 
../../../../orte/mca/ess/base/ess_base_std_app.c:456
    #11 0x3f924079d0 in start_thread (/lib64/libpthread.so.0+0x3f924079d0)

Direct leak of 160 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b67e402f (+0x102f)
    #2 0x7f65bb3e9dee in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:816
    #3 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #4 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #5 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 160 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b67e40ff (+0x10ff)
    #2 0x7f65bb3e9a50 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:627
    #3 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #4 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #5 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 160 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b67e402f (+0x102f)
    #2 0x7f65bb3ea3dc in ompi_mpi_finalize 
../../ompi/runtime/ompi_mpi_finalize.c:222
    #3 0x4006f8 in main /data/vjoost/openmpi-1.8.1/debug/test.c:5
    #4 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 160 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b67e41cf (+0x11cf)
    #2 0x7f65ba502961 in orte_grpcomm_base_modex 
../../../../orte/mca/grpcomm/base/grpcomm_base_modex.c:199
    #3 0x7f65ba28f534 in event_process_active_single_queue 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1367
    #4 0x7f65ba28f534 in event_process_active 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1437
    #5 0x7f65ba28f534 in opal_libevent2021_event_base_loop 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1645
    #6 0x7f65ba4fec0d in orte_progress_thread_engine 
../../../../orte/mca/ess/base/ess_base_std_app.c:456
    #7 0x3f924079d0 in start_thread (/lib64/libpthread.so.0+0x3f924079d0)

Direct leak of 145 byte(s) in 3 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba252f71 in opal_dss_copy_value ../../opal/dss/dss_copy.c:309
    #2 0x7f65b81ee788 (+0x788)
    #3 0x7f65ba28a972 in opal_db_base_fetch_multiple 
../../../../opal/mca/db/base/db_base_fns.c:203
    #4 0x7f65ba502512 in orte_grpcomm_base_pack_modex_entries 
../../../../orte/mca/grpcomm/base/grpcomm_base_modex.c:306
    #5 0x7f65ba502ae9 in orte_grpcomm_base_modex 
../../../../orte/mca/grpcomm/base/grpcomm_base_modex.c:189
    #6 0x7f65ba28f534 in event_process_active_single_queue 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1367
    #7 0x7f65ba28f534 in event_process_active 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1437
    #8 0x7f65ba28f534 in opal_libevent2021_event_base_loop 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1645
    #9 0x7f65ba4fec0d in orte_progress_thread_engine 
../../../../orte/mca/ess/base/ess_base_std_app.c:456
    #10 0x3f924079d0 in start_thread (/lib64/libpthread.so.0+0x3f924079d0)

Direct leak of 144 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b51308b7 (+0x10a18b7)
    #2 0x7f65b512b79e (+0x109c79e)
    #3 0x7f65b57c1589 (+0x1732589)
    #4 0x7f65b48e1f99 (+0x852f99)
    #5 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #6 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #7 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #8 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 120 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b81eeb44 (+0xb44)
    #2 0x7f65ba28a53f in opal_db_base_store 
../../../../opal/mca/db/base/db_base_fns.c:49
    #3 0x7f65bb3eea9f in ompi_modex_send 
../../ompi/runtime/ompi_module_exchange.c:49
    #4 0x7f65b4f23dc0 (+0xe8cdc0)
    #5 0x7f65b4f23f0e (+0xe8cf0e)
    #6 0x7f65bb42a183 in mca_btl_base_select 
../../../../ompi/mca/btl/base/btl_base_select.c:108
    #7 0x7f65b57c2828 (+0x172b828)
    #8 0x7f65bb429a0b in mca_bml_base_init 
../../../../ompi/mca/bml/base/bml_base_init.c:69
    #9 0x7f65b48e35c7 (+0x84c5c7)
    #10 0x7f65bb43c960 in mca_pml_base_select 
../../../../ompi/mca/pml/base/pml_base_select.c:128
    #11 0x7f65bb3e99d0 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:604
    #12 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #13 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #14 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 80 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba275b91 in opal_obj_new ../../../../opal/class/opal_object.h:467
    #2 0x7f65ba275b91 in mca_base_var_enum_create 
../../../../opal/mca/base/mca_base_var_enum.c:113
    #3 0x7f65b3e9f933 (+0x1d9f933)
    #4 0x7f65ba277175 in register_components 
../../../../opal/mca/base/mca_base_components_register.c:116
    #5 0x7f65ba277175 in mca_base_framework_components_register 
../../../../opal/mca/base/mca_base_components_register.c:67
    #6 0x7f65ba2774bf in mca_base_framework_register 
../../../../opal/mca/base/mca_base_framework.c:107
    #7 0x7f65ba277529 in mca_base_framework_open 
../../../../opal/mca/base/mca_base_framework.c:131
    #8 0x7f65bb3e997d in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:572
    #9 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #10 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #11 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 80 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b61d1d3d 
(/data/vjoost/gnu/gcc-4_9-branch/install/lib64/libstdc++.so.6.0.20+0x217d3d)
    #2 0x7f65b4d065f8 (+0xc6f5f8)
    #3 0x7f65ba26e3b2 in open_components 
../../../../opal/mca/base/mca_base_components_open.c:173
    #4 0x7f65ba26e3b2 in mca_base_framework_components_open 
../../../../opal/mca/base/mca_base_components_open.c:66
    #5 0x7f65bb43c31f in mca_pml_base_open 
../../../../ompi/mca/pml/base/pml_base_frame.c:187
    #6 0x7f65ba27757b in mca_base_framework_open 
../../../../opal/mca/base/mca_base_framework.c:150
    #7 0x7f65bb3e995e in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:568
    #8 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #9 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #10 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 64 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65bb3d27b0 in opal_obj_new ../../opal/class/opal_object.h:467
    #2 0x7f65bb3d27b0 in ompi_attr_create_keyval_impl 
../../ompi/attribute/attribute.c:536
    #3 0x7f65bb3d2bf7 in ompi_attr_create_keyval 
../../ompi/attribute/attribute.c:582
    #4 0x7f65bb3d432e in create_comm 
../../ompi/attribute/attribute_predefined.c:225
    #5 0x7f65bb3d432e in ompi_attr_create_predefined 
../../ompi/attribute/attribute_predefined.c:125
    #6 0x7f65bb3e9cb4 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:739
    #7 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #8 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #9 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 64 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x3f918d045c in gaih_inet (/lib64/libc.so.6+0x3f918d045c)
    #2 0x3f918d2f0f in __GI_getaddrinfo (/lib64/libc.so.6+0x3f918d2f0f)
    #3 0x7f65ba27e68c in opal_ifaddrtokindex ../../../opal/util/if.c:276
    #4 0x7f65b6beff1b (+0xdf1b)
    #5 0x7f65ba50b96b in process_uri 
../../../../orte/mca/oob/base/oob_base_stubs.c:368
    #6 0x7f65ba50c564 in orte_oob_base_set_addr 
../../../../orte/mca/oob/base/oob_base_stubs.c:296
    #7 0x7f65ba28f534 in event_process_active_single_queue 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1367
    #8 0x7f65ba28f534 in event_process_active 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1437
    #9 0x7f65ba28f534 in opal_libevent2021_event_base_loop 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1645
    #10 0x7f65ba4fec0d in orte_progress_thread_engine 
../../../../orte/mca/ess/base/ess_base_std_app.c:456
    #11 0x3f924079d0 in start_thread (/lib64/libpthread.so.0+0x3f924079d0)

Direct leak of 64 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65bb3d27b0 in opal_obj_new ../../opal/class/opal_object.h:467
    #2 0x7f65bb3d27b0 in ompi_attr_create_keyval_impl 
../../ompi/attribute/attribute.c:536
    #3 0x7f65bb3d2bf7 in ompi_attr_create_keyval 
../../ompi/attribute/attribute.c:582
    #4 0x7f65bb3d41f5 in create_comm 
../../ompi/attribute/attribute_predefined.c:225
    #5 0x7f65bb3d41f5 in ompi_attr_create_predefined 
../../ompi/attribute/attribute_predefined.c:120
    #6 0x7f65bb3e9cb4 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:739
    #7 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #8 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #9 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 64 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65bb3d27b0 in opal_obj_new ../../opal/class/opal_object.h:467
    #2 0x7f65bb3d27b0 in ompi_attr_create_keyval_impl 
../../ompi/attribute/attribute.c:536
    #3 0x7f65bb3d2bf7 in ompi_attr_create_keyval 
../../ompi/attribute/attribute.c:582
    #4 0x7f65bb3d4232 in create_comm 
../../ompi/attribute/attribute_predefined.c:225
    #5 0x7f65bb3d4232 in ompi_attr_create_predefined 
../../ompi/attribute/attribute_predefined.c:121
    #6 0x7f65bb3e9cb4 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:739
    #7 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #8 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #9 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 64 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65bb3d27b0 in opal_obj_new ../../opal/class/opal_object.h:467
    #2 0x7f65bb3d27b0 in ompi_attr_create_keyval_impl 
../../ompi/attribute/attribute.c:536
    #3 0x7f65bb3d2bf7 in ompi_attr_create_keyval 
../../ompi/attribute/attribute.c:582
    #4 0x7f65bb3d41b3 in create_comm 
../../ompi/attribute/attribute_predefined.c:225
    #5 0x7f65bb3d41b3 in ompi_attr_create_predefined 
../../ompi/attribute/attribute_predefined.c:130
    #6 0x7f65bb3e9cb4 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:739
    #7 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #8 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #9 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 64 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65bb3d27b0 in opal_obj_new ../../opal/class/opal_object.h:467
    #2 0x7f65bb3d27b0 in ompi_attr_create_keyval_impl 
../../ompi/attribute/attribute.c:536
    #3 0x7f65bb3d2bf7 in ompi_attr_create_keyval 
../../ompi/attribute/attribute.c:582
    #4 0x7f65bb3d426f in create_comm 
../../ompi/attribute/attribute_predefined.c:225
    #5 0x7f65bb3d426f in ompi_attr_create_predefined 
../../ompi/attribute/attribute_predefined.c:122
    #6 0x7f65bb3e9cb4 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:739
    #7 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #8 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #9 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 64 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65bb3d27b0 in opal_obj_new ../../opal/class/opal_object.h:467
    #2 0x7f65bb3d27b0 in ompi_attr_create_keyval_impl 
../../ompi/attribute/attribute.c:536
    #3 0x7f65bb3d2bf7 in ompi_attr_create_keyval 
../../ompi/attribute/attribute.c:582
    #4 0x7f65bb3d42ae in create_comm 
../../ompi/attribute/attribute_predefined.c:225
    #5 0x7f65bb3d42ae in ompi_attr_create_predefined 
../../ompi/attribute/attribute_predefined.c:123
    #6 0x7f65bb3e9cb4 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:739
    #7 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #8 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #9 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 64 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65bb3d27b0 in opal_obj_new ../../opal/class/opal_object.h:467
    #2 0x7f65bb3d27b0 in ompi_attr_create_keyval_impl 
../../ompi/attribute/attribute.c:536
    #3 0x7f65bb3d2bf7 in ompi_attr_create_keyval 
../../ompi/attribute/attribute.c:582
    #4 0x7f65bb3d42f1 in create_comm 
../../ompi/attribute/attribute_predefined.c:225
    #5 0x7f65bb3d42f1 in ompi_attr_create_predefined 
../../ompi/attribute/attribute_predefined.c:124
    #6 0x7f65bb3e9cb4 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:739
    #7 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #8 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #9 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 56 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b6bf005f (+0xe05f)
    #2 0x7f65ba50b96b in process_uri 
../../../../orte/mca/oob/base/oob_base_stubs.c:368
    #3 0x7f65ba50c564 in orte_oob_base_set_addr 
../../../../orte/mca/oob/base/oob_base_stubs.c:296
    #4 0x7f65ba28f534 in event_process_active_single_queue 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1367
    #5 0x7f65ba28f534 in event_process_active 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1437
    #6 0x7f65ba28f534 in opal_libevent2021_event_base_loop 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1645
    #7 0x7f65ba4fec0d in orte_progress_thread_engine 
../../../../orte/mca/ess/base/ess_base_std_app.c:456
    #8 0x3f924079d0 in start_thread (/lib64/libpthread.so.0+0x3f924079d0)

Direct leak of 56 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba50ba4f in opal_obj_new ../../../../opal/class/opal_object.h:467
    #2 0x7f65ba50ba4f in process_uri 
../../../../orte/mca/oob/base/oob_base_stubs.c:347
    #3 0x7f65ba50c564 in orte_oob_base_set_addr 
../../../../orte/mca/oob/base/oob_base_stubs.c:296
    #4 0x7f65ba28f534 in event_process_active_single_queue 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1367
    #5 0x7f65ba28f534 in event_process_active 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1437
    #6 0x7f65ba28f534 in opal_libevent2021_event_base_loop 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1645
    #7 0x7f65ba4fec0d in orte_progress_thread_engine 
../../../../orte/mca/ess/base/ess_base_std_app.c:456
    #8 0x3f924079d0 in start_thread (/lib64/libpthread.so.0+0x3f924079d0)

Direct leak of 48 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba50ccc2 in opal_obj_new ../../../../opal/class/opal_object.h:467
    #2 0x7f65ba50ccc2 in orte_oob_base_select 
../../../../orte/mca/oob/base/oob_base_select.c:112
    #3 0x7f65ba4fee44 in orte_ess_base_app_setup 
../../../../orte/mca/ess/base/ess_base_std_app.c:128
    #4 0x7f65b89fa5a9 
(/data/vjoost/openmpi-1.8.1/install/lib/libmpi.so.1.5.0+0x5705a9)
    #5 0x7f65ba4dcc1b in orte_init ../../orte/runtime/orte_init.c:148
    #6 0x7f65bb3e96e1 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:464
    #7 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #8 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #9 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 48 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba26c154 in opal_obj_new ../../../../opal/class/opal_object.h:467
    #2 0x7f65ba26c154 in open_component 
../../../../opal/mca/base/mca_base_component_find.c:625
    #3 0x7f65ba26d648 in find_dyn_components 
../../../../opal/mca/base/mca_base_component_find.c:466
    #4 0x7f65ba26d648 in mca_base_component_find 
../../../../opal/mca/base/mca_base_component_find.c:204
    #5 0x7f65ba277079 in mca_base_framework_components_register 
../../../../opal/mca/base/mca_base_components_register.c:57
    #6 0x7f65ba2774bf in mca_base_framework_register 
../../../../opal/mca/base/mca_base_framework.c:107
    #7 0x7f65ba277529 in mca_base_framework_open 
../../../../opal/mca/base/mca_base_framework.c:131
    #8 0x7f65bb3e999c in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:577
    #9 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #10 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #11 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 36 byte(s) in 3 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x3f91881171 in __strdup (/lib64/libc.so.6+0x3f91881171)

Direct leak of 24 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b81eeb44 (+0xb44)
    #2 0x7f65ba28a53f in opal_db_base_store 
../../../../opal/mca/db/base/db_base_fns.c:49
    #3 0x7f65bb3eea9f in ompi_modex_send 
../../ompi/runtime/ompi_module_exchange.c:49
    #4 0x7f65b512dd43 (+0x1096d43)
    #5 0x7f65bb42a183 in mca_btl_base_select 
../../../../ompi/mca/btl/base/btl_base_select.c:108
    #6 0x7f65b57c2828 (+0x172b828)
    #7 0x7f65bb429a0b in mca_bml_base_init 
../../../../ompi/mca/bml/base/bml_base_init.c:69
    #8 0x7f65b48e35c7 (+0x84c5c7)
    #9 0x7f65bb43c960 in mca_pml_base_select 
../../../../ompi/mca/pml/base/pml_base_select.c:128
    #10 0x7f65bb3e99d0 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:604
    #11 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #12 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #13 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 16 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba763793 in __interceptor_calloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:89
    #1 0x7f65b53b75b9 (+0x13285b9)
    #2 0x7f65b57c1488 (+0x1732488)
    #3 0x7f65b48e1f99 (+0x852f99)
    #4 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #5 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #6 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #7 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 16 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b53b779d (+0x132079d)
    #2 0x7f65b57c1488 (+0x172a488)
    #3 0x7f65b48e1f99 (+0x84af99)
    #4 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #5 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #6 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #7 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 16 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b81ef5b0 (+0x15b0)
    #2 0x7f65ba28a7db in opal_db_base_fetch 
../../../../opal/mca/db/base/db_base_fns.c:133
    #3 0x7f65bb43e4df in ompi_rte_db_fetch 
../../../../../ompi/mca/rte/orte/rte_orte_module.c:281
    #4 0x7f65bb3eeb16 in ompi_modex_recv 
../../ompi/runtime/ompi_module_exchange.c:74
    #5 0x7f65b5130932 (+0x10a1932)
    #6 0x7f65b512b79e (+0x109c79e)
    #7 0x7f65b57c1589 (+0x1732589)
    #8 0x7f65b48e1f99 (+0x852f99)
    #9 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #10 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #11 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #12 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 16 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b57c1cc6 (+0x172acc6)
    #2 0x7f65bb3ea343 in ompi_mpi_finalize 
../../ompi/runtime/ompi_mpi_finalize.c:143
    #3 0x4006f8 in main /data/vjoost/openmpi-1.8.1/debug/test.c:5
    #4 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 16 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba256978 in opal_dss_unpack_byte_object 
../../opal/dss/dss_unpack.c:481
    #2 0x7f65ba255707 in opal_dss_unpack_buffer ../../opal/dss/dss_unpack.c:126
    #3 0x7f65ba25658a in opal_dss_unpack ../../opal/dss/dss_unpack.c:90
    #4 0x7f65ba4f6736 in orte_util_nidmap_init ../../orte/util/nidmap.c:132
    #5 0x7f65b89fa5b7 
(/data/vjoost/openmpi-1.8.1/install/lib/libmpi.so.1.5.0+0x5705b7)
    #6 0x7f65ba4dcc1b in orte_init ../../orte/runtime/orte_init.c:148
    #7 0x7f65bb3e96e1 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:464
    #8 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #9 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #10 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 16 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba256978 in opal_dss_unpack_byte_object 
../../opal/dss/dss_unpack.c:481
    #2 0x7f65ba255707 in opal_dss_unpack_buffer ../../opal/dss/dss_unpack.c:126
    #3 0x7f65ba25658a in opal_dss_unpack ../../opal/dss/dss_unpack.c:90
    #4 0x7f65ba4f6707 in orte_util_nidmap_init ../../orte/util/nidmap.c:119
    #5 0x7f65b89fa5b7 
(/data/vjoost/openmpi-1.8.1/install/lib/libmpi.so.1.5.0+0x5705b7)
    #6 0x7f65ba4dcc1b in orte_init ../../orte/runtime/orte_init.c:148
    #7 0x7f65bb3e96e1 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:464
    #8 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #9 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #10 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 16 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b81ef5b0 (+0x15b0)
    #2 0x7f65ba28a7db in opal_db_base_fetch 
../../../../opal/mca/db/base/db_base_fns.c:133
    #3 0x7f65bb43e4df in ompi_rte_db_fetch 
../../../../../ompi/mca/rte/orte/rte_orte_module.c:281
    #4 0x7f65bb3eeb16 in ompi_modex_recv 
../../ompi/runtime/ompi_module_exchange.c:74
    #5 0x7f65b5130932 (+0x10a1932)
    #6 0x7f65b512b92a (+0x109c92a)
    #7 0x7f65b57c1488 (+0x1732488)
    #8 0x7f65b48e1f99 (+0x852f99)
    #9 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #10 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #11 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #12 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 16 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b81ef5b0 (+0x15b0)
    #2 0x7f65ba28a7db in opal_db_base_fetch 
../../../../opal/mca/db/base/db_base_fns.c:133
    #3 0x7f65bb43e4df in ompi_rte_db_fetch 
../../../../../ompi/mca/rte/orte/rte_orte_module.c:281
    #4 0x7f65bb3eeb16 in ompi_modex_recv 
../../ompi/runtime/ompi_module_exchange.c:74
    #5 0x7f65b4f226d3 (+0xe8b6d3)
    #6 0x7f65b57c1488 (+0x172a488)
    #7 0x7f65b48e1f99 (+0x84af99)
    #8 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #9 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #10 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #11 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 12 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba256718 in opal_dss_unpack_string ../../opal/dss/dss_unpack.c:388
    #2 0x7f65ba255707 in opal_dss_unpack_buffer ../../opal/dss/dss_unpack.c:126
    #3 0x7f65ba25658a in opal_dss_unpack ../../opal/dss/dss_unpack.c:90
    #4 0x7f65ba4f498d in orte_util_decode_nodemap ../../orte/util/nidmap.c:444
    #5 0x7f65ba4f6719 in orte_util_nidmap_init ../../orte/util/nidmap.c:124
    #6 0x7f65b89fa5b7 
(/data/vjoost/openmpi-1.8.1/install/lib/libmpi.so.1.5.0+0x5705b7)
    #7 0x7f65ba4dcc1b in orte_init ../../orte/runtime/orte_init.c:148
    #8 0x7f65bb3e96e1 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:464
    #9 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #10 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #11 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 8 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b53b9392 (+0x1322392)
    #2 0x7f65bb42a183 in mca_btl_base_select 
../../../../ompi/mca/btl/base/btl_base_select.c:108
    #3 0x7f65b57c2828 (+0x172b828)
    #4 0x7f65bb429a0b in mca_bml_base_init 
../../../../ompi/mca/bml/base/bml_base_init.c:69
    #5 0x7f65b48e35c7 (+0x84c5c7)
    #6 0x7f65bb43c960 in mca_pml_base_select 
../../../../ompi/mca/pml/base/pml_base_select.c:128
    #7 0x7f65bb3e99d0 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:604
    #8 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #9 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #10 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 8 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba763793 in __interceptor_calloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:89
    #1 0x7f65b53b74d9 (+0x13284d9)
    #2 0x7f65b57c1488 (+0x1732488)
    #3 0x7f65b48e1f99 (+0x852f99)
    #4 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #5 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #6 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #7 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 4 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b53b77c3 (+0x13207c3)
    #2 0x7f65b57c1488 (+0x172a488)
    #3 0x7f65b48e1f99 (+0x84af99)
    #4 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #5 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #6 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #7 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Direct leak of 1 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b81eeb44 (+0xb44)
    #2 0x7f65ba28a53f in opal_db_base_store 
../../../../opal/mca/db/base/db_base_fns.c:49
    #3 0x7f65bb3eebe6 in ompi_modex_send_string 
../../ompi/runtime/ompi_module_exchange.c:119
    #4 0x7f65bb3e9755 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:511
    #5 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #6 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #7 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 2400 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b61d1e56 
(/data/vjoost/gnu/gcc-4_9-branch/install/lib64/libstdc++.so.6.0.20+0x217e56)
    #2 0x7f65b61d1d59 
(/data/vjoost/gnu/gcc-4_9-branch/install/lib64/libstdc++.so.6.0.20+0x217d59)
    #3 0x7f65b4d065f8 (+0xc6f5f8)
    #4 0x7f65ba26e3b2 in open_components 
../../../../opal/mca/base/mca_base_components_open.c:173
    #5 0x7f65ba26e3b2 in mca_base_framework_components_open 
../../../../opal/mca/base/mca_base_components_open.c:66
    #6 0x7f65bb43c31f in mca_pml_base_open 
../../../../ompi/mca/pml/base/pml_base_frame.c:187
    #7 0x7f65ba27757b in mca_base_framework_open 
../../../../opal/mca/base/mca_base_framework.c:150
    #8 0x7f65bb3e995e in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:568
    #9 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #10 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #11 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 2400 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b61d1e56 
(/data/vjoost/gnu/gcc-4_9-branch/install/lib64/libstdc++.so.6.0.20+0x217e56)
    #2 0x7f65b61d1d59 
(/data/vjoost/gnu/gcc-4_9-branch/install/lib64/libstdc++.so.6.0.20+0x217d59)
    #3 0x7f65b5bc804c (+0x1b3904c)
    #4 0x7f65bb431a2a in mca_mpool_base_module_create 
../../../../ompi/mca/mpool/base/mpool_base_lookup.c:74
    #5 0x7f65b53b7578 (+0x1328578)
    #6 0x7f65b57c1488 (+0x1732488)
    #7 0x7f65b48e1f99 (+0x852f99)
    #8 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #9 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #10 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #11 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 192 byte(s) in 2 object(s) allocated from:
    #0 0x7f65ba7638b9 in __interceptor_realloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:96
    #1 0x7f65bb4297a1 in mca_bml_base_btl_array_reserve 
../../../../ompi/mca/bml/base/bml_base_btl.c:63
    #2 0x7f65b57c1908 (+0x172a908)
    #3 0x7f65b48e1f99 (+0x84af99)
    #4 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #5 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #6 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #7 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 192 byte(s) in 2 object(s) allocated from:
    #0 0x7f65ba7638b9 in __interceptor_realloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:96
    #1 0x7f65bb4297a1 in mca_bml_base_btl_array_reserve 
../../../../ompi/mca/bml/base/bml_base_btl.c:63
    #2 0x7f65b57c191c (+0x173291c)
    #3 0x7f65b48e1f99 (+0x852f99)
    #4 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #5 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #6 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #7 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 192 byte(s) in 2 object(s) allocated from:
    #0 0x7f65ba7638b9 in __interceptor_realloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:96
    #1 0x7f65bb4297a1 in mca_bml_base_btl_array_reserve 
../../../../ompi/mca/bml/base/bml_base_btl.c:63
    #2 0x7f65b57c1933 (+0x172a933)
    #3 0x7f65b48e1f99 (+0x84af99)
    #4 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #5 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #6 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #7 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 152 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b5bc7fa2 (+0x1b38fa2)
    #2 0x7f65bb431a2a in mca_mpool_base_module_create 
../../../../ompi/mca/mpool/base/mpool_base_lookup.c:74
    #3 0x7f65b53b7578 (+0x1328578)
    #4 0x7f65b57c1488 (+0x1732488)
    #5 0x7f65b48e1f99 (+0x852f99)
    #6 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #7 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #8 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #9 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 136 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b53b6f7f (+0x131ff7f)
    #2 0x7f65b57c1488 (+0x172a488)
    #3 0x7f65b48e1f99 (+0x84af99)
    #4 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #5 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #6 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #7 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 120 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b81ef5d4 (+0x15d4)
    #2 0x7f65ba28a7db in opal_db_base_fetch 
../../../../opal/mca/db/base/db_base_fns.c:133
    #3 0x7f65bb43e4df in ompi_rte_db_fetch 
../../../../../ompi/mca/rte/orte/rte_orte_module.c:281
    #4 0x7f65bb3eeb16 in ompi_modex_recv 
../../ompi/runtime/ompi_module_exchange.c:74
    #5 0x7f65b4f226d3 (+0xe936d3)
    #6 0x7f65b57c1488 (+0x1732488)
    #7 0x7f65b48e1f99 (+0x852f99)
    #8 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #9 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #10 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #11 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 80 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b61d1d3d 
(/data/vjoost/gnu/gcc-4_9-branch/install/lib64/libstdc++.so.6.0.20+0x217d3d)
    #2 0x7f65b5bc804c (+0x1b3104c)
    #3 0x7f65bb431a2a in mca_mpool_base_module_create 
../../../../ompi/mca/mpool/base/mpool_base_lookup.c:74
    #4 0x7f65b53b7578 (+0x1320578)
    #5 0x7f65b57c1488 (+0x172a488)
    #6 0x7f65b48e1f99 (+0x84af99)
    #7 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #8 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #9 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #10 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 64 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba763793 in __interceptor_calloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:89
    #1 0x7f65ba275c28 in mca_base_var_enum_create 
../../../../opal/mca/base/mca_base_var_enum.c:127
    #2 0x7f65b3e9f933 (+0x1d9f933)
    #3 0x7f65ba277175 in register_components 
../../../../opal/mca/base/mca_base_components_register.c:116
    #4 0x7f65ba277175 in mca_base_framework_components_register 
../../../../opal/mca/base/mca_base_components_register.c:67
    #5 0x7f65ba2774bf in mca_base_framework_register 
../../../../opal/mca/base/mca_base_framework.c:107
    #6 0x7f65ba277529 in mca_base_framework_open 
../../../../opal/mca/base/mca_base_framework.c:131
    #7 0x7f65bb3e997d in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:572
    #8 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #9 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #10 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 55 byte(s) in 4 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x3f91881171 in __strdup (/lib64/libc.so.6+0x3f91881171)

Indirect leak of 48 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba4f5c36 in opal_obj_new ../../opal/class/opal_object.h:467
    #2 0x7f65ba4f5c36 in orte_util_decode_pidmap ../../orte/util/nidmap.c:918
    #3 0x7f65ba4f674a in orte_util_nidmap_init ../../orte/util/nidmap.c:137
    #4 0x7f65b89fa5b7 
(/data/vjoost/openmpi-1.8.1/install/lib/libmpi.so.1.5.0+0x5705b7)
    #5 0x7f65ba4dcc1b in orte_init ../../orte/runtime/orte_init.c:148
    #6 0x7f65bb3e96e1 in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:464
    #7 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #8 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #9 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 48 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba26c154 in opal_obj_new ../../../../opal/class/opal_object.h:467
    #2 0x7f65ba26c154 in open_component 
../../../../opal/mca/base/mca_base_component_find.c:625
    #3 0x7f65ba26d648 in find_dyn_components 
../../../../opal/mca/base/mca_base_component_find.c:466
    #4 0x7f65ba26d648 in mca_base_component_find 
../../../../opal/mca/base/mca_base_component_find.c:204
    #5 0x7f65ba277079 in mca_base_framework_components_register 
../../../../opal/mca/base/mca_base_components_register.c:57
    #6 0x7f65ba2774bf in mca_base_framework_register 
../../../../opal/mca/base/mca_base_framework.c:107
    #7 0x7f65ba277529 in mca_base_framework_open 
../../../../opal/mca/base/mca_base_framework.c:131
    #8 0x7f65bb3e999c in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:577
    #9 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #10 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #11 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 24 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b81ef5d4 (+0x15d4)
    #2 0x7f65ba28a7db in opal_db_base_fetch 
../../../../opal/mca/db/base/db_base_fns.c:133
    #3 0x7f65bb43e4df in ompi_rte_db_fetch 
../../../../../ompi/mca/rte/orte/rte_orte_module.c:281
    #4 0x7f65bb3eeb16 in ompi_modex_recv 
../../ompi/runtime/ompi_module_exchange.c:74
    #5 0x7f65b5130932 (+0x10a1932)
    #6 0x7f65b512b92a (+0x109c92a)
    #7 0x7f65b57c1488 (+0x1732488)
    #8 0x7f65b48e1f99 (+0x852f99)
    #9 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #10 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #11 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #12 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 24 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b81ef5d4 (+0x15d4)
    #2 0x7f65ba28a7db in opal_db_base_fetch 
../../../../opal/mca/db/base/db_base_fns.c:133
    #3 0x7f65bb43e4df in ompi_rte_db_fetch 
../../../../../ompi/mca/rte/orte/rte_orte_module.c:281
    #4 0x7f65bb3eeb16 in ompi_modex_recv 
../../ompi/runtime/ompi_module_exchange.c:74
    #5 0x7f65b5130932 (+0x1099932)
    #6 0x7f65b512b79e (+0x109479e)
    #7 0x7f65b57c1589 (+0x172a589)
    #8 0x7f65b48e1f99 (+0x84af99)
    #9 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #10 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #11 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #12 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 16 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65b5130980 (+0x10a1980)
    #2 0x7f65b512b79e (+0x109c79e)
    #3 0x7f65b57c1589 (+0x1732589)
    #4 0x7f65b48e1f99 (+0x852f99)
    #5 0x7f65bb3e9d1b in ompi_mpi_init ../../ompi/runtime/ompi_mpi_init.c:771
    #6 0x7f65bb40ca20 in PMPI_Init 
/data/vjoost/openmpi-1.8.1/build/ompi/mpi/c/profile/pinit.c:84
    #7 0x4006f3 in main /data/vjoost/openmpi-1.8.1/debug/test.c:4
    #8 0x3f9181ed1c in __libc_start_main (/lib64/libc.so.6+0x3f9181ed1c)

Indirect leak of 1 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba247f79 in opal_bitmap_init ../../opal/class/opal_bitmap.c:100
    #2 0x7f65ba50ba88 in opal_obj_run_constructors 
../../../../opal/class/opal_object.h:424
    #3 0x7f65ba50ba88 in opal_obj_new ../../../../opal/class/opal_object.h:474
    #4 0x7f65ba50ba88 in process_uri 
../../../../orte/mca/oob/base/oob_base_stubs.c:347
    #5 0x7f65ba50c564 in orte_oob_base_set_addr 
../../../../orte/mca/oob/base/oob_base_stubs.c:296
    #6 0x7f65ba28f534 in event_process_active_single_queue 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1367
    #7 0x7f65ba28f534 in event_process_active 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1437
    #8 0x7f65ba28f534 in opal_libevent2021_event_base_loop 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1645
    #9 0x7f65ba4fec0d in orte_progress_thread_engine 
../../../../orte/mca/ess/base/ess_base_std_app.c:456
    #10 0x3f924079d0 in start_thread (/lib64/libpthread.so.0+0x3f924079d0)

Indirect leak of 1 byte(s) in 1 object(s) allocated from:
    #0 0x7f65ba7633a8 in __interceptor_malloc 
../../../../gcc/libsanitizer/lsan/lsan_interceptors.cc:66
    #1 0x7f65ba247f79 in opal_bitmap_init ../../opal/class/opal_bitmap.c:100
    #2 0x7f65b6bf0098 (+0xe098)
    #3 0x7f65ba50b96b in process_uri 
../../../../orte/mca/oob/base/oob_base_stubs.c:368
    #4 0x7f65ba50c564 in orte_oob_base_set_addr 
../../../../orte/mca/oob/base/oob_base_stubs.c:296
    #5 0x7f65ba28f534 in event_process_active_single_queue 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1367
    #6 0x7f65ba28f534 in event_process_active 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1437
    #7 0x7f65ba28f534 in opal_libevent2021_event_base_loop 
../../../../../../opal/mca/event/libevent2021/libevent/event.c:1645
    #8 0x7f65ba4fec0d in orte_progress_thread_engine 
../../../../orte/mca/ess/base/ess_base_std_app.c:456
    #9 0x3f924079d0 in start_thread (/lib64/libpthread.so.0+0x3f924079d0)

SUMMARY: LeakSanitizer: 29057 byte(s) leaked in 84 allocation(s).

Reply via email to