Re: [OMPI users] Q: Getting MPI-level memory use from OpenMPI?

2023-04-17 Thread George Bosilca via users
Some folks from ORNL have done some studies about OMPI memory usage a few years ago, but I am not sure if these studies are openly available. OMPI manages all the MCA parameters, user facing requests, unexpected messages, temporary buffers for collectives and IO. And those are, I might be slightly

Re: [OMPI users] Q: Getting MPI-level memory use from OpenMPI?

2023-04-17 Thread Brian Dobbins via users
Hi George, Got it, thanks for the info - I naively hadn't even considered that of course all the related libraries likely have their *own* allocators. So, for *OpenMPI, *it sounds like I can use my own opal_[mc]alloc calls, with a new build turning mem debugging on, to tally up and report the t

Re: [OMPI users] Q: Getting MPI-level memory use from OpenMPI?

2023-04-17 Thread George Bosilca via users
Brian, OMPI does not have an official mechanism to report how much memory OMPI allocates. But, there is hope: 1. We have a mechanism to help debug memory issues (OPAL_ENABLE_MEM_DEBUG). You could enable it and then provide your own flavor of memory tracking in opal/util/malloc.c 2. You can use a

[OMPI users] Q: Getting MPI-level memory use from OpenMPI?

2023-04-14 Thread Brian Dobbins via users
Hi all, I'm wondering if there's a simple way to get statistics from OpenMPI as to how much memory the *MPI* layer in an application is taking. For example, I'm running a model and I can get the RSS size at various points in the code, and that reflects the user data for the application, *plus*,