The project I’m working on is a larger toolchain (written in Python) to run
regression tests. The part that does the data comparison is fairly small. Speed
is not crucial but doing the data comparison in python was incredibly slow. So
we went with a C++ extension. For everything else python work
Depending on your exact usage and the data contained in the CDF-5 files I
guess netcdf4-python would work for reading the files (if the underlying
netcdf library is compiled against pnetcdf).
However, this will not immediately yield mpi features. Yet, reading
different segments of files could be ma
On 17 September 2015 at 18:56, Jeff Squyres (jsquyres)
wrote:
> On Sep 17, 2015, at 11:44 AM, Joel Hermanns wrote:
>>
>> Thanks for the quick answer!
>
> Be sure to see Nick's answer, too -- mpi4py is a nice package.
>
>> I have a few questions now:
>>
>> 1. Are there any downsides of using —disa
> FYI, you can also see what they have done in mpi4py to by-pass this problem.
Could you elaborate on this or give me some pointer to other resources?
> I would actually highly recommend you to use mpi4py rather than implementing
> this from scratch your-self ;)
I fully agree that it is a bad
On Sep 17, 2015, at 11:44 AM, Joel Hermanns wrote:
>
> Thanks for the quick answer!
Be sure to see Nick's answer, too -- mpi4py is a nice package.
> I have a few questions now:
>
> 1. Are there any downsides of using —disable-dlopen?
You won't be able to add or remove plugins in the filesyste
Thanks for the quick answer!
I have a few questions now:
1. Are there any downsides of using —disable-dlopen?
2. Are there any other options? We might not be able to change MPI
installation, when this is running on a supercomputer.
Joel
On 17 Sep 2015, at 17:21, Jeff Squyres (jsquyres) wrote:
FYI, you can also see what they have done in mpi4py to by-pass this
problem.
I would actually highly recommend you to use mpi4py rather than
implementing this from scratch your-self ;)
2015-09-17 15:21 GMT+00:00 Jeff Squyres (jsquyres) :
> Short version:
>
> The easiest way to do this is to confi
Short version:
The easiest way to do this is to configure your Open MPI installation with
--disable-dlopen.
More detail:
Open MPI uses a bunch of plugins for its functionality. When you dlopen libmpi
in a private namespace (like Python does), and then libmpi tries to dlopen its
plugins, the
