Hi, Thanks everyone for your answer. I was aware of Plasma and knew it seemed to be discontinued (and I think only working on UNIX ?), so I don't think it is in an usable state. For UCX, I was not aware this could pass data over shared memory. I will look into it and see if this is usable. Else I might also implement something on my side or use another library to do what I want.
Thanks, Louis ________________________________ De : Yibo Cai <[email protected]> Envoyé : mercredi 20 juillet 2022 04:51 À : [email protected] <[email protected]> Objet : Re: [C++] Shared memory Hi Louis, Arrow FlightRPC supports UCX transport, which supports IPC over shared memory. Please note UCX support is still experimental, with few documents now. Yibo On 7/19/22 16:51, Louis C wrote: > > Hello, > > For IPC purposes, I was interested in "shared memory" to pass data > between processes. The idea would be to create a named shared memory > zone (not backed by any file), and write Arrow data in it, then read > back this data in another process. On linux this would probably > correspond to something like calling "shm_open" and then mmap this > region, before writing Arrow data in it. > Looking at the docs and the code of Arrow, I think that it is not > possible using only Arrow. The only class that comes close to what I > would like is "MemoryMappedFile" which is an input/output class to a > real file on disk (but mapped in memory at the openning). > Is this correct ? Is there any plan in the future to directly support > this feature ? > > Best regards, > Louis C.
