Hello, My IPC use case involves writing a Windows-based real tlime data stream in Python, and reading it back concurrently with Rust. I tried using the IPC protocol to accomplish that, but I'm currently unsuccessful. The issue I'm facing is probably related to concurrent access to a file by the two different processes, where one is attempting to write and the other to read. Code examples can be found in this issue that I filed against the Rust (unofficial) IPC implementation (https://github.com/jorgecarleitao/arrow2/issues/301), but I believe that this problem isn't due to a faulty implementation.
My question is a bit more broad - is my use case a valid one for the IPC protocol? Do I need to (somehow) perform checks and synchronization between the two concurrent processes so that they don't access the file simultaneuosly? This is obviously easier when the two "actors" live under the same program and mutexes are available, but two different processes in two different languages seem more difficult to sync. Is there another way to achieve this? My fallback is basically writing lots of tiny independent parquet files in Python and accessing them (with some delay) in Rust. This might work but it's not a clean solution, and it may raise other filesystem-oriented issues depending on my data rate and file size limiit. Thanks in advance.
