mapleFU commented on issue #38275: URL: https://github.com/apache/arrow/issues/38275#issuecomment-1766516940
Oh that's interesting, so here when initialize, the `RecordBatch` is "decoded", however, it might uses memory allocated by mmap. And when you reading it using threading, you might suffer from swap. Can you report the OS and disk you're actually using? I'm a bit busy on work days but I'll try to reproduce this when I have spare time. Also cc @kou do you have any advice on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
