Luosuu commented on issue #38275: URL: https://github.com/apache/arrow/issues/38275#issuecomment-1765343917
@mapleFU Hi, thank you for reply. The memory-mapped files are pretty large and cannot fit into the CPU RAM at once I believe.. BTW, if I convert all those files from arrow streaming format to arrow file (random access format) and use `open_file` instead of `open_stream`, should I observe the performance difference? Or after `read_all` the speed of accessing RecordBatches on the disk should be the same. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
