mapleFU commented on issue #37139: URL: https://github.com/apache/arrow/issues/37139#issuecomment-1698528219
> Yeah, I get it that it is doing prefetching, but why memory is not dropping after iteration, with batch, but it is increasing after every iteration, is it possible cause of the Python and Linux combination? I also noticed in the macOS, it is being steady, but not quite sure, this happens over the span of 6 hours. Have you fixed this? I've checked the code and I think memory would be released if fetch is done. If you still meet the problem, would you mind provide the code? And I can debug here. @unReaLaneS -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
