FelixYBW commented on issue #11876: URL: https://github.com/apache/gluten/issues/11876#issuecomment-5839512322
The root cause is that memory utilization measured from sar/telegraf is the physical memory allocated. While the used bytes tracked by the memory manager are logical memory. This happens during table scans because we started too many I/O threads, which allocated a large block of memory to be filled by remote reads, but it's not yet filled. Finally, OOM was raised. the solution is to reduce the inflight IO. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
