zhztheplayer opened a new pull request, #11456: URL: https://github.com/apache/incubator-gluten/pull/11456
For allocating global off-heap memory in Gluten, we have been using the storage-memory-based approach provided by utility `GlobalOffHeapMemory` (which is being renamed and deprecated in this PR). However, so far we noticed that the approach didn't bring us much benefit compared to directly allocating from off-heap execution memory via a process-wise dummy task memory manager. The PR refactors the code to rollback to the later solution instead. The main reason we do this is for more conveniently reusing the existing tree consumer code in Gluten, which helps memory allocations to account themselves to Spark with a specific name and category, which helps user and developer track these allocations, both in production and test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
