zhztheplayer opened a new issue, #7750:
URL: https://github.com/apache/incubator-gluten/issues/7750

   ### Description
   
   So far `ColumnarBuildSideRelation` is allocated on Spark JVM heap memory.
   
   ```
   case class ColumnarBuildSideRelation(output: Seq[Attribute], batches: 
Array[Array[Byte]]) {
     ...
   }
   ```
   
   It appears that we can replace `batches: Array[Array[Byte]]` with an 
off-heap allocated container to move the memory usage to off-heap. This could 
avoid some of the heap OOM issues.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to