advancedxy commented on issue #133: URL: https://github.com/apache/incubator-uniffle/issues/133#issuecomment-1502606303
> Based on my reading of the design document, there are two memory sections allocated for network and shuffle data storage. Would it be accurate to describe them as shared buffers? It might be hard to share memory between shuffle data and network transport, but it's possible they are shared in a unified ByteBuffer pool, that means buffers should be released to pool then usable for other uses. I believe we should do it in baby steps, the netty rpc framework should be introduced first, then the off-heap memory management, then unified memory management and spill. I haven't thought it throughly, but I believe we can learn from the best. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@uniffle.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
