xianjingfeng commented on issue #407: URL: https://github.com/apache/incubator-uniffle/issues/407#issuecomment-1350556392
> Emm... It's too big. For huge partition, 200G data size is normal. I mean even if we cache all the local index files, we won't use too much memory. I think 3g is enough for most servers. For us, the bottleneck is the network and disk, not the memory. > Besides, we'd better to have a unified memory manager in shuffle-server if using this cache. You are right. And I think we should do this after #133 . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
