jerqi commented on issue #955: URL: https://github.com/apache/incubator-uniffle/issues/955#issuecomment-1593356545
> ok. what do you mean by > > > We should set it according to the partition number of shuffle server Actually, we just the use 80G heap to run the shuffle server in our production env. Our machine is 150G. It's enough for several TBs shuffle with 1000 executors to use 9 shuffle server. We estimate the max task concurrency in our production env. Max task concurrency means the max partitions which we need hold it in the memory of shuffle sever. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@uniffle.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
