ErikFang opened a new pull request, #3260:
URL: https://github.com/apache/celeborn/pull/3260

   ### What changes were proposed in this pull request?
   enhance celeborn to
   1. allow shuffle client to write to one partition with multiple partition 
locations parallelly
   2. allow lifecycle manager to detect  parallel level for each partition by 
partition splitting frequency
   
   CIP-18: Dynamically optimize shuffle write parallelism
   
https://docs.google.com/document/d/1CqFswIOP5nR8Cy2THo8tELOwVxUf0ZP_8pDjaYj2HGc/edit?usp=sharing
   
   ### Why are the changes needed?
   TBD
   
   
   ### Does this PR introduce _any_ user-facing change?
   TBD
   
   
   ### How was this patch tested?
   TBD
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to