zuston opened a new pull request, #11213:
URL: https://github.com/apache/incubator-gluten/pull/11213

   ## What changes are proposed in this pull request?
   
   Uniffle’s partition reassignment mechanism enables fast switching to 
alternative shuffle servers, improving performance and stability. However, in 
the previous Uniffle integration with Gluten, this mechanism did not function 
properly due to a missing trigger, which could cause significant partition 
backpressure without activating multi shuffle-server load balancing.
   
   This PR also enables fast fail for the shuffle writer in case any data is 
lost.
   
   ## How was this patch tested?
   
   Existing tests are sufficient
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to