zuston commented on issue #2568: URL: https://github.com/apache/uniffle/issues/2568#issuecomment-3143280521
Another point is that the MutableShuffleHandleInfo has the unreasonable data structure. <img width="1166" height="493" alt="Image" src="https://github.com/user-attachments/assets/a7836f98-1b86-4ff6-a2fb-207a5bd5bccf"; /> Normally the partition number will be large but the assigned shuffle-servers will be less than the partition number, so in the current codebase, the grpc proto structure will stored duplicate structure, this will make driver have a large burden, and we could use the following structure to simplify this logic in the grpc proto. `Map<ShuffleServerInfo,` List<PartitionId>> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
