zhengchenyu commented on PR #2421: URL: https://github.com/apache/uniffle/pull/2421#issuecomment-2765909671
Add debug log [here](https://github.com/apache/uniffle/blob/76a4dcf76b41529dfda36569140c48c3f0554722/storage/src/main/java/org/apache/uniffle/storage/handler/impl/HadoopClientReadHandler.java#L141): <img width="933" alt="截屏2025-03-31 18 56 38" src="https://github.com/user-attachments/assets/23b0f29f-5ccd-46e0-b009-dabdcef9242b"; /> Then found the log like this ``` file name is 10.36.212.203-58685_0_0.data, shuffleServerId is 10.36.212.203-58685-17000 ``` This is an obvious problem. It is caused by the mismatch of server id. The integration test two modes, GRPC and GRPC_NETTY. When MR uses GRPC, the netty port is used to form the service id, so an error is reported. From [here](https://github.com/apache/uniffle/blob/76a4dcf76b41529dfda36569140c48c3f0554722/client-mr/core/src/main/java/org/apache/hadoop/mapreduce/v2/app/RssMRAppMaster.java#L349), we know that RssMRAppMaster determines whether to enable netty by checking whether the netty port is -1. #1919 changed the default netty port from -1 to 17000. So the problem occurs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
