xianjingfeng commented on issue #339:
URL:
https://github.com/apache/incubator-uniffle/issues/339#issuecomment-1328017090
> Thanks for pointing out that. I did a quick look at the shuffle write
client code, it seems that the `sendShuffleData` process is blocked by the
first round to the primary shuffle servers. I think rather to reduce the
`rss.client.send.check.timeout.ms` settings(-> which causes task retry), how
about refactor `sendShuffleDataAsync` to return early and the send round of
`sendShuffleDataAsync` could start asap.
>
> The purpose of sending data concurrently is that once a request finished,
the whole sending process would finish, which avoids busy/flaky servers.
`rss.client.send.check.timeout.ms` is for limit the max time to finish send
blocks to all replicas. And how to let it return early is what we need discuss.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
