FMX commented on PR #3132: URL: https://github.com/apache/celeborn/pull/3132#issuecomment-2723171994
> @FMX I noticed the comment regarding checkpointing only after a chunk is fully read, while i'm not sure under what cases can a returned chunk be not fully read before calling `next()`, I nonetheless have addressed the comment, now checkpointing last returned chunk id on each `next()` call. PTAL! Hi, after some discussion, we found that if a chunk is returned and is not fully read, the spark task will fail, so this won't be a problem here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
