Hexiaoqiao commented on PR #8312: URL: https://github.com/apache/hadoop/pull/8312#issuecomment-4349780682
> the lastIBR timestamp was only updated on success. A failed RPC left lastIBR stale, so sendImmediately() returned true on every subsequent heartbeat. This should be the right way at DataNode side IMO, otherwise, Incremental Block information could not be updated in time and lead to other issues. > Under high NameNode load this creates a positive feedback loop: failures trigger immediate retries, which increase NameNode contention, which causes more failures. For this case, we should improve performance at NameNode side rather than downgrade DataNode IBR. FYI. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
