symious commented on PR #5603: URL: https://github.com/apache/hadoop/pull/5603#issuecomment-1532347000
The issue we met was not "source file needs copying again", but source file uploaded with a different checksum type. Because it's distcp, so the temp file was removed after the exception. We need to first skip the crc check, then run "hadoop fs -checksum" on the source file and target file to find out the root cause of this one. The initial idea of this addition of log was to help others with the same issue to save to process of redundant works and just check the log for mismatch reasons. @steveloughran @ayushtkn -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
