Adam Maroti created HADOOP-17611:
------------------------------------
Summary: Distcp parallel file copy breaks the modification time
Key: HADOOP-17611
URL: https://issues.apache.org/jira/browse/HADOOP-17611
Project: Hadoop Common
Issue Type: Bug
Reporter: Adam Maroti
The commit HADOOP-11794. Enable distcp to copy blocks in parallel.
(bf3fb585aaf2b179836e139c041fc87920a3c886) broke the modification time of large
files.
In CopyCommitter.java inside concatFileChunks Filesystem.concat is called which
changes the modification time therfore the modification times of files copeid
by distcp will not match the source files. However this only occures for large
enough files, which are copied by splitting them up by distcp.
In concatFileChunks. before calling concat extract the modification time and
apply that to the concatenated resulting file after the concat. (probably best
after the rename()).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
