liuxiaolong created HADOOP-17256: ------------------------------------ Summary: DistCp -update option will be invalid when distcp files from hdfs to S3 Key: HADOOP-17256 URL: https://issues.apache.org/jira/browse/HADOOP-17256 Project: Hadoop Common Issue Type: Bug Components: tools/distcp Reporter: liuxiaolong
We use distcp with -update option to copy a dir from hdfs to S3. When we run distcp job once more, it will overwrite S3 dir directly, rather than skip the same files. Test Case: 1. Run twice distcp cmd, the modify time of S3 files will be modified hadoop distcp -update /testA/ s3a://tiered-storage-bigdata-1251625956/testA/ -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org