[ https://issues.apache.org/jira/browse/HADOOP-14707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153894#comment-16153894 ]
Steve Loughran commented on HADOOP-14707: ----------------------------------------- Issue is that even if you don't set -p, you can't use distcp to upload the .raw stuff from an encrypted HDFS zone, as that force sets the -preserve flag, which of course fails against: s3a, wasb, adl, ... > AbstractContractDistCpTest to test attr preservation with -p, verify > blobstores downgrade > ----------------------------------------------------------------------------------------- > > Key: HADOOP-14707 > URL: https://issues.apache.org/jira/browse/HADOOP-14707 > Project: Hadoop Common > Issue Type: Improvement > Components: fs, fs/azure, fs/s3, test, tools/distcp > Affects Versions: 2.9.0 > Reporter: Steve Loughran > Assignee: Steve Loughran > Priority: Minor > > It *may* be that trying to use {{distcp -p}} with S3a triggers a stack trace > {code} > java.lang.UnsupportedOperationException: S3AFileSystem doesn't support > getXAttrs > at org.apache.hadoop.fs.FileSystem.getXAttrs(FileSystem.java:2559) > at > org.apache.hadoop.tools.util.DistCpUtils.toCopyListingFileStatus(DistCpUtils.java:322) > > {code} > Add a test to {{AbstractContractDistCpTest}} to verify that this is handled > better. What is "handle better" here? Either ignore the option or fail with > "don't do that" text -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org