Sean Mackrory created HADOOP-14172:
--------------------------------------
Summary: S3Guard: import does not import empty directory
Key: HADOOP-14172
URL: https://issues.apache.org/jira/browse/HADOOP-14172
Project: Hadoop Common
Issue Type: Sub-task
Reporter: Sean Mackrory
It imports everything comes up from listFiles, which includes only files (and
their parent directories as a side-effect). My first thought on doing this
would be to override S3AFileSystem to add an optional parameter to use
AcceptAllButSelfAndS3nDirs instead of AcceptFilesOnly. But we could also
manually traverse the tree to get all FileStatus objects directory by directory
like we do for diff. That's far slower but doesn't add surface area to
S3AFileSystem. But there's also the impact to other S3 clients to worry about -
I could go either way on that.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
