ben-roling commented on a change in pull request #19: CRUNCH-677 Source and
Target accept FileSystem
URL: https://github.com/apache/crunch/pull/19#discussion_r259011894
##########
File path:
crunch-core/src/main/java/org/apache/crunch/io/impl/FileTargetImpl.java
##########
@@ -178,7 +206,7 @@ public void handleOutputs(Configuration conf, Path
workingPath, int index) throw
if (useDistributedCopy) {
LOG.info("Source and destination are in different file systems,
performing distributed copy from {} to {}", srcPattern,
path);
- handeOutputsDistributedCopy(conf, srcPattern, srcFs, dstFs,
maxDistributedCopyTasks);
+ handleOutputsDistributedCopy(dstFsConf, srcPattern, srcFs, dstFs,
maxDistributedCopyTasks);
Review comment:
This is a cherry-pick merge mistake causing the build to fail. I'll fix in
a second and make sure the build and all tests are passing. Btw, this was
originally developed on an internal fork and reviewed with my colleagues,
@noslowerdna and @mkwhitacre.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
