[
https://issues.apache.org/jira/browse/HADOOP-6558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tsz Wo (Nicholas), SZE moved MAPREDUCE-1431 to HADOOP-6558:
-----------------------------------------------------------
Component/s: (was: harchive)
fs
Fix Version/s: (was: 0.22.0)
0.22.0
Key: HADOOP-6558 (was: MAPREDUCE-1431)
Project: Hadoop Common (was: Hadoop Map/Reduce)
> archive does not work with distcp -update
> -----------------------------------------
>
> Key: HADOOP-6558
> URL: https://issues.apache.org/jira/browse/HADOOP-6558
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Reporter: Tsz Wo (Nicholas), SZE
> Assignee: Mahadev konar
> Fix For: 0.22.0
>
>
> The following distcp command works.
> {noformat}
> hadoop distcp -Dmapred.job.queue.name=q
> har://hdfs-nn_hostname:8020/user/tsz/t101.har/t101 t101_distcp
> {noformat}
> However, it does not work for -update.
> {noformat}
> -bash-3.1$ hadoop distcp -Dmapred.job.queue.name=q -update
> har://hdfs-nn_hostname:8020/user/tsz/t101.har/t101 t101_distcp
> 10/01/29 20:06:53 INFO tools.DistCp:
> srcPaths=[har://hdfs-nn_hostname:8020/user/tsz/t101.har/t101]
> 10/01/29 20:06:53 INFO tools.DistCp: destPath=t101
> java.lang.IllegalArgumentException: Wrong FS:
> har://hdfs-nn_hostname:8020/user/tsz/t101.har/t101/text-00000000, expected:
> hdfs://nn_hostname
> at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:310)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.java:99)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:155)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.getFileChecksum(DistributedFileSystem.java:463)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.getFileChecksum(DistributedFileSystem.java:46)
> at
> org.apache.hadoop.fs.FilterFileSystem.getFileChecksum(FilterFileSystem.java:250)
> at org.apache.hadoop.tools.DistCp.sameFile(DistCp.java:1204)
> at org.apache.hadoop.tools.DistCp.setup(DistCp.java:1084)
> ...
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
