[ http://issues.apache.org/jira/browse/HADOOP-738?page=comments#action_12451472 ] Yoram Arnon commented on HADOOP-738: ------------------------------------
local files in general do not have a crc file associated with them. making a local copy of dfs file implies losing the crc file IMO, just like putting a file into dfs should assume the source filed doesn't have a crc file associated with it. yes, we lose something, but that something is the norm in the local fs world. To me that makes sense, especially since the crc files are hidden, and thus confusing for the uninitiated. > dfs get or copyToLocal should not copy crc file > ----------------------------------------------- > > Key: HADOOP-738 > URL: http://issues.apache.org/jira/browse/HADOOP-738 > Project: Hadoop > Issue Type: Bug > Components: dfs > Affects Versions: 0.8.0 > Environment: all > Reporter: Milind Bhandarkar > Assigned To: Milind Bhandarkar > Fix For: 0.9.0 > > Attachments: hadoop-crc.patch > > > Currently, when we -get or -copyToLocal a directory from DFS, all the files > including crc files are also copied. When we -put or -copyFromLocal again, > since the crc files already exist on DFS, this put fails. The solution is not > to copy checksum files when copying to local. Patch is forthcoming. -- This message is automatically generated by JIRA. - If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa - For more information on JIRA, see: http://www.atlassian.com/software/jira
