[
https://issues.apache.org/jira/browse/HADOOP-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13067813#comment-13067813
]
Uma Maheswara Rao G commented on HADOOP-7178:
---------------------------------------------
Hi Daryn,
Thanks a lot for taking a look on this issue.
Client app will deal with FileSystem APIs only right?
{code}
public void copyToLocalFile(boolean delSrc, Path src, Path dst)
throws IOException {
FileUtil.copy(this, src, getLocal(getConf()), dst, delSrc, getConf());
}
{code}
But here it will select LocalFileSystem always.
What my idea is, if client app calls ignoreCrc on fs, then it sould internally
set verifyCheckSum to false and also selects the RawLocalFileSystem instead of
LocalFileSystem.
Give me your opinion on this.
> FileSystem should have an option to control the .crc file creations at Local.
> -----------------------------------------------------------------------------
>
> Key: HADOOP-7178
> URL: https://issues.apache.org/jira/browse/HADOOP-7178
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Uma Maheswara Rao G
> Assignee: Uma Maheswara Rao G
> Attachments: HADOOP-7178_COMMON.patch, HADOOP-7178_HDFS.patch
>
>
> When we copy the files from DFS to local, it is creating the .crc files in
> local filesystem for the verification of checksum. When user dont want to do
> any check sum verifications, this files will not be useful.
> Command line already has an option ignoreCrc, to control this.
> So, we should have the similar option on FileSystem also..... like
> fs.ignoreCrc().
> This should set the setVerifyChecksum to false and also should select the
> non CheckSumFileSystem as local fs.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
