Hi Florin,

 Recently i had given the patch for controlling .crc files at client side.
 
 Please look at https://issues.apache.org/jira/browse/HADOOP-7178.

 Provided one extra API in FileSystem.java,
public void copyToLocalFile(boolean delSrc, Path src, Path dst, boolean 
useRawLocalFileSystem)

 If you pass useRawLocalFileSystem as true, then .crc files will not be created.

 By default copy APIs will use LocalFileSystem.java as local, LocalFileSystem 
is extends the CRCFileSysstem. so , we will get crc files at local.

FileSystem.setVerifyChecksum(false) is only for not verify the checksums. It 
will not control the .crc file creations.

Regards,
Uma

----- Original Message -----
From: Florin P <florinp...@yahoo.com>
Date: Tuesday, August 9, 2011 6:44 pm
Subject: Get rid of crc files when using FileUtil.copy(FileSystem srcFS, Path 
src, File dst, boolean deleteSource, Configuration conf)  is used
To: hdfs-user@hadoop.apache.org

> Hello!
>   We have used the method FileUtil.copy(FileSystem srcFS, Path 
> src, File dst, boolean deleteSource, Configuration conf) , and we 
> have seen that some crc files were generated for each copied file. 
> We would like that these files do not be generated. We have tried 
> to use
> FileSystem.setVerifyChecksum(false) but with no effect. We are 
> using hadoop API 0.20.2-cdh3u1-SNAPSHOT. Can you please help?
> 
> Thanks.
>   Florin
>    
>

Reply via email to