If -getmerge is updated, specifically deleting the .crc is not necessary.
Adding an option that invokes fs.writeChecksum via a cmdline option should do
the trick.
On Apr 18, 2013, at 2:41 AM, Fabio Pitzolu wrote:
Hi Hemanth,
I guess that the only solution is to delete the crc files after the
Hi all,
is there a way to use the *getmerge* fs command and not generate the .crc
files in the output local directory?
Thanks,
Fabio Pitzolu**
Use this command:hadoop fs -getmerge <file in hdfs> <local>
—
Sent from Mailbox for iPhone
On Wed, Apr 17, 2013 at 10:40 PM, Fabio Pitzolu fabio.pitz...@gr-ci.com
wrote:
Hi all,
is there a way to use the *getmerge* fs command and not generate the .crc
files in the output local directory?
I don't think that is possible. When we use -getmerge, the destination
filesystem happens to be a LocalFileSystem which extends from
ChecksumFileSystem. I believe that's why the CRC files are getting in.
Would it not be possible for you to ignore them, since they have a fixed
extension ?
Thanks