Re: Hadoop fs -getmerge

2013-04-22 Thread Daryn Sharp
If -getmerge is updated, specifically deleting the .crc is not necessary. Adding an option that invokes fs.writeChecksum via a cmdline option should do the trick. On Apr 18, 2013, at 2:41 AM, Fabio Pitzolu wrote: Hi Hemanth, I guess that the only solution is to delete the crc files after the

Hadoop fs -getmerge

2013-04-17 Thread Fabio Pitzolu
Hi all, is there a way to use the *getmerge* fs command and not generate the .crc files in the output local directory? Thanks, Fabio Pitzolu**

Re: Hadoop fs -getmerge

2013-04-17 Thread 姚吉龙
Use this command:hadoop fs -getmerge  <file in hdfs> <local> — Sent from Mailbox for iPhone On Wed, Apr 17, 2013 at 10:40 PM, Fabio Pitzolu fabio.pitz...@gr-ci.com wrote: Hi all, is there a way to use the *getmerge* fs command and not generate the .crc files in the output local directory?

Re: Hadoop fs -getmerge

2013-04-17 Thread Hemanth Yamijala
I don't think that is possible. When we use -getmerge, the destination filesystem happens to be a LocalFileSystem which extends from ChecksumFileSystem. I believe that's why the CRC files are getting in. Would it not be possible for you to ignore them, since they have a fixed extension ? Thanks