Hadoop's CRC checking mechanism. So, I looking forward
to implement external CRC checker for Hadoop.
Regards,
Thamizhannal P
--- On Mon, 11/4/11, Josh Patterson j...@cloudera.com wrote:
From: Josh Patterson j...@cloudera.com
Subject: Re: Reg HDFS checksum
To: common-user@hadoop.apache.org
Cc
...@cloudera.com wrote:
From: Josh Patterson j...@cloudera.com
Subject: Re: Reg HDFS checksum
To: common-user@hadoop.apache.org
Cc: Thamizh tceg...@yahoo.co.in
Date: Monday, 11 April, 2011, 7:53 PM
Thamizh,
For a much older project I wrote a demo tool that computed the hadoop
style checksum locally
On 12/04/2011 07:06, Josh Patterson wrote:
If you take a look at:
https://github.com/jpatanooga/IvoryMonkey/blob/master/src/tv/floe/IvoryMonkey/hadoop/fs/ExternalHDFSChecksumGenerator.java
you'll see a single process version of what HDFS does under the hood,
albeit in a highly distributed
file? If you have some reference please share me. It would be great help for
me.
Regards,
Thamizhannal P
--- On Sat, 9/4/11, Harsh J ha...@cloudera.com wrote:
From: Harsh J ha...@cloudera.com
Subject: Re: Reg HDFS checksum
To: common-user@hadoop.apache.org
Date: Saturday, 9 April
Hello Thamizh,
Perhaps the discussion in the following link can shed some light on
this: http://getsatisfaction.com/cloudera/topics/hadoop_fs_crc
On Fri, Apr 8, 2011 at 5:47 PM, Thamizh tceg...@yahoo.co.in wrote:
Hi All,
This is question regarding HDFS checksum computation.
--
Harsh J
Hi All,
This is question regarding HDFS checksum computation.
I understood that When we read a file from HDFS by default it verifies the
checksum and your read would not succeed if the file is corrupted. Also CRC is
internal to hadoop.
Here are my questions:
1. How can I use hadoop dfs -get
