HDFS uses 4GB for the file + checksum data.
Default is for every 512 bytes of data, 4 bytes of checksum are stored. In
this case additional 32MB data.
On Tue, Nov 20, 2012 at 11:00 PM, WangRamon wrote:
> Hi All
>
> I'm wondering if there is an additional overhead when storing some data
> into H
Thanks, besides the checksum data is there anything else? Data in name node?
Date: Tue, 20 Nov 2012 23:14:06 -0800
Subject: Re: Is there an additional overhead when storing data in HDFS?
From: sur...@hortonworks.com
To: user@hadoop.apache.org
HDFS uses 4GB for the file + checksum data.
Default
t; Subject: Re: Is there an additional overhead when storing data in HDFS?
> From: sur...@hortonworks.com
> To: user@hadoop.apache.org
>
>
> HDFS uses 4GB for the file + checksum data.
>
> Default is for every 512 bytes of data, 4 bytes of checksum are stored. In
> this cas
tored in journal/fsimage.
>
>
> On Tue, Nov 20, 2012 at 11:21 PM, WangRamon wrote:
>
>> Thanks, besides the checksum data is there anything else? Data in name
>> node?
>>
>> --
>> Date: Tue, 20 Nov 2012 23:14:06 -0800
>> S
Thank guys, great job.
From: donta...@gmail.com
Date: Wed, 21 Nov 2012 13:23:08 +0530
Subject: Re: Is there an additional overhead when storing data in HDFS?
To: user@hadoop.apache.org
Hello Ramon,
Why don't you go through this link once :
http://www.aosabook.org/en/hdfs.htmlSuresh and
