Re: Metadata size for 1 TB HDFS data?

2012-12-20 Thread Mohammad Tariq
Thank you so much for the valuable response Stephen. But I have a few questions to ask here. Could you please elaborate a bit, if possible? Each of the specified objects are totally different from each other. A file will be smaller than a directory in size, and a directory might be smaller than a

Re: Metadata size for 1 TB HDFS data?

2012-12-20 Thread Stephen Fritz
Each block, file, and directory is an object in the namenodes heap, so it depends on how you're storing your data. You may need to account for those in your calculations. On Thu, Dec 20, 2012 at 7:01 AM, Mohammad Tariq wrote: > Hello group, > > What could be the approx. size of the met

Metadata size for 1 TB HDFS data?

2012-12-20 Thread Mohammad Tariq
Hello group, What could be the approx. size of the metadata if I have 1 TB of data in my HDFS?I am not doing anything additional but just a simple put. Will it be ((1*1024*1024)/64)*200 Bytes? *Keeping 64M as the block size. Is my understanding right?Please correct me if i'm wrong. Many