Re: How HDFS divides Files into block

2012-05-18 Thread Harsh J
Utkarsh, This question has been asked several times before. I've myself previously answered the same question at: http://www.mail-archive.com/mapreduce-user@hadoop.apache.org/msg04282.html If HDFS says its block size is 64M, then that is what the block size is. HDFS is a filesystem, and writes on

How HDFS divides Files into block

2012-05-18 Thread Utkarsh Gupta
Hi, I have a doubt about HDFS which may be a very trivial thing but I am not able to understand it. Since hdfs keeps the files in block of 64/128 MB how does HDFS splits files? The problem which I see is that suppose I have a long string in my input file as: 672364,423746273,4234234,2,342,34,2