Hi, I have a question about how to decide the block size. As I understanding, the block size is related to namenode's heap size(how many blocks can be handled), total storage capacity of clusters, the files size (depends on applications, e.g. 1T log file), #of replicas, and the performance of mapreduce. In Google's paper, they used 64MB as their block size. Yahoo and Facebook seems set block size to 128MB. Hadoop default value is 64MB. I don't know why 64MB or 128MB. Is that the result from the tradeoff as I mentioned above? How do I decide the block size if I want to build my application upon Hadoop? Is their any criterion or formula?
Any opinions or comments will be appreciate. stchu
