Re: Block placement in HDFS

2008-11-25 Thread Hyunsik Choi
Hi All, I try to divide some data into partitions explicitly (like regions of Hbase). I wonder the following way to do is the best method. For example, when we assume a block size 64MB, a file potion corresponding to 0~63MB is allocated to first block? I have three questions as follows: Is the

Re: Block placement in HDFS

2008-11-25 Thread Pete Wyckoff
Fyi - Owen is referring to: https://issues.apache.org/jira/browse/HADOOP-2559 On 11/24/08 10:22 PM, "Owen O'Malley" <[EMAIL PROTECTED]> wrote: On Nov 24, 2008, at 8:44 PM, Mahadev Konar wrote: > Hi Dennis, > I don't think that is possible to do. No, it is not possible. > The block place

Re: Block placement in HDFS

2008-11-25 Thread Dhruba Borthakur
Hi Dennis, There were some discussions on this topic earlier: http://issues.apache.org/jira/browse/HADOOP-3799 Do you have any specific use-case for this feature? thanks, dhruba On Mon, Nov 24, 2008 at 10:22 PM, Owen O'Malley <[EMAIL PROTECTED]> wrote: > > On Nov 24, 2008, at 8:44 PM, Mahadev

Re: Block placement in HDFS

2008-11-24 Thread Owen O'Malley
On Nov 24, 2008, at 8:44 PM, Mahadev Konar wrote: Hi Dennis, I don't think that is possible to do. No, it is not possible. The block placement is determined by HDFS internally (which is local, rack local and off rack). Actually, it was changed in 0.17 or so to be node-local, off-rack, a

Re: Block placement in HDFS

2008-11-24 Thread Mahadev Konar
Hi Dennis, I don't think that is possible to do. The block placement is determined by HDFS internally (which is local, rack local and off rack). mahadev On 11/24/08 6:59 PM, "dennis81" <[EMAIL PROTECTED]> wrote: > > Hi everyone, > > I was wondering whether it is possible to control the pl