RE: Question about DFS Reserved Space

2011-06-10 Thread Bible, Landy
-Original Message- From: Harsh J [mailto:ha...@cloudera.com] Sent: Thursday, June 09, 2011 12:14 PM To: common-user@hadoop.apache.org Subject: Re: Question about DFS Reserved Space >Landy, >>On Thu, Jun 9, 2011 at 10:05 PM, Bible, Landy wrote: >> Hi all, >> >>

Re: Question about DFS Reserved Space

2011-06-09 Thread Koji Noguchi
My understanding of hdfs is limited but I believe it's > DFS will use (total disk size - 10 GB) and not > always leave 10 GB free? Datanode simply does 'df' - reserve_space(10G) and *use* up to that amount. Koji On 6/9/11 10:13 AM, "Harsh J" wrote: > Landy, > > On Thu, Jun 9, 2011 at 10:

Re: Question about DFS Reserved Space

2011-06-09 Thread Harsh J
Landy, On Thu, Jun 9, 2011 at 10:05 PM, Bible, Landy wrote: > Hi all, > > I'm planning a rather non-standard HDFS cluster.   The machines will be doing > more than just DFS, and each machine will have varying local storage > utilization outside of DFS.  If I use the "dfs.datanode.du.reserved" p