Is disk use reported with replication?

2013-04-22 Thread Keith Wiley
Simple question: When I issue a "hadoop fs -du" command and/or when I view the namenode web UI to see HDFS disk utilization (which the namenode reports both as bytes and percentage), should I expect to see disk use reported as "true data size" or as replicated size (e.g. with 3X replication, sho

Re: Is disk use reported with replication?

2013-04-23 Thread burberry blues
Hi I am new to Hadoop world. Can you please let me know what is a hadoop stack? Thanks, Burberry On Mon, Apr 22, 2013 at 10:19 AM, Keith Wiley wrote: > Simple question: When I issue a "hadoop fs -du" command and/or when I view > the namenode web UI to see HDFS disk utilization (which the name

Re: Is disk use reported with replication?

2013-04-23 Thread Harsh J
Hi Keith, The "fs -du" computes length of files, and would not report replicated on-disk size. HDFS disk utilization OTOH, is the current, simple report of used/free disk space, which would certainly include replicated data. On Mon, Apr 22, 2013 at 10:49 PM, Keith Wiley wrote: > Simple question: