Re: Getting free and used space

2009-05-02 Thread Stas Oskin
Hi. Actually, I'm trying to use the getDiskStatus() function, but it doesn't seem to work so well in 0.18.3. Can someone advice of a reliable way to get the HDFS overall free and used space? Same function that reports the space to the NameNode web panel? Thanks. 2009/5/2 Edward Capriolo > You

Re: Getting free and used space

2009-05-02 Thread Edward Capriolo
You can also pull these variables from the name node, datanode with JMX. I am doing this to graph them with cacti. Both the JMX READ/WRITE and READ user can access this variable. On Tue, Apr 28, 2009 at 8:29 AM, Stas Oskin wrote: > Hi. > > Any idea if the getDiskStatus() function requires superus

Re: Getting free and used space

2009-04-28 Thread Stas Oskin
Hi. Any idea if the getDiskStatus() function requires superuser rights? Or it can work for any user? Thanks. 2009/4/9 Aaron Kimball > You can insert this propery into the jobconf, or specify it on the command > line e.g.: -D hadoop.job.ugi=username,group,group,group. > > - Aaron > > On We

Re: Getting free and used space

2009-04-08 Thread Aaron Kimball
You can insert this propery into the jobconf, or specify it on the command line e.g.: -D hadoop.job.ugi=username,group,group,group. - Aaron On Wed, Apr 8, 2009 at 7:04 AM, Brian Bockelman wrote: > Hey Stas, > > What we do locally is apply the latest patch for this issue: > https://issues.apa

Re: Getting free and used space

2009-04-08 Thread Brian Bockelman
Hey Stas, What we do locally is apply the latest patch for this issue: https://issues.apache.org/jira/browse/HADOOP-4368 This makes getUsed (actually, it switches to FileSystem.getStatus) not a privileged action. As far as specifying the user ... gee, I can't think of it off the top of my

Re: Getting free and used space

2009-04-08 Thread Stas Oskin
Hi. Thanks for the explanation. Now for the easier part - how do I specify the user when connecting? :) Is it a config file level, or run-time level setting? Regards. 2009/4/8 Brian Bockelman > Hey Stas, > > Did you try this as a privileged user? There might be some permission > errors... i

Re: Getting free and used space

2009-04-08 Thread Brian Bockelman
Hey Stas, Did you try this as a privileged user? There might be some permission errors... in most of the released versions, getUsed() is only available to the Hadoop superuser. It may be that the exception isn't propagating correctly. Brian On Apr 8, 2009, at 3:13 AM, Stas Oskin wrote:

Getting free and used space

2009-04-08 Thread Stas Oskin
Hi. I'm trying to use the API to get the overall used and free spaces. I tried this function getUsed(), but it always returns 0. Any idea? Thanks.