Re: Problem with Counters

2009-02-07 Thread some speed
Thank you all so much. That works. I made a stupid mistake with the naming of a local variable. so the error. :( On Thu, Feb 5, 2009 at 9:49 AM, Tom White wrote: > Try moving the enum to inside the top level class (as you already did) > and then use getCounter() passing the enum value: > > pu

Re: Problem with Counters

2009-02-05 Thread Tom White
Try moving the enum to inside the top level class (as you already did) and then use getCounter() passing the enum value: public class MyJob { static enum MyCounter{ct_key1}; // Mapper and Reducer defined here public static void main(String[] args) throws IOException { // ... Runni

Re: Problem with Counters

2009-02-05 Thread Rasit OZDAS
Sharath, You're using reporter.incrCounter(enumVal, intVal); to increment counter, I think method to get should also be similar. Try to use findCounter(enumVal).getCounter() or getCounter(enumVal). Hope this helps, Rasit 2009/2/5 some speed : > In fact I put the enum in my Reduce method as t

Re: Problem with Counters

2009-02-05 Thread some speed
In fact I put the enum in my Reduce method as the following link (from Yahoo) says so: http://public.yahoo.com/gogate/hadoop-tutorial/html/module5.html#metrics --->Look at the section under Reporting Custom Metrics. 2009/2/5 some speed > Thanks Rasit. > > I did as you said. > > 1) Put the stati

Re: Problem with Counters

2009-02-05 Thread some speed
Thanks Rasit. I did as you said. 1) Put the static enum MyCounter{ct_key1} just above main() 2) Changed result = ct.findCounter("org.apache.hadoop.mapred.Task$Counter", 1, "Reduce.MyCounter").getCounter(); Still is doesnt seem to help. It throws a null pointer exception.Its not able to find th

Re: Problem with Counters

2009-02-05 Thread Rasit OZDAS
Forgot to say, value "0" means that the requested counter does not exist. 2009/2/5 Rasit OZDAS : > Sharath, > I think the static enum definition should be out of Reduce class. > Hadoop probably tries to find it elsewhere with "MyCounter", but it's > actually "Reduce.MyCounter" in your example. >

Re: Problem with Counters

2009-02-05 Thread Rasit OZDAS
Sharath, I think the static enum definition should be out of Reduce class. Hadoop probably tries to find it elsewhere with "MyCounter", but it's actually "Reduce.MyCounter" in your example. Hope this helps, Rasit 2009/2/5 some speed : > I Tried the following...It gets compiled but the value of r

Re: Problem with Counters

2009-02-05 Thread some speed
I Tried the following...It gets compiled but the value of result seems to be 0 always. RunningJob running = JobClient.runJob(conf); Counters ct = new Counters(); ct = running.getCounters(); long result = ct.findCounter("org.apache.hadoop.mapred.Task$Coun

Re: Problem with Counters

2009-02-05 Thread some speed
Hi Tom, I get the error : Cannot find Symbol* "**MyCounter.ct_key1 " * On Thu, Feb 5, 2009 at 5:51 AM, Tom White wrote: > Hi Sharath, > > The code you posted looks right to me. Counters#getCounter() will > return the counter's value. What error are you getting? > > Tom > > On Thu, Feb 5,

Re: Problem with Counters

2009-02-05 Thread Tom White
Hi Sharath, The code you posted looks right to me. Counters#getCounter() will return the counter's value. What error are you getting? Tom On Thu, Feb 5, 2009 at 10:09 AM, some speed wrote: > Hi, > > Can someone help me with the usage of counters please? I am incrementing a > counter in Reduce m

Problem with Counters

2009-02-05 Thread some speed
Hi, Can someone help me with the usage of counters please? I am incrementing a counter in Reduce method but I am unable to collect the counter value after the job is completed. Its something like this: public static class Reduce extends MapReduceBase implements Reducer { static enum