Re: Reading Counters

2010-02-05 Thread Ted Xu
Rajan, It is possible for clients to read counters using Java API. You can create an RPC proxy to retrieve them ( by calling RPC.getProxy() ). In fact the hadoop command use that way. However, jobs that retired by JobTracker ( those been put into the history page as presented in web UI ) cannot r

Reading Counters

2010-02-03 Thread Rajan Dev
We have a hadoop job running and have used custom counters to track few counters ( like no of successfully processed documents matching certain conditions) Since we need to get this counters even while the Hadoop job is running , we wrote another Java program to read these counters * Counter re