Re: how to increment counters inside of InputFormat/RecordReader in mapreduce api?

2012-07-30 Thread Harsh J
Jim, This is fixed in 2.x releases already via https://issues.apache.org/jira/browse/MAPREDUCE-1905 (incompat change). In 1.x this is a known limitation. Perhaps we can come up with a different non-breaking fix for 1.x? On Mon, Jul 30, 2012 at 11:41 AM, Jim Donofrio wrote: > In the mapred api ge

how to increment counters inside of InputFormat/RecordReader in mapreduce api?

2012-07-29 Thread Jim Donofrio
In the mapred api getRecordReader was passed a Reporter which could then get passed to the RecordReader to allow a RecordReader to increment counters for different types of records, bad records, etc. In the new mapreduce api createRecordReader only gets the InputSplit and TaskAttemptContext, bo