Bruno Dumon created GIRAPH-995:
----------------------------------

             Summary: Support use of counters in InputFormats
                 Key: GIRAPH-995
                 URL: https://issues.apache.org/jira/browse/GIRAPH-995
             Project: Giraph
          Issue Type: Improvement
            Reporter: Bruno Dumon


I'm working on a custom EdgeInputFormat where I'd like to use map reduce 
counters. I've noticed these don't work, because the TaskAttemptContext 
contains a DummyReporter.

This is because WrappedEdgeInputFormat.createEdgeReader() creates a different 
TaskAttemptContext to pass to the my reader, I assume because of threadsafety 
considerations.

I patched HadoopUtils.makeTaskAttemptContext() to support counters, but only in 
case HADOOP_NON_JOBCONTEXT_IS_INTERFACE, because only in that case it possible 
to pass on a StatusReporter to the TaskAttemptContextImpl.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to