Laurent Goujon created MAPREDUCE-6486:
-----------------------------------------

             Summary: File{Input|Output}Format counters not updated when using 
viewfs
                 Key: MAPREDUCE-6486
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6486
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: mrv2, task
            Reporter: Laurent Goujon


MapReduce tasks rely on filesystem stats to update FileInputFormatCounter and 
FileOutputFormatCounter bytes counters.

But if the filesystem is viewfs, stats are not updated and counters are zero. 
However the resolved filesystem for the input and output paths have their stats 
updated, and should be used by the framework (which could be done by resolving 
the path first).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to