[
https://issues.apache.org/jira/browse/TEZ-3459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572484#comment-15572484
]
Hitesh Shah commented on TEZ-3459:
----------------------------------
[~kshukla] I guess the impl needs to be changed to use the dagclient and invoke
the necessary api to obtain the counters. We dont have task level apis as of
today but we should be able to return back the job level counters as the
dag/vertex level counters are accessible.
> Issues running M/R jobs with Tez
> --------------------------------
>
> Key: TEZ-3459
> URL: https://issues.apache.org/jira/browse/TEZ-3459
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Manuel Godbert
> Attachments: colorCount.sh, colorCount.sh, mr-example.jar,
> mr-example.jar
>
>
> After applying the patch delivered in TEZ-3330, I enriched the
> MapredColorCount example to reproduce some of the other issues I encountered
> on the jobs I wish to see running with Tez.
> I am attaching a jar to the JIRA, including source code, and a script file
> detailing the observed results in comments.
> It adresses 4 issues:
> - the embedded jars in /lib are ignored by Tez, but YARN uses them without
> additional configuration
> - The use of a combiner causes a NullPointerException
> - The counters incremented in the Reporter objects stay at 0
> - The additional output configured is missing in the final job output folder.
> It seems the problem occurs at task commit time, as the new output file is
> not in the same folder as the main output file.
> I am using HDP2.4
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
