[
https://issues.apache.org/jira/browse/PIG-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051914#comment-15051914
]
Rohini Palaniswamy commented on PIG-4760:
-----------------------------------------
bq. Actually the MR counter is completely redundant and should be removed.
It is used by Oozie and cannot remove it.
https://git1-us-west.apache.org/repos/asf?p=oozie.git;a=blob;f=sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/OoziePigStats.java;h=c3a31b596e7914709f017eee21a498985055c897;hb=refs/heads/master#l99
jobStatsGroup.put("HADOOP_COUNTERS",
toJSONFromCounters(jobStats.getHadoopCounters()));
> TezDAGStats.convertToHadoopCounters is not used, but impose MR counter limit
> ----------------------------------------------------------------------------
>
> Key: PIG-4760
> URL: https://issues.apache.org/jira/browse/PIG-4760
> Project: Pig
> Issue Type: Bug
> Components: tez
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.16.0, 0.15.1
>
> Attachments: PIG-4760-1.patch
>
>
> PIG-4529 reveal a MR counter limit issue imposed to Pig. The original fix
> won't work in Oozie since Oozie launcher already imposed counter limit and
> Pig cannot change it (there is an internal flag in Limits to make sure it
> does not init twice).
> Actually the MR counter is completely redundant and should be removed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)