[ 
https://issues.apache.org/jira/browse/PIG-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15051914#comment-15051914
 ] 

Rohini Palaniswamy commented on PIG-4760:
-----------------------------------------

bq. Actually the MR counter is completely redundant and should be removed.
  It is used by Oozie and cannot remove it.

https://git1-us-west.apache.org/repos/asf?p=oozie.git;a=blob;f=sharelib/pig/src/main/java/org/apache/oozie/action/hadoop/OoziePigStats.java;h=c3a31b596e7914709f017eee21a498985055c897;hb=refs/heads/master#l99

  jobStatsGroup.put("HADOOP_COUNTERS", 
toJSONFromCounters(jobStats.getHadoopCounters()));

> TezDAGStats.convertToHadoopCounters is not used, but impose MR counter limit
> ----------------------------------------------------------------------------
>
>                 Key: PIG-4760
>                 URL: https://issues.apache.org/jira/browse/PIG-4760
>             Project: Pig
>          Issue Type: Bug
>          Components: tez
>            Reporter: Daniel Dai
>            Assignee: Daniel Dai
>             Fix For: 0.16.0, 0.15.1
>
>         Attachments: PIG-4760-1.patch
>
>
> PIG-4529 reveal a MR counter limit issue imposed to Pig. The original fix 
> won't work in Oozie since Oozie launcher already imposed counter limit and 
> Pig cannot change it (there is an internal flag in Limits to make sure it 
> does not init twice).
> Actually the MR counter is completely redundant and should be removed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to