houman babai created OOZIE-3603:
-----------------------------------
Summary: Oozie Luncher & Map-Reduce Action Complete Successfully
However Oozie Still Fails the Action
Key: OOZIE-3603
URL: https://issues.apache.org/jira/browse/OOZIE-3603
Project: Oozie
Issue Type: Bug
Components: core
Affects Versions: 5.1.0
Environment: Oozie Version 5.1.0-CDH6.3.1
Reporter: houman babai
I am using oozie 5.1.0-cdh6.3.1
In my workflow I have a mapreduce action, which generates over 300 counters.
The oozie launcher & the mapreduce job successfully complete, however, oozie
reports that:
{code}
Error Code: LimitExceededException
LimitExceededException: Too many counters: 121 max=120
{code}
I have updated mapred-site.xml.
The log for the mapreduce job reports success, in fact I can see all the
counters & the actual output of the mapreduce job on hdfs.
In the oozie launcher log I can see:
* mapreduce.job.counters.max : 8192
* mapreduce.job.counters.groups.max : 100
Furthermore, the oozie launcher log ends with:
{code:java}
--------------------
Submitting Oozie action Map-Reduce job
=======================
<<< Invocation of Main class completed <<<
Oozie Launcher, propagating new Hadoop job id to Oozie
=======================
job_1594765755382_0035
=======================
Oozie Launcher, uploading action data to HDFS sequence file:
hdfs://HDFS/user/MY-ID/oozie-oozi/0000012-200714223028181-oozie-oozi-W/ACTION-NAME--map-reduce/action-data.seq
Stopping AM
Callback notification attempts left 0
Callback notification trying
http://OOZIE-URL:11000/oozie/callback?id=0000012-200714223028181-oozie-oozi-W@ACTION-NAME&status=RUNNING
Callback notification to
http://OOZIE-URL:11000/oozie/callback?id=0000012-200714223028181-oozie-oozi-W@ACTION-NAME&status=RUNNING
succeeded
Callback notification succeeded
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
