Yesha Vora created MAPREDUCE-5798: ------------------------------------- Summary: Mrrsleep job with only maps fails with 'Illegal output to map' Key: MAPREDUCE-5798 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5798 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Yesha Vora
Mrr sleep job with only maps is failing with 'Illegal output to map'. {noformat} -bash-4.1$ hadoop jar tez-mapreduce-examples.jar mrrsleep -m 10 -ir 0 -r 0 14/03/16 05:52:08 INFO client.RMProxy: Connecting to ResourceManager at hostname/0.0.0.0:8032 14/03/16 05:52:09 INFO examples.MRRSleepJob: Creating in-mem splits 14/03/16 05:52:09 INFO hadoop.MRHelpers: Generating mapreduce api input splits 14/03/16 05:52:09 INFO hadoop.MRHelpers: NumSplits: 10, SerializedSize: 620 14/03/16 05:52:09 INFO client.TezClient: Submitting DAG to YARN, applicationId=application_1394838695668_0023 14/03/16 05:52:09 INFO impl.YarnClientImpl: Submitted application application_1394838695668_0023 14/03/16 05:52:09 INFO client.RMProxy: Connecting to ResourceManager at hostname/0.0.0.0:8032 14/03/16 05:52:09 INFO examples.MRRSleepJob: DAG Status: status=SUBMITTED, progress=null, diagnostics=, counters=null 14/03/16 05:52:10 INFO examples.MRRSleepJob: DAG Status: status=SUBMITTED, progress=null, diagnostics=, counters=null 14/03/16 05:52:11 INFO examples.MRRSleepJob: DAG Status: status=SUBMITTED, progress=null, diagnostics=, counters=null 14/03/16 05:52:12 INFO examples.MRRSleepJob: DAG Status: status=SUBMITTED, progress=null, diagnostics=, counters=null 14/03/16 05:52:14 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 0 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:15 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 0 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:16 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 0 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:17 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 1 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:18 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 2 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:19 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 3 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:20 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 3 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:21 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 3 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:22 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 3 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:23 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 3 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:24 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 3 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:25 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 3 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:26 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 3 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:27 INFO examples.MRRSleepJob: DAG Status: status=RUNNING, progress=TotalTasks: 10 Succeeded: 0 Running: 3 Failed: 0 Killed: 0, diagnostics=, counters=null 14/03/16 05:52:28 INFO examples.MRRSleepJob: DAG Status: status=FAILED, progress=TotalTasks: 10 Succeeded: 0 Running: 0 Failed: 1 Killed: 9, diagnostics=Vertex failed, vertexName=map, vertexId=vertex_1394838695668_0023_1_00, diagnostics=[Task failed, taskId=task_1394838695668_0023_1_00_000001, diagnostics=[AttemptID:attempt_1394838695668_0023_1_00_000001_0 Info:Error: java.io.IOException: Illegal output to map: class org.apache.tez.mapreduce.input.MRInputLegacy at org.apache.tez.mapreduce.processor.map.MapProcessor.run(MapProcessor.java:129) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:306) at org.apache.hadoop.mapred.YarnTezDagChild$4.run(YarnTezDagChild.java:526) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.hadoop.mapred.YarnTezDagChild.main(YarnTezDagChild.java:515) Container released by application, AttemptID:attempt_1394838695668_0023_1_00_000001_1 Info:Error: java.io.IOException: Illegal output to map: class org.apache.tez.mapreduce.input.MRInputLegacy at org.apache.tez.mapreduce.processor.map.MapProcessor.run(MapProcessor.java:129) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:306) at org.apache.hadoop.mapred.YarnTezDagChild$4.run(YarnTezDagChild.java:526) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.hadoop.mapred.YarnTezDagChild.main(YarnTezDagChild.java:515) Container released by application, AttemptID:attempt_1394838695668_0023_1_00_000001_2 Info:Error: java.io.IOException: Illegal output to map: class org.apache.tez.mapreduce.input.MRInputLegacy at org.apache.tez.mapreduce.processor.map.MapProcessor.run(MapProcessor.java:129) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:306) at org.apache.hadoop.mapred.YarnTezDagChild$4.run(YarnTezDagChild.java:526) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.hadoop.mapred.YarnTezDagChild.main(YarnTezDagChild.java:515) Container released by application, AttemptID:attempt_1394838695668_0023_1_00_000001_3 Info:Error: java.io.IOException: Illegal output to map: class org.apache.tez.mapreduce.input.MRInputLegacy at org.apache.tez.mapreduce.processor.map.MapProcessor.run(MapProcessor.java:129) at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:306) at org.apache.hadoop.mapred.YarnTezDagChild$4.run(YarnTezDagChild.java:526) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548) at org.apache.hadoop.mapred.YarnTezDagChild.main(YarnTezDagChild.java:515) ], Vertex failed as one or more tasks failed. failedTasks:1] DAG failed due to vertex failure. failedVertices:1 killedVertices:0, counters=null {noformat} -- This message was sent by Atlassian JIRA (v6.2#6252)