[
https://issues.apache.org/jira/browse/MAPREDUCE-3643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13182631#comment-13182631
]
Arun Prakash commented on MAPREDUCE-3643:
-----------------------------------------
I have attached the snapshot for the job tracker and below i mentioned the
console output.
12/01/09 11:36:29 INFO streaming.StreamJob: map 0% reduce 0%
12/01/09 11:36:34 INFO streaming.StreamJob: map 100% reduce 0%
Streaming command for step4
hadoop fs -rmr $OUTPUT
hadoop jar $HADOOP_HOME/contrib/streaming/hadoop-streaming-*.jar \
-D mapred.job.name="$NAME" \
-D mapred.reduce.tasks=1 \
-D mapred.task.timeout=$TIMEOUT \
-input $INPUT1 \
-input $INPUT2 \
-mapper "/bin/awk 'gsub(/\t/, \",\")'" \
-reducer "/bin/cat" \
-output $OUTPUT
i have used the /bin/cat instead of identity reducer and mapper
> Reducer Job always goes to pending state.
> -----------------------------------------
>
> Key: MAPREDUCE-3643
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3643
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Arun Prakash
> Priority: Minor
> Attachments: snap.JPG
>
>
> I am using hadoop streaming command for map-reduce.In my job there are 4
> streaming commands,i have no issues with first 3 steps but step4 job once
> mapper got 100% completed directly going to pending state,even there was no
> error in the job tracker.
> In the step4,i am merging the output(i.e step2 and step 3 output) as single
> output using identity reducer.
> I have ran this job several times there was no issues but i am facing the
> problem right now.
> Any suggestions!
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
