In hadoop-0.20.0 streaming job do not throw proper verbose error message if
file is not present
-----------------------------------------------------------------------------------------------
Key: MAPREDUCE-1068
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1068
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/streaming
Affects Versions: 0.20.1
Reporter: Peeyush Bishnoi
Fix For: 0.20.2, 0.21.0, 0.22.0, 0.20.1
With hadoop-0.20.0 proper error message is not thrown , when streaming job is
submitted and if file is not present to be distributed with "-file" option. But
with hadoop-0.18.* proper verbose message is thrown if file is not present and
it is easy for the users to debug.
For example:
With hadoop-0.20.0:
$ hadoop jar $HADOOP_HOME/hadoop-streaming.jar -Dmapred.job.queue.name=general
-input /user/simon/test1.txt -output /user/simon/test.out -mapper "/bin/cat"
-file dummy -reducer "/bin/cat"
Streaming Job Failed!
With hadoop-0.18.*:
$ hadoop jar $HADOOP_HOME/hadoop-streaming.jar -input /user/simon/test1.txt
-output /user/simon/test.out -mapper "/bin/cat" -file dummy -reducer "/bin/cat"
09/10/06 10:06:49 ERROR streaming.StreamJob: Unexpected value "Argument :
/home/simon/dummy doesn't exist." found while processing -file
---
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
