Streaming task with special char gets wrong output
---------------------------------------------------
Key: MAPREDUCE-3388
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3388
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/streaming, mrv2
Affects Versions: 0.23.0, 0.24.0
Reporter: Robert Joseph Evans
Assignee: Robert Joseph Evans
Priority: Critical
In 0.20.204:
{noformat}
hadoop jar $HADOOP_HOME/hadoop-streaming.jar '-Dmapreduce.job.acl-view-job=*'
-files 'file:///tmp/InputDir#testlink!@$&*()-_+=' -input input.txt -mapper
'xargs cat' -reducer cat -output output -jobconf
mapred.job.name=streamingTest-1000 -jobconf 'mapreduce.job.acl-view-job=*'
{noformat}
Output:
{noformat}
hadoop fs -cat output/*
and-so-is-the-c#
c++-also-supports-object-oriented-concepts
hadoop-apache-org-core
hadoop-streaming
hod-is-the-part-of-hadoop
it-is-residing-on-apache-under-repos-asf
java-an object-oriented-language
smalltalk-is-also-object-oriented-language
streaming-is-also-part-of-it
{noformat}
For 0.23:
{noformat}
hadoop jar $HADOOP_MAPRED_HOME/hadoop-streaming.jar
-Dmapreduce.job.acl-view-job=* -files
'file:///tmp/InputDir#testlink!@$&*()-_+=' -input input.txt -mapper 'xargs
cat' -reducer cat -output output -jobconf mapred.job.name=streamingTest-1000
-jobconf 'mapreduce.job.acl-view-job=*'
{noformat}
Output:
{noformat}
testlink!@$&*()-_+=/input1.txt testlink!@$&*()-_+=/input2.txt
{noformat}
The contents of input.txt are as follows:
{noformat}
hadoop fs -cat Streaming/streaming-1000/input.txt
testlink!@$&*()-_+=/input1.txt
testlink!@$&*()-_+=/input2.txt
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
