[
https://issues.apache.org/jira/browse/HADOOP-2622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12571237#action_12571237
]
lohit vijayarenu commented on HADOOP-2622:
------------------------------------------
Most users use -file to pass map/reduce script and conf files. Having them to
move ask them to place the file on DFS and use it via -cacheFile. or
-cacheArchive is not user friendly. If we decide to remove -file, could it be
made convenient for user to pass these kind of script. And also right now, if
users have their own inputFormat, they would have to jar it with streaming jar
and use the custom jar because setInputFormat is done at client side. So,
passing that via -file does not work. It would be really helpful if this is
also address.
> Fix -file option in Streaming to use Distributed Cache
> ------------------------------------------------------
>
> Key: HADOOP-2622
> URL: https://issues.apache.org/jira/browse/HADOOP-2622
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/streaming
> Reporter: Amareshwari Sri Ramadasu
> Assignee: Amareshwari Sri Ramadasu
> Fix For: 0.17.0
>
>
> The -file option works by putting the script into the job's jar file by
> unjar-ing, copying and then jar-ing it again.
> We should rework the -file option to use the DistributedCache and the symlink
> option it provides.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
