[
https://issues.apache.org/jira/browse/HADOOP-11509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14293817#comment-14293817
]
Chris Nauroth commented on HADOOP-11509:
----------------------------------------
I took a look at how the generic command line options are documented, currently
and going back to 1.0.4:
http://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-common/CommandsManual.html#Generic_Options
http://hadoop.apache.org/docs/r1.0.4/commands_manual.html#Generic+Options
Also relevant is the streaming documentation, which basically repeats the
information:
http://hadoop.apache.org/docs/r2.6.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/HadoopStreaming.html#Generic_Command_Options
http://hadoop.apache.org/docs/r1.0.4/streaming.html#Generic+Command+Options
There is no way for a user to interpret this documentation to get a complete
and correct understanding of these precedence rules (regardless of this patch).
It sounds like you're suggesting we file a follow-on jira to improve the
documentation. Do I understand correctly?
I still can't see a way that this patch would cause calling code to break. The
argument handling at this layer is not strictly positional, due to the way
commons-cli works. I don't expect anyone will need to swap the order of
arguments in their script or anything like that. Do you have an example of
something that would break after this patch?
> change parsing sequence in GenericOptionsParser to parse -D parameters first
> ----------------------------------------------------------------------------
>
> Key: HADOOP-11509
> URL: https://issues.apache.org/jira/browse/HADOOP-11509
> Project: Hadoop Common
> Issue Type: Bug
> Reporter: Xuan Gong
> Assignee: Xuan Gong
> Fix For: 2.7.0
>
> Attachments: HADOOP-11509.1.patch, HADOOP-11509.2.patch
>
>
> In GenericOptionsParser, we need to parse -D parameter first. In that case,
> the user input parameter (through -D) can be set into configuration object
> earlier and used to process other parameters.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
