[ https://issues.apache.org/jira/browse/SPARK-7367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15145490#comment-15145490 ]
bimal tandel commented on SPARK-7367: ------------------------------------- I had a same problem today and I wrote the patch for it. I am creating a pull request. Based on my analysis there is an unintended consequences of printing help if --help is the only argument passed. example spark-submit --verbose --help wont print help anymore. Instead it prints this, spark-submit --verbose --help Error: Must specify a primary resource (JAR or Python or R file) Run with --help for usage help or --verbose for debug output > spark-submit CLI --help -h overrides the application arguments > -------------------------------------------------------------- > > Key: SPARK-7367 > URL: https://issues.apache.org/jira/browse/SPARK-7367 > Project: Spark > Issue Type: Bug > Components: Spark Submit > Reporter: Gianmario Spacagna > Priority: Minor > > The spark-submit script will parse the --help argument even if is provided as > application argument. > E.g. > spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass > /MyLocalJAR.jar --help > or > spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass > /MyLocalJAR.jar -h > If my application is using a parsing library, such as Scallop, then it will > never be able to run the application with --help as argument. > I think the spark-submit script should only print the help message when is > provided as single argument like this: > spark-submit --help > or it should provide a separator for trailing arguments: > spark-submit --master local[*] --driver-memory 4G --class bar.foo.MyClass > /MyLocalJAR.jar -- --help --arg1 --arg2 -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org