Ok, I think I found the issue. It's not only that the quotations are missing from the --conf param, they are also missing from the --driver-java-options, which is concatenated to the INTERPRETER_RUN_COMMAND in interpreter.sh
I will fix it in my build, but would like a confirmation that this is indeed the issue (and I'm not missing anything), so I'd open a pull request. On Thu, Jul 8, 2021 at 3:05 PM Lior Chaga <lio...@taboola.com> wrote: > I'm trying to run zeppelin using local spark interpreter. > Basically everything works, but if I try to set > `spark.driver.extraJavaOptions` or `spark.executor.extraJavaOptions` > containing several arguments, I get an exception. > For instance, for providing `-DmyParam=1 -DmyOtherParam=2`, I'd get: > Error: Unrecognized option: -DmyOtherParam=2 > > I noticed that the spark submit looks as follow: > > spark-submit --class > org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer > --driver-class-path > .... *--conf spark.driver.extraJavaOptions=-DmyParam=1 -DmyOtherParam=2* > > So I tried to patch SparkInterpreterLauncher to add quotation marks (like > in the example from spark documentation - > https://spark.apache.org/docs/latest/configuration.html#dynamically-loading-spark-properties > ) > > I see that the quotation marks were added: *--conf > "spark.driver.extraJavaOptions=-DmyParam=1 -DmyOtherParam=2"* > But I still get the same error. > > Any idea how I can make it work? >
