Thanks Lior for the investigation.
Lior Chaga <lio...@taboola.com> 于2021年7月8日周四 下午8:31写道： > Ok, I think I found the issue. It's not only that the quotations are > missing from the --conf param, they are also missing from > the --driver-java-options, which is concatenated to > the INTERPRETER_RUN_COMMAND in interpreter.sh > > I will fix it in my build, but would like a confirmation that this is > indeed the issue (and I'm not missing anything), so I'd open a pull > request. > > On Thu, Jul 8, 2021 at 3:05 PM Lior Chaga <lio...@taboola.com> wrote: > >> I'm trying to run zeppelin using local spark interpreter. >> Basically everything works, but if I try to set >> `spark.driver.extraJavaOptions` or `spark.executor.extraJavaOptions` >> containing several arguments, I get an exception. >> For instance, for providing `-DmyParam=1 -DmyOtherParam=2`, I'd get: >> Error: Unrecognized option: -DmyOtherParam=2 >> >> I noticed that the spark submit looks as follow: >> >> spark-submit --class >> org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer >> --driver-class-path >> .... *--conf spark.driver.extraJavaOptions=-DmyParam=1 >> -DmyOtherParam=2* >> >> So I tried to patch SparkInterpreterLauncher to add quotation marks (like >> in the example from spark documentation - >> https://spark.apache.org/docs/latest/configuration.html#dynamically-loading-spark-properties >> ) >> >> I see that the quotation marks were added: *--conf >> "spark.driver.extraJavaOptions=-DmyParam=1 -DmyOtherParam=2"* >> But I still get the same error. >> >> Any idea how I can make it work? >> > -- Best Regards Jeff Zhang
