spark java options

2015-01-16 Thread Kane Kim
I want to add some java options when submitting application: --conf spark.executor.extraJavaOptions=-XX:+UnlockCommercialFeatures -XX:+FlightRecorder But looks like it doesn't get set. Where I can add it to make it working? Thanks.

Re: spark java options

2015-01-16 Thread Marcelo Vanzin
Hi Kane, What's the complete command line you're using to submit the app? Where to you expect these options to appear? On Fri, Jan 16, 2015 at 11:12 AM, Kane Kim kane.ist...@gmail.com wrote: I want to add some java options when submitting application: --conf

Re: spark java options

2015-01-16 Thread Marcelo Vanzin
Hi Kane, Here's the command line you sent me privately: ./spark-1.2.0-bin-hadoop2.4/bin/spark-submit --class SimpleApp --conf spark.executor.extraJavaOptions=-XX:+UnlockCommercialFeatures -XX:+FlightRecorder --master local simpleapp.jar ./test.log You're running the app in local mode. In that