Add export SPARK_JAVA_OPTS=“-Xss16m” to conf/spark-env.sh. Then it should apply to the executor.
Matei On May 5, 2014, at 2:20 PM, Andrea Esposito <and1...@gmail.com> wrote: > Hi there, > > i'm doing an iterative algorithm and sometimes i ended up with > StackOverflowError, doesn't matter if i do checkpoints or not. > > Remaining i don't understand why this is happening, i figure out that > increasing the stack size is a workaround. > > Developing using "local[n]" so the local mode i can set the stack size > through the -Xss parameter. How can i do the same for the standalone mode for > each worker? Setting it as "java -Xss16m Worker" seems useless because the > actual computation are done on CoarseGrainExecutor.. > > Best, > EA
