Howdy Folks,
What is the correct syntax in 1.0.0 to set networking variables in spark shell?
Specifically, I'd like to set the spark.akka.frameSize
I'm attempting this:
spark-shell -Dspark.akka.frameSize=10000 --executor-memory 4g
Only to get this within the session:
System.getProperty("spark.executor.memory")
res0: String = 4g
System.getProperty("spark.akka.frameSize")
res1: String = null
I don't believe I am violating protocol, but I have also posted this to SO:
http://stackoverflow.com/questions/27215288/how-do-i-set-spark-akka-framesize-in-spark-shell
~~~~~~
May All Your Sequences Converge
