"spark.storage.memoryFraction 0.05" If you want to store a lot of memory I think this must be a higher fraction. The default is 0.6 (not 0.0X).
To change the output directory you can set "spark.local.dir=/path/to/dir" and you can even specify multiple directories (for example if you have multiple mounted devices) by using a ',' between the paths. I.e. "spark.local.dir=/path/to/dir1,/path/to/dir2" or --conf "spark.local.dir=/mnt/,/mnt2/" (at launch time). -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/WARN-MemoryStore-Not-enough-space-tp25492p25500.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
