local[k] simply creates k threads in the same process, so you just need to set the memory of the spawning process, using standard Java options.
Also, avoid SPARK_MEM when possible, as it will be deprecated by 1.0.0. (In 0.9.0 and prior versions, you still need SPARK_MEM to set shell memory, though.) On Sun, Feb 23, 2014 at 1:19 PM, agg <agalaka...@gmail.com> wrote: > I am trying to run a stand-alone job, using sbt and not the spark > shell...any > thoughts for this? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Set-memory-when-using-local-k-tp1945p1950.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >
