Re: Running Spark in local mode seems to ignore local[N]

2015-05-11 Thread Dmitry Goldenberg
ecial one must do, running locally and > submitting > >> >> > a > >> >> > job > >> >> > like so: > >> >> > > >> >> > spark-submit \ > >> >

Re: Running Spark in local mode seems to ignore local[N]

2015-05-11 Thread Dmitry Goldenberg
e: > >> >> > Hi, > >> >> > > >> >> > Is there anything special one must do, running locally and > submitting > >> >> > a > >> >> > job > >> >> > like so: > >> >> > > >>

Re: Running Spark in local mode seems to ignore local[N]

2015-05-11 Thread Sean Owen
>> > a >> >> > job >> >> > like so: >> >> > >> >> > spark-submit \ >> >> > --class "com.myco.Driver" \ >> >> > --master local[*] \ >> >> > ./lib/myco.j

Re: Running Spark in local mode seems to ignore local[N]

2015-05-11 Thread Dmitry Goldenberg
park-submit \ > >> > --class "com.myco.Driver" \ > >> > --master local[*] \ > >> > ./lib/myco.jar > >> > > >> > In my logs, I'm only seeing log messages with the thread identifier of > >> >

Re: Running Spark in local mode seems to ignore local[N]

2015-05-11 Thread Sean Owen
I'm only seeing log messages with the thread identifier of >> > "Executor task launch worker-0". >> > >> > There are 4 cores on the machine so I expected 4 threads to be at play. >> > Running with local[32] did not yield 32 worker threads. >&

Re: Running Spark in local mode seems to ignore local[N]

2015-05-11 Thread Dmitry Goldenberg
tor task launch worker-0". > > > > There are 4 cores on the machine so I expected 4 threads to be at play. > > Running with local[32] did not yield 32 worker threads. > > > > Any recommendations? Thanks. > > > > > > > > -- > > View

Re: Running Spark in local mode seems to ignore local[N]

2015-05-11 Thread Marcelo Vanzin
gt; "Executor task launch worker-0". > > There are 4 cores on the machine so I expected 4 threads to be at play. > Running with local[32] did not yield 32 worker threads. > > Any recommendations? Thanks. > > > > -- > View this message in context: > http:/

Re: Running Spark in local mode seems to ignore local[N]

2015-05-11 Thread Sean Owen
ith local[32] did not yield 32 worker threads. > > Any recommendations? Thanks. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Running-Spark-in-local-mode-seems-to-ignore-

Running Spark in local mode seems to ignore local[N]

2015-05-11 Thread dgoldenberg
task launch worker-0". There are 4 cores on the machine so I expected 4 threads to be at play. Running with local[32] did not yield 32 worker threads. Any recommendations? Thanks. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Running-Spark-in-local-mod