ache-spark-user-list.1001560.n3.nabble.com/Getting-the-number-of-slaves-tp10604p24043.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.
try sc.getConf.getInt("spark.executor.instances", 1)
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Getting-the-number-of-slaves-tp10604p24043.html
Sent from the Apache Spark User List mailing list archive at
I should have searched more...
> >>>
> >>> Something I noticed though: after the SparkContext is initialized, I
> had
> >>> to
> >>> wait for a few seconds until sc.getExecutorStorageStatus.length returns
> >>> the
> >>> correct number of workers
rs in my cluster (otherwise it returns 1, for the
>>> driver)...
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> http://apache-spark-user-list.1001560.n3.nabble.com/Getting-the-number-of-slaves-tp10604p10619.html
>>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>>
>
turns 1, for the
>> driver)...
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Getting-the-number-of-slaves-tp10604p10619.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>
>
or the
> driver)...
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Getting-the-number-of-slaves-tp10604p10619.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
)...
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Getting-the-number-of-slaves-tp10604p10619.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
ntext:
> http://apache-spark-user-list.1001560.n3.nabble.com/Getting-the-number-of-slaves-tp10604.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
currently in
use, in order set the level of parallelism and RDD partitions, based on that
number.
Thanks!
Nicolas
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Getting-the-number-of-slaves-tp10604.html
Sent from the Apache Spark User List mailing li