Just to add you can also look into SPARK_WORKER_INSTANCES configuration in
the spark-env.sh file.
On Aug 17, 2015 3:44 AM, Daniel Darabos daniel.dara...@lynxanalytics.com
wrote:
Hi Praveen,
On Mon, Aug 17, 2015 at 12:34 PM, praveen S mylogi...@gmail.com wrote:
What does this mean in
What does this mean in .setMaster(local[2])
Is this applicable only for standalone Mode?
Can I do this in a cluster setup, eg:
. setMaster(hostname:port[2])..
Is it number of threads per worker node?
Hi Praveen,
On Mon, Aug 17, 2015 at 12:34 PM, praveen S mylogi...@gmail.com wrote:
What does this mean in .setMaster(local[2])
Local mode (executor in the same JVM) with 2 executor threads.
Is this applicable only for standalone Mode?
It is not applicable for standalone mode, only for
