. Master can be on one of the C* node or a
non-C* node.
Mohammed
-Original Message-
From: algermissen1971 [mailto:algermissen1...@icloud.com]
Sent: Sunday, July 12, 2015 12:35 PM
To: Spark User
Subject: Master vs. Slave Nodes Clarification
Hi,
I have a question that I
:35 PM
To: Spark User
Subject: Master vs. Slave Nodes Clarification
Hi,
I have a question that I really have problems with figuring out for
myself:
Does the master node in a spark cluster need to be a node similar to the
slave nodes or should I rather view it as a coordinating node
...@icloud.com]
Sent: Sunday, July 12, 2015 12:35 PM
To: Spark User
Subject: Master vs. Slave Nodes Clarification
Hi,
I have a question that I really have problems with figuring out for myself:
Does the master node in a spark cluster need to be a node similar to the
slave nodes or should I
You are a bit confused about master node, slave node and the driver
machine.
1. Master node can be kept as a smaller machine in your dev environment,
mostly in production you will be using Mesos or Yarn cluster manager.
2. Now, if you are running your driver program (the streaming job) on the
