So connecting to the cluster (port 7077) works. That is to say, the Spark
Context is created. The timeout occurs on the worker side when I run any
command with .collect(). The client (local machine) basically waits
forever). I'm wondering if maybe I'm not understanding the architecture
correctly
Have you tried connecting to the port 7077 on the cluster from your local
machine to see if it works ok ?
Sent from my iPhone
> On Apr 29, 2016, at 5:58 PM, Richard Han wrote:
>
> I have an EC2 installation of Spark Standalone Master/Worker set up. The two
> can talk to
I have an EC2 installation of Spark Standalone Master/Worker set up. The
two can talk to one another, and all ports are open in the security group
(just to make sure it isn't the port). When I run spark-shell on the master
node (setting it to --master spark://ip:7077) it runs everything correctly.