Re: Timeout when submitting an application to a remote Spark Standalone master

2016-04-29 Thread Richard Han
So connecting to the cluster (port 7077) works. That is to say, the Spark Context is created. The timeout occurs on the worker side when I run any command with .collect(). The client (local machine) basically waits forever). I'm wondering if maybe I'm not understanding the architecture correctly

Re: Timeout when submitting an application to a remote Spark Standalone master

2016-04-29 Thread Femi Anthony
Have you tried connecting to the port 7077 on the cluster from your local machine to see if it works ok ? Sent from my iPhone > On Apr 29, 2016, at 5:58 PM, Richard Han wrote: > > I have an EC2 installation of Spark Standalone Master/Worker set up. The two > can talk to

Timeout when submitting an application to a remote Spark Standalone master

2016-04-29 Thread Richard Han
I have an EC2 installation of Spark Standalone Master/Worker set up. The two can talk to one another, and all ports are open in the security group (just to make sure it isn't the port). When I run spark-shell on the master node (setting it to --master spark://ip:7077) it runs everything correctly.