Cluster not accepting jobs

2013-12-06 Thread Nathan Kronenfeld
Hi, all. I'm trying to connect to a remote cluster from my machine, using spark 0.7.3. In conf/spark-env.sh, I've set MASTER, SCALA_HOME, SPARK_MASTER_IP, and SPARK_MASTER_PORT. When I try to run a job, it starts, but never gets anywhere, and I keep getting the following error message:

Re: Cluster not accepting jobs

2013-12-06 Thread Nathan Kronenfeld
Never mind, I figured it out - apparently it was different DNS resolutions locally and within the cluster; when I use the IP address instead of the machine name in MASTER, it all seems to work. On Fri, Dec 6, 2013 at 1:38 PM, Nathan Kronenfeld nkronenf...@oculusinfo.com wrote: Hi, all. I'm

Re: Cluster not accepting jobs

2013-12-06 Thread Matei Zaharia
Yeah, in general, make sure you use exactly the same “cluster URL” string shown on the master’s web UI. There’s currently a limitation in Akka where different ways of specifying the hostname won’t work. Matei On Dec 6, 2013, at 10:54 AM, Nathan Kronenfeld nkronenf...@oculusinfo.com wrote: