Re: Adding slaves on spark standalone on ec2

2015-05-28 Thread Akhil Das
and it will show up along with other slaves. Thanks Best Regards On Thu, May 28, 2015 at 12:29 PM, nizang ni...@windward.eu wrote: hi, I'm working on spark standalone system on ec2, and I'm having problems on resizing the cluster (meaning - adding or removing slaves). In the basic ec2 scripts (http

Adding slaves on spark standalone on ec2

2015-05-28 Thread nizang
hi, I'm working on spark standalone system on ec2, and I'm having problems on resizing the cluster (meaning - adding or removing slaves). In the basic ec2 scripts (http://spark.apache.org/docs/latest/ec2-scripts.html), there's only script for lunching the cluster, not adding slaves

Re: Adding slaves on spark standalone on ec2

2015-05-28 Thread Nizan Grauer
, I'm working on spark standalone system on ec2, and I'm having problems on resizing the cluster (meaning - adding or removing slaves). In the basic ec2 scripts (http://spark.apache.org/docs/latest/ec2-scripts.html), there's only script for lunching the cluster, not adding slaves

Re: Adding slaves on spark standalone on ec2

2015-05-28 Thread Akhil Das
at 12:29 PM, nizang ni...@windward.eu wrote: hi, I'm working on spark standalone system on ec2, and I'm having problems on resizing the cluster (meaning - adding or removing slaves). In the basic ec2 scripts (http://spark.apache.org/docs/latest/ec2-scripts.html), there's only script

Re: Spark Standalone on EC2

2014-10-09 Thread Akhil Das
Regards On Tue, Oct 7, 2014 at 3:36 AM, Ankur Srivastava ankur.srivast...@gmail.com wrote: Hi, I have started a Spark Cluster on EC2 using Spark Standalone cluster manager but spark is trying to identify the worker threads using the hostnames which are not accessible publicly. So when I try

Re: Spark Standalone on EC2

2014-10-09 Thread Ankur Srivastava
ankur.srivast...@gmail.com wrote: Hi, I have started a Spark Cluster on EC2 using Spark Standalone cluster manager but spark is trying to identify the worker threads using the hostnames which are not accessible publicly. So when I try to submit jobs from eclipse it is failing, is there some way spark

Re: Spark Standalone on EC2

2014-10-09 Thread Akhil Das
address either i believe. What are you trying to do here? running your eclipse locally and connecting to your ec2 cluster? Thanks Best Regards On Tue, Oct 7, 2014 at 3:36 AM, Ankur Srivastava ankur.srivast...@gmail.com wrote: Hi, I have started a Spark Cluster on EC2 using Spark

Spark Standalone on EC2

2014-10-06 Thread Ankur Srivastava
Hi, I have started a Spark Cluster on EC2 using Spark Standalone cluster manager but spark is trying to identify the worker threads using the hostnames which are not accessible publicly. So when I try to submit jobs from eclipse it is failing, is there some way spark can use IP address instead