Is spark-ec2 going away?

2016-01-27 Thread Sung Hwan Chung
I noticed that in the main branch, the ec2 directory along with the spark-ec2 script is no longer present. Is spark-ec2 going away in the next release? If so, what would be the best alternative at that time? A couple more additional questions: 1. Is there any way to add/remove additional workers

Re: Is spark-ec2 going away?

2016-01-27 Thread Nicholas Chammas
I noticed that in the main branch, the ec2 directory along with the spark-ec2 script is no longer present. It’s been moved out of the main repo to its own location: https://github.com/amplab/spark-ec2/pull/21 Is spark-ec2 going away in the next release? If so, what would be the best alternative

Re: Is spark-ec2 going away?

2016-01-27 Thread Alexander Pivovarov
I noticed that in the main branch, the ec2 directory along with the > spark-ec2 script is no longer present. > > Is spark-ec2 going away in the next release? If so, what would be the best > alternative at that time? > > A couple more additional questions: > 1. Is there any way to add/r

Re: Is spark-ec2 going away?

2016-01-27 Thread Sung Hwan Chung
16 at 2:07 PM, Sung Hwan Chung <coded...@cs.stanford.edu > > wrote: > >> I noticed that in the main branch, the ec2 directory along with the >> spark-ec2 script is no longer present. >> >> Is spark-ec2 going away in the next release? If so, what would be th

Re: Is spark-ec2 going away?

2016-01-27 Thread Nick Pentreath
instances to the cluster on fly (CORE instances >> support add only, TASK instances - add and remove) >> >> >> >>> On Wed, Jan 27, 2016 at 2:07 PM, Sung Hwan Chung <coded...@cs.stanford.edu> >>> wrote: >>> I noticed that in the main branc

Re: Is spark-ec2 going away?

2016-01-27 Thread Sung Hwan Chung
location: > https://github.com/amplab/spark-ec2/pull/21 > > Is spark-ec2 going away in the next release? If so, what would be the best > alternative at that time? > > It’s not going away. It’s just being removed from the main Spark repo and > maintained separately. > >