Re: Spark GCE Script

2014-05-23 Thread Aureliano Buendia
On Fri, May 16, 2014 at 11:19 AM, Akhil Das ak...@sigmoidanalytics.comwrote: Hi I have sent a pull request https://github.com/apache/spark/pull/681 you can verify it and add it :) Matei, Would you please verify this pull request for Jenkins? It has been a couple of weeks. Thanks Best

Spark GCE Script

2014-05-05 Thread Akhil Das
Hi Sparkers, We have created a quick spark_gce script which can launch a spark cluster in the Google Cloud. I'm sharing it because it might be helpful for someone using the Google Cloud for deployment rather than AWS. Here's the link to the script https://github.com/sigmoidanalytics/spark_gce

Re: Spark GCE Script

2014-05-05 Thread Matei Zaharia
Very cool! Have you thought about sending this as a pull request? We’d be happy to maintain it inside Spark, though it might be interesting to find a single Python package that can manage clusters across both EC2 and GCE. Matei On May 5, 2014, at 7:18 AM, Akhil Das ak...@sigmoidanalytics.com

Re: Spark GCE Script

2014-05-05 Thread François Le lay
Has anyone considered using jclouds tooling to support multiple cloud providers? Maybe using Pallet? François On May 5, 2014, at 3:22 PM, Nicholas Chammas nicholas.cham...@gmail.com wrote: I second this motion. :) A unified cloud deployment tool would be absolutely great. On Mon,