RE: Is spark-ec2 for production use?

2015-04-22 Thread nate
smoke tests -Original Message- From: Nicholas Chammas [mailto:nicholas.cham...@gmail.com] Sent: Tuesday, April 21, 2015 2:33 PM To: n...@reactor8.com; Spark dev list Subject: Re: Is spark-ec2 for production use? Nate, could you point us to an example of how one would use Big Top

Re: Is spark-ec2 for production use?

2015-04-21 Thread Shivaram Venkataraman
I'm not sure its exactly easy to define 'production' use. One thing we could stress is that spark-ec2 is meant to be run manually (i.e. it outputs errors, asks for prompts etc.) and that automating it is not in our scope right now. Shivaram On Tue, Apr 21, 2015 at 12:05 PM, Nicholas Chammas

Re: Is spark-ec2 for production use?

2015-04-21 Thread Patrick Wendell
It could be a good idea to document this a bit. The original goals were to give people an easy way to get started with Spark and also to provide a consistent environment for our own experiments and benchmarking of Spark at the AMPLab. Over time I've noticed a huge amount of scope increase in terms

RE: Is spark-ec2 for production use?

2015-04-21 Thread nate
Cc: Spark dev list Subject: Re: Is spark-ec2 for production use? It could be a good idea to document this a bit. The original goals were to give people an easy way to get started with Spark and also to provide a consistent environment for our own experiments and benchmarking of Spark at the AMPLab

Re: Is spark-ec2 for production use?

2015-04-21 Thread Nicholas Chammas
list Subject: Re: Is spark-ec2 for production use? It could be a good idea to document this a bit. The original goals were to give people an easy way to get started with Spark and also to provide a consistent environment for our own experiments and benchmarking of Spark at the AMPLab. Over