Re: EC2 scripts documentations lacks how to actually run applications

2014-01-08 Thread Aureliano Buendia
Thanks Patrick. I take it that spark does not come with a daemonizer, and the user is responsible for that. Having said that, it feels odd that spark doesn't come with an application daemonizer out of the box. I know spark is fast, but it's not _that_ fast to not need a daemonizer :) On Wed, Jan

Re: EC2 scripts documentations lacks how to actually run applications

2014-01-08 Thread Patrick Wendell
Hey Aureliano, Yes, people run long running applications with standalone mode and run it in production. spark-class is a utility function for convenience. If you want to run a long running application you would write a spark application, bundle it, and submit it to the cluster. You can then launch

Re: EC2 scripts documentations lacks how to actually run applications

2014-01-08 Thread Mark Hamstra
https://github.com/apache/incubator-spark/pull/293 On Wed, Jan 8, 2014 at 10:12 AM, Aureliano Buendia wrote: > Here is a refactored version of the question: > > How to run spark-class for long running applications? Why is that > spark-class doesn't launch a daemon? > > > On Wed, Jan 8, 2014 at 3

Re: EC2 scripts documentations lacks how to actually run applications

2014-01-08 Thread Aureliano Buendia
Here is a refactored version of the question: How to run spark-class for long running applications? Why is that spark-class doesn't launch a daemon? On Wed, Jan 8, 2014 at 3:21 AM, Aureliano Buendia wrote: > Hi, > > The EC2 > documents

EC2 scripts documentations lacks how to actually run applications

2014-01-07 Thread Aureliano Buendia
Hi, The EC2 documentshas a section called 'Running Applications', but it actually lacks the step which should describe how to run the application. The spark_ec2 script