Re: Restful WS for Spark

2016-10-01 Thread Vadim Semenov
I worked with both, so I'll give you some insight from my perspective. spark-jobserver has stable API and overall mature but doesn't work with yarn-cluster mode and python support is in-development right now. Livy has stable API (but I'm not sure if I can speak for it since it has appeared

Re: Restful WS for Spark

2016-09-30 Thread Mahendra Kutare
Try Cloudera Livy https://github.com/cloudera/livy It may be helpful for your requirement. Cheers, Mahendra about.me/mahendrakutare

Re: Restful WS for Spark

2016-09-30 Thread gobi s
Hi All, sample spark project which uses REST. http://techgobi.blogspot.in/2016/09/bigdata-sample-project.html On Fri, Sep 30, 2016 at 11:39 PM, Vadim Semenov wrote: > There're two REST job servers that work with spark: > >

Re: Restful WS for Spark

2016-09-30 Thread Vadim Semenov
There're two REST job servers that work with spark: https://github.com/spark-jobserver/spark-jobserver https://github.com/cloudera/livy On Fri, Sep 30, 2016 at 2:07 PM, ABHISHEK wrote: > Hello all, > Have you tried accessing Spark application using Restful web-services? >

Restful WS for Spark

2016-09-30 Thread ABHISHEK
Hello all, Have you tried accessing Spark application using Restful web-services? I have requirement where remote user submit the request with some data, it should be sent to Spark and job should run in Hadoop cluster mode. Output should be sent back to user. Please share your expertise.