Spark REST API

Is there a way to flush the API? I execute http://localhost:18080/api/v1/applications?status=runningning In the results I will get a list of applications but not all are still running. This is causing an issue with monitoring what is actually running. To compound the problem these are

Spark REST API YARN client mode is not full?

Hi, When I start Spark v1.6 (cdh5.8.0) in Yarn client mode I see that 4040 port is avaiable, but UI shows nothing and API returns not full information. I started Spark application like this: spark-submit --master yarn-client --class org.apache.spark.examples.SparkPi

Re: Extending Spark REST API

lo, > I have a question: is there a way to extend Spark REST API with > higher-level, application-specific handlers? (exposing additional > information, like app-specific metrics, but also taking some actions within > an app) > > Yes, I could host my own REST endpoint within an a

Extending Spark REST API

Hello, I have a question: is there a way to extend Spark REST API with higher-level, application-specific handlers? (exposing additional information, like app-specific metrics, but also taking some actions within an app) Yes, I could host my own REST endpoint within an app, but then I have

Re: SPARK REST API on YARN

ne mode? > > Thanks in advance > > -- > If you reply to this email, your message will be added to the discussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/SPARK-REST-API-on-YARN-tp26267.html > To start a new topic under Apach

SPARK REST API on YARN

question is. It is possible to access this REST API when you are not using Spark in Standalone mode? Thanks in advance -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SPARK-REST-API-on-YARN-tp26267.html Sent from the Apache Spark User List mailing list archive

Re: Spark REST API shows Error 503 Service Unavailable

let.ServletHolder.initServlet(ServletHolder.java:532) >> at >> >> org.spark-project.jetty.servlet.ServletHolder.getServlet(ServletHolder.java:415) >> at >> >> org.spark-project.jetty.servlet.ServletHolder.handle(ServletHolder.java:657) >> at >&

Re: Spark REST API shows Error 503 Service Unavailable

erCollection.java:255) > at > > org.spark-project.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) > at org.spark-project.jetty.server.Server.handle(Server.java:370) > at > > org.spark-project.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494)

Re: Spark REST API shows Error 503 Service Unavailable

eaderComplete(AbstractHttpConnection.java:1033) > at > org.spark-project.jetty.http.HttpParser.parseNext(HttpParser.java:644) > at > org.spark-project.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) > at > org.spark-project.jetty.server.AsyncH

Re: Spark REST API shows Error 503 Service Unavailable

ct.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:501) > > at > > > org.spark-project.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) > > at > > > org.spark-project.jetty.servlet.ServletHandler.doScope(ServletHandler.java:428) > &g

Re: Spark REST API shows Error 503 Service Unavailable

On Thu, Dec 17, 2015 at 3:31 PM, Vikram Kone wrote: > No we are using standard spark w/ datastax cassandra. I'm able to see some > json when I do http://10.1.40.16:7080/json/v1/applications > but getting the following errors when I do >

Spark REST API shows Error 503 Service Unavailable

-list.1001560.n3.nabble.com/Spark-REST-API-shows-Error-503-Service-Unavailable-tp25692.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org

Available options for Spark REST API

Dear Spark experts! I would like to know the best practices used for invoking spark jobs via REST API. We tried out the hidden REST API mentioned here: http://arturmkrtchyan.com/apache-spark-hidden-rest-api It works fine for spark standalone mode but does not seem to be working when i specify

Re: Available options for Spark REST API

hello if i correct understand - sparkui with rest api - for monitoring spark-jobserver - for submit job. On Mon, Dec 7, 2015 at 9:42 AM, sunil m <260885smanik...@gmail.com> wrote: > Dear Spark experts! > > I would like to know the best practices used for invoking spark jobs via > REST API. > >

Re: Where is the doc about the spark rest api ?

Check Spark Jobserver Thanks Best Regards On Mon, Aug 31, 2015 at 8:54 AM, canan chen wrote: > I found the rest api for submitting spark job, but did not found the > document. Could any one point it to me ? Thanks >

Re: Where is the doc about the spark rest api ?

>> current I don't think there's a document address this part, also this rest api is only used for SparkSubmit currently, not public API as I know. Even it is used by SparkSubmit, I think document is still necessary about how to use it in SparkSubmit. I am not sure why there's no document mention

Re: Where is the doc about the spark rest api ?

Here is the Rest related part in Spark ( https://github.com/apache/spark/tree/master/core/src/main/scala/org/apache/spark/deploy/rest ), current I don't think there's a document address this part, also this rest api is only used for SparkSubmit currently, not public API as I know. Thanks Jerry

Re: Where is the doc about the spark rest api ?

I mean the spark builtin rest api On Mon, Aug 31, 2015 at 3:09 PM, Akhil Das wrote: > Check Spark Jobserver > > > Thanks > Best Regards > > On Mon, Aug 31, 2015 at 8:54 AM, canan chen wrote: > >>