Re: Spark Job Server application compilation issue

Thanks for pointing . On Wed, Mar 14, 2018 at 11:19 PM, Vadim Semenov wrote: > This question should be directed to the `spark-jobserver` group: > https://github.com/spark-jobserver/spark-jobserver#contact > > They also have a gitter chat. > > Also include the errors you

Re: Spark Job Server application compilation issue

This question should be directed to the `spark-jobserver` group: https://github.com/spark-jobserver/spark-jobserver#contact They also have a gitter chat. Also include the errors you get once you're going to be asking them a question On Wed, Mar 14, 2018 at 1:37 PM, sujeet jog

Spark Job Server application compilation issue

Input is a json request, which would be decoded in myJob() & processed further. Not sure what is wrong with below code, it emits errors as unimplemented methods (runJob/validate), any pointers on this would be helpful, jobserver-0.8.0 object MyJobServer extends SparkSessionJob { type JobData

Livy VS Spark Job Server

It will be helpful if someone can compare Livy and Spark Job Server. Thanks

Re: Spark job server pros and cons

Spark job Server(SJS) gives you the ability to have your spark job as a service. It has features like caching RDD, publish rest APIs to submit your job and named RDDs. For more info, refer https://github.com/spark-jobserver/spark-jobserver. Internally SJS too uses the same spark job submit so

Spark job server pros and cons

Hi, So far, I ran spark jobs directly using spark-submit options. I have a use case to use Spark Job server to run the job. I wanted to find out PROS and CONs of using this job server? If anyone can share it, it will be great. My jobs usually connected to multiple data sources like Kafka, Custom

Re: LIVY VS Spark Job Server

submit & monitor spark Jobs using REST > Interfaces. > > When to use Livy vs Spark Job Server? > > Regards, > Sam > > > > -- > View this message in context: http://apache-spark-user-list. > 1001560.n3.nabble.com/LIVY-VS-Spark-Job-Server-tp27722.html > S

LIVY VS Spark Job Server

Hi Team, I am evaluating different ways to submit & monitor spark Jobs using REST Interfaces. When to use Livy vs Spark Job Server? Regards, Sam -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/LIVY-VS-Spark-Job-Server-tp27722.html Sent from the Ap

Re: [Community] Python support added to Spark Job Server

awesome, one question about the job server, when will it support Spark 2.x ? great thanks~ On Thu, Aug 18, 2016 at 1:04 AM, Evan Chan <velvia.git...@gmail.com> wrote: > Hi folks, > > Just a friendly message that we have added Python support to the REST > Spark Job Server

[Community] Python support added to Spark Job Server

Hi folks, Just a friendly message that we have added Python support to the REST Spark Job Server project. If you are a Python user looking for a RESTful way to manage your Spark jobs, please come have a look at our project! https://github.com/spark-jobserver/spark-jobserver -Evan

Submitting Job to YARN-Cluster using Spark Job Server

.n3.nabble.com/Submitting-Job-to-YARN-Cluster-using-Spark-Job-Server-tp26936.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional

spark job server

Hi, I am not able to start spark job sever. I am facing below error. Please let me know, how to resolve this issue. I have configured one master and two workers in cluster mode. ./server_start.sh *./server_start.sh: line 52: kill: (19621) - No such process./server_start.sh: line 78:

Re: spark job server

Hi, I am using "ooyala/spark-jobserver". Regards, Rajesh On Sat, Jan 16, 2016 at 8:36 PM, Ted Yu wrote: > Which distro are you using ? > > From the error message, compute-classpath.sh was not found. > I searched Spark 1.6 built for hadoop 2.6 but didn't find > either

Re: spark job server

Which distro are you using ? >From the error message, compute-classpath.sh was not found. I searched Spark 1.6 built for hadoop 2.6 but didn't find either compute-classpath.sh or server_start.sh Cheers On Sat, Jan 16, 2016 at 5:33 AM, Madabhattula Rajesh Kumar < mrajaf...@gmail.com> wrote: >

Re: Spark Job Server with Yarn and Kerberos

.com>> wrote: > > Has anyone used Spark Job Server on a "kerberized" cluster in YARN-Client > mode? When Job Server contacts the YARN resource manager, we see a "Cannot > impersonate root" error and am not sure what we have misconfigured. > > Thanks. >

Spark Job Server with Yarn and Kerberos

Has anyone used Spark Job Server on a "kerberized" cluster in YARN-Client mode? When Job Server contacts the YARN resource manager, we see a "Cannot impersonate root" error and am not sure what we have misconfigured. Thanks. ___ *Mike Wright* Principal

How do I query a DSE Cassandra table using Spark Job Server

I am trying to use the spark job server to run a query against a DSE Cassandra table. Can any one please help me with instructions? I am *NOT* a Java person. What I have done so far: 1. I have a single node DataStax Cassandra ver 4.6 running on a Centos 6.6 VM 2. Tested dse spark to query tables

Re: Can spark job server be used to visualize streaming data?

, February 12, 2015 at 1:55 AM To: Felix C Cc: Kelvin Chu, user@spark.apache.org Subject: Re: Can spark job server be used to visualize streaming data? Hello Felix, I am already streaming in very simple data using Kafka (few messages / second, each record only has 3 columns...really simple

Re: Can spark job server be used to visualize streaming data?

: Thursday, February 12, 2015 at 1:55 AM To: Felix C Cc: Kelvin Chu, user@spark.apache.org Subject: Re: Can spark job server be used to visualize streaming data? Hello Felix, I am already streaming in very simple data using Kafka (few messages / second, each record only has 3 columns

Re: Can spark job server be used to visualize streaming data?

felixcheun...@hotmail.com Cc: Kelvin Chu 2dot7kel...@gmail.com, user@spark.apache.org Subject: Re: Can spark job server be used to visualize streaming data? Hello Felix, I am already streaming in very simple data using Kafka (few messages / second, each record only has 3 columns...really simple

Re: Can spark job server be used to visualize streaming data?

it myself yet so not sure how well it works. See here: https://github.com/andypetrella/spark-notebook From: Su She Date: Thursday, February 12, 2015 at 1:55 AM To: Felix C Cc: Kelvin Chu, user@spark.apache.org Subject: Re: Can spark job server be used to visualize streaming data

Re: Can spark job server be used to visualize streaming data?

spark job server be used to visualize streaming data? Hello Felix, I am already streaming in very simple data using Kafka (few messages / second, each record only has 3 columns...really simple, but looking to scale once I connect everything). I am processing it in Spark Streaming and am currently

Re: Can spark job server be used to visualize streaming data?

it works. See here: https://github.com/andypetrella/spark-notebook From: Su She Date: Thursday, February 12, 2015 at 1:55 AM To: Felix C Cc: Kelvin Chu, user@spark.apache.org Subject: Re: Can spark job server be used to visualize streaming data? Hello Felix, I am already streaming

Re: Can spark job server be used to visualize streaming data?

Cc: user@spark.apache.org Subject: Re: Can spark job server be used to visualize streaming data? Hi Su, Out of the box, no. But, I know people integrate it with Spark Streaming to do real-time visualization. It will take some work though. Kelvin On Mon, Feb 9, 2015 at 5:04 PM, Su She

Re: Can spark job server be used to visualize streaming data?

: Su She suhsheka...@gmail.com Sent: February 11, 2015 10:23 AM To: Felix C felixcheun...@hotmail.com Cc: Kelvin Chu 2dot7kel...@gmail.com, user@spark.apache.org Subject: Re: Can spark job server be used to visualize streaming data? Thank you Felix and Kelvin. I think I'll def be using the k-means

Re: Can spark job server be used to visualize streaming data?

--- Original Message --- From: Su She suhsheka...@gmail.com Sent: February 11, 2015 10:23 AM To: Felix C felixcheun...@hotmail.com Cc: Kelvin Chu 2dot7kel...@gmail.com, user@spark.apache.org Subject: Re: Can spark job server be used to visualize streaming data? Thank you Felix and Kelvin. I

Re: Can spark job server be used to visualize streaming data?

Hi Su, Out of the box, no. But, I know people integrate it with Spark Streaming to do real-time visualization. It will take some work though. Kelvin On Mon, Feb 9, 2015 at 5:04 PM, Su She suhsheka...@gmail.com wrote: Hello Everyone, I was reading this blog post:

Can spark job server be used to visualize streaming data?

Hello Everyone, I was reading this blog post: http://homes.esat.kuleuven.be/~bioiuser/blog/a-d3-visualisation-from-spark-as-a-service/ and was wondering if this approach can be taken to visualize streaming data...not just historical data? Thank you! -Suh

Spark Job Server first steps

Hi, I'm starting to explore the Spark Job Server contributed by Ooyala [1], running from the master branch. I started by developing and submitting a simple job and the JAR check gave me errors on a seemingly good jar. I disabled the fingerprint checking on the jar and I could submit

Re: Spark Job Server first steps

Hi Gerard, We're using the Spark Job Server in production, from GitHub [master] running against a recent Spark-1.0 snapshot so it definitely works. I'm afraid the only time we've seen a similar error was an unfortunate case of PEBKAC http://en.wikipedia.org/wiki/User_error. First and foremost

Re: Spark Job Server first steps

--data-binary *@*sparkjobservertest_2.10-0.1.jar localhost:8090/jars/test Definitively a case of PEBKAC or 'PICNIC' as I used to know it. :-) Thanks! -Gerard. On Thu, May 22, 2014 at 7:52 PM, Michael Cutler mich...@tumra.com wrote: Hi Gerard, We're using the Spark Job Server in production