Re: Reg Job Server

2015-02-05 Thread Deep Pradhan
I have a single node Spark standalone cluster. Will this also work for my cluster? Thank You On Fri, Feb 6, 2015 at 11:02 AM, Mark Hamstra wrote: > > https://cwiki.apache.org/confluence/display/SPARK/Profiling+Spark+Applications+Using+YourKit > > On Thu, Feb 5, 2015 at 9:18 PM, Deep Pradhan >

Re: Reg Job Server

2015-02-05 Thread Mark Hamstra
https://cwiki.apache.org/confluence/display/SPARK/Profiling+Spark+Applications+Using+YourKit On Thu, Feb 5, 2015 at 9:18 PM, Deep Pradhan wrote: > Yes, I want to know, the reason about the job being slow. > I will look at YourKit. > Can you redirect me to that, some tutorial in how to use? > > T

Re: Reg Job Server

2015-02-05 Thread Deep Pradhan
Yes, I want to know, the reason about the job being slow. I will look at YourKit. Can you redirect me to that, some tutorial in how to use? Thank You On Fri, Feb 6, 2015 at 10:44 AM, Kostas Sakellis wrote: > When you say profiling, what are you trying to figure out? Why your spark > job is slow

Re: Reg Job Server

2015-02-05 Thread Kostas Sakellis
When you say profiling, what are you trying to figure out? Why your spark job is slow? Gatling seems to be a load generating framework so I'm not sure how you'd use it (i've never used it before). Spark runs on the JVM so you can use any JVM profiling tools like YourKit. Kostas On Thu, Feb 5, 201

Re: Reg Job Server

2015-02-05 Thread Deep Pradhan
I read somewhere about Gatling. Can that be used to profile Spark jobs? On Fri, Feb 6, 2015 at 10:27 AM, Kostas Sakellis wrote: > Which Spark Job server are you talking about? > > On Thu, Feb 5, 2015 at 8:28 PM, Deep Pradhan > wrote: > >> Hi, >> Can Spark Job Server be used for profiling Spark

Re: Reg Job Server

2015-02-05 Thread Kostas Sakellis
Which Spark Job server are you talking about? On Thu, Feb 5, 2015 at 8:28 PM, Deep Pradhan wrote: > Hi, > Can Spark Job Server be used for profiling Spark jobs? >

Reg Job Server

2015-02-05 Thread Deep Pradhan
Hi, Can Spark Job Server be used for profiling Spark jobs?