https://cwiki.apache.org/confluence/display/SPARK/Profiling+Spark+Applications+Using+YourKit
On Thu, Feb 5, 2015 at 9:18 PM, Deep Pradhan <pradhandeep1...@gmail.com> wrote: > Yes, I want to know, the reason about the job being slow. > I will look at YourKit. > Can you redirect me to that, some tutorial in how to use? > > Thank You > > On Fri, Feb 6, 2015 at 10:44 AM, Kostas Sakellis <kos...@cloudera.com> > wrote: > >> When you say profiling, what are you trying to figure out? Why your spark >> job is slow? Gatling seems to be a load generating framework so I'm not >> sure how you'd use it (i've never used it before). Spark runs on the JVM so >> you can use any JVM profiling tools like YourKit. >> >> Kostas >> >> On Thu, Feb 5, 2015 at 9:03 PM, Deep Pradhan <pradhandeep1...@gmail.com> >> wrote: >> >>> I read somewhere about Gatling. Can that be used to profile Spark jobs? >>> >>> On Fri, Feb 6, 2015 at 10:27 AM, Kostas Sakellis <kos...@cloudera.com> >>> wrote: >>> >>>> Which Spark Job server are you talking about? >>>> >>>> On Thu, Feb 5, 2015 at 8:28 PM, Deep Pradhan <pradhandeep1...@gmail.com >>>> > wrote: >>>> >>>>> Hi, >>>>> Can Spark Job Server be used for profiling Spark jobs? >>>>> >>>> >>>> >>> >> >