Have you tried Spark GUI on 4040. This will show jobs being executed by executors is each stage and the line of code as well.
[image: Inline images 1] Also command line tools like jps and jmonitor HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com On 16 May 2016 at 06:25, Deepak Sharma <deepakmc...@gmail.com> wrote: > Hi > I have scala program consisting of spark core and spark streaming APIs > Is there any open source tool that i can use to debug the program for > performance reasons? > My primary interest is to find the block of codes that would be exeuted on > driver and what would go to the executors. > Is there JMX extension of Spark? > > -- > Thanks > Deepak > >
