From IntelliJ, you can use the remote debugging feature.
http://stackoverflow.com/questions/19128264/how-to-remote-debug-in-intellij-12-1-4
For remote debugging, you need to pass the following:
-Xdebug -Xrunjdwp:server=y,transport=dt_socket,address=4000,suspend=n
jvm options and configure your ide on that given port (4000) for remote
debugging.
Thanks
Best Regards
On Fri, Mar 20, 2015 at 9:46 AM, raggy raghav0110...@gmail.com wrote:
I am trying to debug a Spark Application on a cluster using a master and
several worker nodes. I have been successful at setting up the master node
and worker nodes using Spark standalone cluster manager. I downloaded the
spark folder with binaries and use the following commands to setup worker
and master nodes. These commands are executed from the spark directory.
command for launching master
./sbin/start-master.sh
command for launching worker node
./bin/spark-class org.apache.spark.deploy.worker.Worker master-URL
command for submitting application
./sbin/spark-submit --class Application --master URL ~/app.jar
Now, I would like to understand the flow of control through the Spark
source
code on the worker nodes when I submit my application(I just want to use
one
of the given examples that use reduce()). I am assuming I should setup
Spark
on Eclipse. The Eclipse setup link on the Apache Spark website seems to be
broken. I would appreciate some guidance on setting up Spark and Eclipse to
enable stepping through Spark source code on the worker nodes.
If not Eclipse, I would be open to using some other IDE or approach that
will enable me to step through Spark source code after launching my
application.
Thanks!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Launching-Spark-Cluster-Application-through-IDE-tp22155.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
