If you are profiling in standalone mode, I recommend you to try with Java
Mission Control.
You just need to start app with these params:
-XX:+UnlockCommercialFeatures -XX:+FlightRecorder
-Dcom.sun.management.jmxremote=true
-Dcom.sun.management.jmxremote.port=$YOUR_PORT
Hi list,
I'm curious as to what are the best practices of profiling spark apps? So far I
tried following this guide with hprof and/or yourkit but the profile looks
strange:
https://cwiki.apache.org/confluence/display/SPARK/Profiling+Spark+Applications+Using+YourKit
55% of time spent in
