RE: questions about debugging a spark application

2014-04-29 Thread wxhsdp
Hi Liu, is it the feature of spark 0.9.1? my version is 0.9.0, it has no effect when i set spark.eventLog.enabled -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/questions-about-debugging-a-spark-application-tp4891p5028.html Sent from the Apache Spark User

RE: questions about debugging a spark application

2014-04-28 Thread Liu, Raymond
. Checkout latest docs/monitoring.md for detail. Best Regards, Raymond Liu -Original Message- From: wxhsdp [mailto:wxh...@gmail.com] Sent: Tuesday, April 29, 2014 8:07 AM To: u...@spark.incubator.apache.org Subject: Re: questions about debugging a spark application thanks for your reply

Re: questions about debugging a spark application

2014-04-28 Thread wxhsdp
thanks for your reply, daniel what do you mean by "the logs contain everything to reconstruct the same data." ? i also use times to look into the logs, but only get a little. as i can see, it logs the flow to run the application, but there are no more details about each task, for example, see the

Re: questions about debugging a spark application

2014-04-28 Thread Daniel Darabos
Good question! I am also new to the JVM and would appreciate some tips. On Sun, Apr 27, 2014 at 5:19 AM, wxhsdp wrote: > Hi, all > i have some questions about debug in spark: > 1) when application finished, application UI is shut down, i can not see > the details about the app, like >

Re: questions about debugging a spark application

2014-04-27 Thread wxhsdp
or should i run my app on spark shell by using addJars ? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/questions-about-debugging-a-spark-application-tp4891p4911.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: questions about debugging a spark application

2014-04-27 Thread wxhsdp
or should i run my app in spark shell by using addJars -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/questions-about-debugging-a-spark-application-tp4891p4910.html Sent from the Apache Spark User List mailing list archive at Nabble.com.