log files of failed task

2015-03-23 Thread sergunok 
Hi,

I executed a task on Spark in YARN and it failed.
I see just executor lost message from YARNClientScheduler, no further
details..
(I read ths error can be connected to spark.yarn.executor.memoryOverhead
setting and already played with this param)

How to go more deeply in details in log files and find exact reason? How can
log of failed task be examined?

Unfortunately I haven't access to UI of Spark just can use command line.

Thanks!

Serg.



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/log-files-of-failed-task-tp22183.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: log files of failed task

2015-03-23 Thread Emre Sevinc 
Hello Sergun,

Generally you can use

   yarn application -list

to see the applicationIDs of applications and then you can see the logs
of finished applications using:

   yarn logs -applicationId applicationID

Hope this helps.

--
Emre Sevinç
http://www.bigindustries.be/



On Mon, Mar 23, 2015 at 8:23 AM, sergunok ser...@gmail.com wrote:

 Hi,

 I executed a task on Spark in YARN and it failed.
 I see just executor lost message from YARNClientScheduler, no further
 details..
 (I read ths error can be connected to spark.yarn.executor.memoryOverhead
 setting and already played with this param)

 How to go more deeply in details in log files and find exact reason? How
can
 log of failed task be examined?

 Unfortunately I haven't access to UI of Spark just can use command line.

 Thanks!

 Serg.



 --
 View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/log-files-of-failed-task-tp22183.html
 Sent from the Apache Spark User List mailing list archive at Nabble.com.

 -
 To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
 For additional commands, e-mail: user-h...@spark.apache.org




--
Emre Sevinc