Re: Yarn -- one of the daemons getting killed

2013-12-18 Thread Krishna Kishore Bonagiri
see exactly when they terminate, and hopefully why. *From: *Krishna Kishore Bonagiri *Sent: *Monday, December 16, 2013 6:20 AM *To: *user@hadoop.apache.org *Reply To: *user@hadoop.apache.org *Subject: *Re: Yarn -- one of the daemons getting killed Hi Vinod, Yes, I am running on Linux

Re: Yarn -- one of the daemons getting killed

2013-12-17 Thread Krishna Kishore Bonagiri
: *Monday, December 16, 2013 6:20 AM *To: *user@hadoop.apache.org *Reply To: *user@hadoop.apache.org *Subject: *Re: Yarn -- one of the daemons getting killed Hi Vinod, Yes, I am running on Linux. I was actually searching for a corresponding message in /var/log/messages to confirm

Re: Yarn -- one of the daemons getting killed

2013-12-17 Thread Vinod Kumar Vavilapalli
, December 16, 2013 6:20 AM To: user@hadoop.apache.org Reply To: user@hadoop.apache.org Subject: Re: Yarn -- one of the daemons getting killed Hi Vinod, Yes, I am running on Linux. I was actually searching for a corresponding message in /var/log/messages to confirm that OOM killed my

Re: Yarn -- one of the daemons getting killed

2013-12-16 Thread Krishna Kishore Bonagiri
Hi Vinod, Yes, I am running on Linux. I was actually searching for a corresponding message in /var/log/messages to confirm that OOM killed my daemons, but could not find any corresponding messages there! According to the following link, it looks like if it is a memory issue, I should see a

RE: Yarn -- one of the daemons getting killed

2013-12-16 Thread Vinayakumar B
Hi Krishna, Please check the out files as well for daemons. You may find something. Cheers, Vinayakumar B From: Krishna Kishore Bonagiri [mailto:write2kish...@gmail.com] Sent: 16 December 2013 16:50 To: user@hadoop.apache.org Subject: Re: Yarn -- one of the daemons getting killed Hi Vinod

Re: Yarn -- one of the daemons getting killed

2013-12-16 Thread Krishna Kishore Bonagiri
files as well for daemons. You may find something. Cheers, Vinayakumar B *From:* Krishna Kishore Bonagiri [mailto:write2kish...@gmail.com] *Sent:* 16 December 2013 16:50 *To:* user@hadoop.apache.org *Subject:* Re: Yarn -- one of the daemons getting killed Hi Vinod, Yes, I am

Re: Yarn -- one of the daemons getting killed

2013-12-16 Thread Jeff Stuckman
@hadoop.apache.org Reply To: user@hadoop.apache.org Subject: Re: Yarn -- one of the daemons getting killed Hi Vinod, Yes, I am running on Linux. I was actually searching for a corresponding message in /var/log/messages to confirm that OOM killed my daemons, but could not find any corresponding messages

RE: Yarn -- one of the daemons getting killed

2013-12-16 Thread java8964
Bonagiri Sent: Monday, December 16, 2013 6:20 AM To: user@hadoop.apache.org Reply To: user@hadoop.apache.org Subject: Re: Yarn -- one of the daemons getting killed Hi Vinod, Yes, I am running on Linux. I was actually searching for a corresponding message in /var/log/messages to confirm

Re: Yarn -- one of the daemons getting killed

2013-12-13 Thread Krishna Kishore Bonagiri
Vinod, One more thing I observed is that, my Client which submits Application Master one after another continuously also gets killed sometimes. So, it is always any of the Java Processes that is getting killed. Does it indicate some excessive memory usage by them or something like that, that is

Re: Yarn -- one of the daemons getting killed

2013-12-13 Thread Vinod Kumar Vavilapalli
Yes, that is what I suspect. That is why I asked if everything is on a single node. If you are running linux, linux OOM killer may be shooting things down. When it happens, you will see something like 'killed process in system's syslog. Thanks, +Vinod On Dec 13, 2013, at 4:52 AM, Krishna

Re: Yarn -- one of the daemons getting killed

2013-12-13 Thread Adam Kawa
If you are interested, please read how we run into OOM-killer issue that was killing our TaskTrackers http://hakunamapdata.com/two-memory-related-issues-on-the-apache-hadoop-cluster/ (+ one issue related to heavy swapping). 2013/12/13 Vinod Kumar Vavilapalli vino...@hortonworks.com Yes, that

Yarn -- one of the daemons getting killed

2013-12-12 Thread Krishna Kishore Bonagiri
Hi, I am running a small application on YARN (2.2.0) in a loop of 500 times, and while doing so one of the daemons, node manager, resource manager, or data node is getting killed (I mean disappearing) at a random point. I see no information in the corresponding log files. How can I know why is

Re: Yarn -- one of the daemons getting killed

2013-12-12 Thread Vinod Kumar Vavilapalli
Is all of this on a single node? Thanks, +Vinod On Dec 12, 2013, at 3:26 AM, Krishna Kishore Bonagiri write2kish...@gmail.com wrote: Hi, I am running a small application on YARN (2.2.0) in a loop of 500 times, and while doing so one of the daemons, node manager, resource manager, or

Re: Yarn -- one of the daemons getting killed

2013-12-12 Thread Krishna Kishore Bonagiri
No, I am running on 2 node cluster. On Fri, Dec 13, 2013 at 1:52 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: Is all of this on a single node? Thanks, +Vinod On Dec 12, 2013, at 3:26 AM, Krishna Kishore Bonagiri write2kish...@gmail.com wrote: Hi, I am running a small