Re: Slider stop not working

2015-05-18 Thread Chackravarthy Esakkimuthu
sure Gour, I have already filed an issue for the same in hadoop-common and will submit patch. Thanks for your assistance in helping me debugging this issue. On Mon, May 18, 2015 at 2:54 AM, Gour Saha wrote: > Chackra, > This is wonderful. Than

Re: Slider stop not working

2015-05-17 Thread Gour Saha
Chackra, This is wonderful. Thanks for debugging this and finding a solution. Now that we know it works for Debian, we have to check if this modified syntax will work for other OSes? If yes, then we can make a machine independent change. Otherwise we have to make OS specific code change. I wo

Re: Slider stop not working

2015-05-17 Thread Chackravarthy Esakkimuthu
Gour/Steve, The issue was because of improper kill command construction by DefaultContainerExecutor, and hence kill SIGTERM itself was not issued to SliderAgent, hence all the agents as well as components continue to run. I made one change in Shell.java (hadoop-common) to construct the kill comm

Re: Slider stop not working

2015-05-14 Thread Chackravarthy Esakkimuthu
sure Gour, would like to take up this task and contribute. Thanks for the pointers for me to proceed with, I will get in touch with you incase If I need any more help. And wrt kill -s TERM on main.py processes (tried on both parent and child process independently), please find the result as follow

Re: Slider stop not working

2015-05-13 Thread Gour Saha
Hi Chackra, You are absolutely right. The workaround that I was planning to work on, should be implemented as a neat backup solution, when YARN fails to shutdown containers (in this and certain other possible scenarios). In fact, we had filed a bug long time back along the same lines, predictin

Re: Slider stop not working

2015-05-13 Thread Chackravarthy Esakkimuthu
Thanks for your response steve, I was thinking that SliderAgent would receive 'stop' command from SliderAM to kill the components spawned by those agents. And yeah this might be specific to debian installation as others in the group are not facing this issue. On Tue, May 12, 2015 at 1:50 PM, Stev

Re: Slider stop not working

2015-05-12 Thread Steve Loughran
> On 12 May 2015, at 08:42, Chackravarthy Esakkimuthu > wrote: > > Starting a new thread, > > already JIRA filed for the same by Gour, > https://issues.apache.org/jira/browse/YARN-3561 > > Slider stop does not stop the components started by slider, instead it > stops only SliderAM, and even S

Slider stop not working

2015-05-12 Thread Chackravarthy Esakkimuthu
Starting a new thread, already JIRA filed for the same by Gour, https://issues.apache.org/jira/browse/YARN-3561 Slider stop does not stop the components started by slider, instead it stops only SliderAM, and even SliderAgents did not receive 'stop' command. (it happens with debian 7) and tested w