Child processes still running after successful job
Hi everybody, I have a problem with giraph and hadoop 1.2.1. After a successful giraph job, giraph workers are still running and are not cleanup (Child processes still visible with a jps command) is this normal? Thanks in advanceChadi
Re: Child processes still running after successful job
HI Chadi, I also have this problem, my solution is to write a python script to kill the process on each slave machine which consumes lots of memory.:) I hope there is a better solution.
RE: Child processes still running after successful job
Hi avery What do you mean by your version of hadoop ? Best regards,Chadi Date: Fri, 11 Apr 2014 07:35:44 -0700 From: ach...@apache.org To: user@giraph.apache.org Subject: Re: Child processes still running after successful job Unfortunately we don't face this issue since our version of Hadoop kills processes after a job is complete. If you can do a jstack, you can probably figure out where this is hanging and submit a patch to fix it. On 4/11/14, 4:24 AM, Yi Lu wrote: HI Chadi, I also have this problem, my solution is to write a python script to kill the process on each slave machine which consumes lots of memory.:) I hope there is a better solution.
Re: Child processes still running after successful job
Corona - https://www.facebook.com/notes/facebook-engineering/under-the-hood-scheduling-mapreduce-jobs-more-efficiently-with-corona/10151142560538920 On 4/11/14, 8:14 AM, chadi jaber wrote: Hi avery What do you mean by your version of hadoop ? Best regards, Chadi Date: Fri, 11 Apr 2014 07:35:44 -0700 From: ach...@apache.org To: user@giraph.apache.org Subject: Re: Child processes still running after successful job Unfortunately we don't face this issue since our version of Hadoop kills processes after a job is complete. If you can do a jstack, you can probably figure out where this is hanging and submit a patch to fix it. On 4/11/14, 4:24 AM, Yi Lu wrote: HI Chadi, I also have this problem, my solution is to write a python script to kill the process on each slave machine which consumes lots of memory.:) I hope there is a better solution.