Child processes still running after successful job

2014-04-11 Thread chadi jaber 
Hi everybody,
I have a problem with giraph and hadoop 1.2.1. After a successful giraph job, 
giraph workers are still running and are not cleanup (Child processes still 
visible with a jps command)
is this normal?
Thanks in advanceChadi

Re: Child processes still running after successful job

2014-04-11 Thread Yi Lu 
HI Chadi,

I also have this problem, my solution is to write a python script to kill
the process on each slave machine which consumes lots of memory.:)

I hope there is a better solution.
​

RE: Child processes still running after successful job

2014-04-11 Thread chadi jaber 

Hi avery 
What do you mean by your version of hadoop ?
Best regards,Chadi
 Date: Fri, 11 Apr 2014 07:35:44 -0700
 From: ach...@apache.org
 To: user@giraph.apache.org
 Subject: Re: Child processes still running after successful job
 
 Unfortunately we don't face this issue since our version of Hadoop kills 
 processes after a job is complete.  If you can do a jstack, you can 
 probably figure out where this is hanging and submit a patch to fix it.
 
 On 4/11/14, 4:24 AM, Yi Lu wrote:
  HI Chadi,
 
  I also have this problem, my solution is to write a python script to 
  kill the process on each slave machine which consumes lots of memory.:)
 
  I hope there is a better solution.
  ​

Re: Child processes still running after successful job

2014-04-11 Thread Avery Ching 
Corona - 
https://www.facebook.com/notes/facebook-engineering/under-the-hood-scheduling-mapreduce-jobs-more-efficiently-with-corona/10151142560538920


On 4/11/14, 8:14 AM, chadi jaber wrote:


Hi avery

What do you mean by your version of hadoop ?

Best regards,
Chadi

 Date: Fri, 11 Apr 2014 07:35:44 -0700
 From: ach...@apache.org
 To: user@giraph.apache.org
 Subject: Re: Child processes still running after successful job

 Unfortunately we don't face this issue since our version of Hadoop 
kills

 processes after a job is complete. If you can do a jstack, you can
 probably figure out where this is hanging and submit a patch to fix it.

 On 4/11/14, 4:24 AM, Yi Lu wrote:
  HI Chadi,
 
  I also have this problem, my solution is to write a python script to
  kill the process on each slave machine which consumes lots of 
memory.:)

 
  I hope there is a better solution.
  ​