Ryota Egashira created OOZIE-2206:
-------------------------------------

             Summary: Change Reaper mode on ChildReaper in ZKLocksService
                 Key: OOZIE-2206
                 URL: https://issues.apache.org/jira/browse/OOZIE-2206
             Project: Oozie
          Issue Type: Bug
            Reporter: Ryota Egashira


OOZIE-1906 added znode cleanup thread.
currently passing Reaper.Mode.REAP_INDEFINITELY, but this enforce Oozie server 
to keep reaping znode even after znode is cleaned up.   This adds memory 
pressure on oozie server. Need to change to REAP_UNTIL_GONE  or 
REAP_UNTIL_DELETE
  
{code}
reaper = new ChildReaper(zk.getClient(), LOCKS_NODE, 
Reaper.Mode.REAP_INDEFINITELY, getExecutorService(), 
ConfigurationService.getInt(services.getConf(), REAPING_THRESHOLD) * 1000, 
REAPING_LEADER_PATH);
{code}

we hit one scenario where  one ZK quorum slows down for short period, causing 
many Zk locks not released properly, right after ChildReaper (every 5 min ) 
runs, which keep checking the list of Znode ever since, in the end, Oozie 
server hit OOM.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to