[
https://issues.apache.org/jira/browse/OOZIE-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rohini Palaniswamy updated OOZIE-2475:
--------------------------------------
Description:
There is corner case where leaking happens.
when workflow KillCommand is issued, WfEndXCommand is invoked in the end
finally block, and WfEndXCommand.deleteWFDir() kills action Dir (e.g.,
/user/satish/oozie_satish/123450-15000000000000-oozie_satish-W)
but, when this happens right before launcher mapper uploading actionData to
HDFS, previously deleted actionDir is created again. the actionDir will not be
cleaned up after. This leak can fill up namespace quota of user over a period
of time.
The solution is to delete clean up action dir in ActionKillXCommand.
was:
There is corner case where leaking happens.
when workflow KillCommand is issued, WfEndXCommand is invoked in the end
finally block, and WfEndXCommand.deleteWFDir() kills action Dir (e.g.,
/user/satish/oozie_satish/123450-15000000000000-oozie_satish-W)
but, when this happens right before launcher mapper uploading actionData to
HDFS, previously deleted actionDir is created again. the actionDir will not be
cleaned up after.
The solution is to delete clean up action dir in ActionKillXCommand.
Summary: Oozie does not cleanup action dir of killed actions (was:
Oozie does not cleanup failed actions; fills up namespace quota)
> Oozie does not cleanup action dir of killed actions
> ---------------------------------------------------
>
> Key: OOZIE-2475
> URL: https://issues.apache.org/jira/browse/OOZIE-2475
> Project: Oozie
> Issue Type: Bug
> Reporter: Satish Subhashrao Saley
> Assignee: Satish Subhashrao Saley
> Attachments: OOZIE-2475-1.patch
>
>
> There is corner case where leaking happens.
> when workflow KillCommand is issued, WfEndXCommand is invoked in the end
> finally block, and WfEndXCommand.deleteWFDir() kills action Dir (e.g.,
> /user/satish/oozie_satish/123450-15000000000000-oozie_satish-W)
> but, when this happens right before launcher mapper uploading actionData to
> HDFS, previously deleted actionDir is created again. the actionDir will not
> be cleaned up after. This leak can fill up namespace quota of user over a
> period of time.
> The solution is to delete clean up action dir in ActionKillXCommand.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
