[
https://issues.apache.org/jira/browse/PIG-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rohini Palaniswamy updated PIG-4921:
------------------------------------
Attachment: PIG-4921-3.patch
Updated patch to have shutdown hooks ordered taking into account issue in
PIG-4916. One side effect of this is that shutdown hook all run in a single
thread now. But it should be fine as only when running via Oozie launcher time
is of concern and in that case we kill the running jobs before shutdown hook.
So shutdown hook will only have to cleanup tmp files and close TimelineClient
which have to be done before filesystem is closed.
> Kill running jobs on InterruptedException
> -----------------------------------------
>
> Key: PIG-4921
> URL: https://issues.apache.org/jira/browse/PIG-4921
> Project: Pig
> Issue Type: Bug
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.17.0
>
> Attachments: PIG-4921-1.patch, PIG-4921-2.patch, PIG-4921-3.patch
>
>
> Shutdown hook kills running jobs, but when running in Oozie launcher
> sometimes NodeManager can issue a SIGKILL after AM unregisters and before
> shutdown hook gets to execute causing orphaned jobs that continue to run. So
> it is better to kill when we see the InterruptedException.
> Added additional System.err logging to code in shutdown hooks as
> LogManager.shutdown() is called by mapreduce AM (Oozie launcher job is
> mapreduce) and log4j logging does not appear anymore.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
