Shubham created OOZIE-3610:
------------------------------
Summary: Need to improve Oozie job handling if oozie launcher Map
is killed
Key: OOZIE-3610
URL: https://issues.apache.org/jira/browse/OOZIE-3610
Project: Oozie
Issue Type: Improvement
Reporter: Shubham
- Due to Yarn Pre-emption, Yarn is killing Map task, which results in new
Spark job. So we have duplicate job.
- We were able to reproduce issue after killing running Oozie launcher Map
task.
- To fix above issue, we applied OOZIE-2194, which kills running Spark Job on
map task kill(launcher job) and launch new one.
- If existing job is killed, we are wasting progress made by existing running
job and it will again start from beginning
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
