Sudarshan Vasudevan created GOBBLIN-1384:
--------------------------------------------
Summary: Fix task cancellation to ensure task commit is invoked
only after task completes
Key: GOBBLIN-1384
URL: https://issues.apache.org/jira/browse/GOBBLIN-1384
Project: Apache Gobblin
Issue Type: Bug
Components: gobblin-core
Affects Versions: 0.16.0
Reporter: Sudarshan Vasudevan
Assignee: Abhishek Tiwari
Fix For: 0.16.0
Per the current behavior, the task is marked as completed as soon as task
cancellation is invoked, which interrupts the task, and immediately decrements
a latch counting the number of running tasks. This implies that
GobblinMultiTaskAttempt which monitors this countdown latch, can invoke task
commit before the task has completed. This can lead to incorrect behavior in
batch mode and potential resource leak in the streaming mode where commit
failures potentially leaves some resources open.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
