Urmi Mustafi created GOBBLIN-2107:
-------------------------------------
Summary: Delete adhoc flowSpecs from flowCatalog
Key: GOBBLIN-2107
URL: https://issues.apache.org/jira/browse/GOBBLIN-2107
Project: Apache Gobblin
Issue Type: Bug
Components: gobblin-service
Reporter: Urmi Mustafi
Assignee: Abhishek Tiwari
Delete adhoc flowSpecs from flowCatalog to avoid build up of adhoc flowSpecs in
catalog even when job compilation fails by adding the deletion in a finally
block in non-MA scheduler case.
# Previous PR: [https://github.com/apache/gobblin/pull/3944/files] causes a
bug where adhoc flows are not deleted when multi-active scheduler is enabled.
This PR re-adds deletion of flowSpec to the dagManager to be called by the
active host for the MA scheduler case (there will only be one active host if
dagManager is enabled otherwise code will use dagProcessingEngine).
# It also ensures quota is released and failed flow compilation event sent by
the FlowCompilationValidationHelper in all compilation failure cases. This was
being incorrectly handled before.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
