[
https://issues.apache.org/jira/browse/GOBBLIN-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Tiwari updated GOBBLIN-952:
------------------------------------
Fix Version/s: (was: 0.15.0)
0.16.0
> PathAlerationListner needs to picks up only modified job
> --------------------------------------------------------
>
> Key: GOBBLIN-952
> URL: https://issues.apache.org/jira/browse/GOBBLIN-952
> Project: Apache Gobblin
> Issue Type: Bug
> Affects Versions: 0.14.0
> Reporter: Jay Sen
> Priority: Minor
> Fix For: 0.16.0
>
>
> {{PathAlterationListenerAdaptorForMonitor}} detects any changes to the job
> config path, which is the required functionality but it also literally tried
> to schedule or unschedule all the changes.
> In case the job runs only once (by config), it will move it to .done file
> which it then tries to unschedule it.
> May be the monitor needs additional logic to ignore some changes like this.
> here is the log
> {code:java}
> 22:57:38.803 INFO: [TaskExecutor STOPPING-97]
> [org.apache.gobblin.runtime.TaskExecutor] TaskExecutor - Successfully
> shutdown ExecutorService:
> com.google.common.util.concurrent.MoreExecutors$ScheduledListeningDecorator@6b5a367e
> 22:57:38.803 INFO: [TaskExecutor STOPPING-97]
> [org.apache.gobblin.runtime.TaskExecutor] TaskExecutor - Attempting to
> shutdown ExecutorService:
> com.google.common.util.concurrent.MoreExecutors$ListeningDecorator@659dd565
> 22:57:38.803 INFO: [TaskExecutor STOPPING-97]
> [org.apache.gobblin.runtime.TaskExecutor] TaskExecutor - Successfully
> shutdown ExecutorService:
> com.google.common.util.concurrent.MoreExecutors$ListeningDecorator@659dd565
> 22:57:38.803 INFO: [LocalTaskStateTracker STOPPING-98]
> [org.apache.gobblin.runtime.local.LocalTaskStateTracker]
> LocalTaskStateTracker - Stopping the task state tracker
> 22:57:38.803 INFO: [LocalTaskStateTracker STOPPING-98]
> [org.apache.gobblin.runtime.local.LocalTaskStateTracker]
> LocalTaskStateTracker - Attempting to shutdown ExecutorService:
> com.google.common.util.concurrent.MoreExecutors$ScheduledListeningDecorator@5faf4e52
> 22:57:38.804 INFO: [LocalTaskStateTracker STOPPING-98]
> [org.apache.gobblin.runtime.local.LocalTaskStateTracker]
> LocalTaskStateTracker - Successfully shutdown ExecutorService:
> com.google.common.util.concurrent.MoreExecutors$ScheduledListeningDecorator@5faf4e52
> 22:57:38.804 INFO: [JobScheduler-2-70]
> [org.apache.gobblin.source.extractor.filebased.FileBasedSource]
> FileBasedSource - Shutting down the FileSystemHelper connection
> 22:57:56.476 INFO: [newDaemonThreadFactory-26]
> [org.apache.gobblin.scheduler.PathAlterationListenerAdaptorForMonitor]
> PathAlterationListenerAdaptorForMonitor - Detected deletion of job
> configuration file
> file:/home/jsenjaliya/gobblin-dist/gobblin-jobs/local-aerospike-avro.pull
> 22:57:56.476 INFO: [newDaemonThreadFactory-26]
> [org.apache.gobblin.scheduler.PathAlterationListenerAdaptorForMonitor]
> PathAlterationListenerAdaptorForMonitor - Could not find a scheduled job to
> unschedule with path
> /home/jsenjaliya/gobblin-dist/gobblin-jobs/local-aerospike-avro.pull
> {code}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
