Jay Sen created GOBBLIN-952:
-------------------------------
Summary: PathAlerationListner needs to picks up only modified job
Key: GOBBLIN-952
URL: https://issues.apache.org/jira/browse/GOBBLIN-952
Project: Apache Gobblin
Issue Type: Bug
Affects Versions: 0.14.0
Reporter: Jay Sen
Fix For: 0.15.0
{{PathAlterationListenerAdaptorForMonitor}} detects any changes to the job
config path, which is the required functionality but it also literally tried to
schedule or unschedule all the changes.
In case the job runs only once (by config), it will move it to .done file which
it then tries to unschedule it.
May be the monitor needs additional logic to ignore some changes like this.
here is the log
{code:java}
22:57:38.803 INFO: [TaskExecutor STOPPING-97]
[org.apache.gobblin.runtime.TaskExecutor] TaskExecutor - Successfully shutdown
ExecutorService:
com.google.common.util.concurrent.MoreExecutors$ScheduledListeningDecorator@6b5a367e
22:57:38.803 INFO: [TaskExecutor STOPPING-97]
[org.apache.gobblin.runtime.TaskExecutor] TaskExecutor - Attempting to shutdown
ExecutorService:
com.google.common.util.concurrent.MoreExecutors$ListeningDecorator@659dd565
22:57:38.803 INFO: [TaskExecutor STOPPING-97]
[org.apache.gobblin.runtime.TaskExecutor] TaskExecutor - Successfully shutdown
ExecutorService:
com.google.common.util.concurrent.MoreExecutors$ListeningDecorator@659dd565
22:57:38.803 INFO: [LocalTaskStateTracker STOPPING-98]
[org.apache.gobblin.runtime.local.LocalTaskStateTracker] LocalTaskStateTracker
- Stopping the task state tracker
22:57:38.803 INFO: [LocalTaskStateTracker STOPPING-98]
[org.apache.gobblin.runtime.local.LocalTaskStateTracker] LocalTaskStateTracker
- Attempting to shutdown ExecutorService:
com.google.common.util.concurrent.MoreExecutors$ScheduledListeningDecorator@5faf4e52
22:57:38.804 INFO: [LocalTaskStateTracker STOPPING-98]
[org.apache.gobblin.runtime.local.LocalTaskStateTracker] LocalTaskStateTracker
- Successfully shutdown ExecutorService:
com.google.common.util.concurrent.MoreExecutors$ScheduledListeningDecorator@5faf4e52
22:57:38.804 INFO: [JobScheduler-2-70]
[org.apache.gobblin.source.extractor.filebased.FileBasedSource] FileBasedSource
- Shutting down the FileSystemHelper connection
22:57:56.476 INFO: [newDaemonThreadFactory-26]
[org.apache.gobblin.scheduler.PathAlterationListenerAdaptorForMonitor]
PathAlterationListenerAdaptorForMonitor - Detected deletion of job
configuration file
file:/home/jsenjaliya/gobblin-dist/gobblin-jobs/local-aerospike-avro.pull
22:57:56.476 INFO: [newDaemonThreadFactory-26]
[org.apache.gobblin.scheduler.PathAlterationListenerAdaptorForMonitor]
PathAlterationListenerAdaptorForMonitor - Could not find a scheduled job to
unschedule with path
/home/jsenjaliya/gobblin-dist/gobblin-jobs/local-aerospike-avro.pull
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
