Github user cestella commented on the issue: https://github.com/apache/metron/pull/1081 One more comment about restartability, I think we could potentially support this with this architecture in the future. You can recover the Job object from MR via the JobClient ``` Configuration conf = new Configuration(); JobClient jobClient = new JobClient(new JobConf(conf)); // deprecation WARN JobID jobID = JobID.forName("job_201107011451_0001"); // deprecation WARN RunningJob runningJob = jobClient.getJob(jobID); ``` We could look for jobs which are completed but not in the HDFS structure and recover them on REST start. I would suggest doing that as a follow-on though.
---