Sebastian Nagel created NUTCH-2442: -------------------------------------- Summary: Injector to stop if job fails to avoid loss of CrawlDb Key: NUTCH-2442 URL: https://issues.apache.org/jira/browse/NUTCH-2442 Project: Nutch Issue Type: Bug Components: injector Affects Versions: 1.13 Reporter: Sebastian Nagel Priority: Critical Fix For: 1.14
Injector does not check whether the MapReduce job is successful. Even if the job fails - installs the CrawlDb -- move current/ to old/ -- replace current/ with an empty or potentially incomplete version - exits with code 0 so that scripts running the crawl workflow cannot detect the failure -- if Injector is run a second time the CrawlDb is lost (both current/ and old/ are empty or corrupted) -- This message was sent by Atlassian JIRA (v6.4.14#64029)