Looks like the segment is faulty nevertheless so I had to delete it and reindex. So what could cause this error ?
2011/5/7 MilleBii <[email protected]> > Hi guys, > > I have an issue with my fetcher which gives me the following headache > > Fetcher: Your 'http.agent.name' value should be listed first in > 'http.robots.agents' property. > Fetcher: starting > Fetcher: segment: crawl/segments/20110503210804 > java.io.IOException: Task process exit with nonzero status of 134. > at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:425) > > Fetcher: done > > Actually I see nothing in the hadoop log related to that > java.io.IOException, the fetcher goes fine, parsing etc... also. > However this error is faulting my script. > > Any suggestion what this error might be ? > > -- > -MilleBii- > -- -MilleBii-
