[ https://issues.apache.org/jira/browse/NUTCH-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14480977#comment-14480977 ]
Chong Li commented on NUTCH-1771: --------------------------------- Hi, I changed the check function to static and also the isIndexable(). Now the SegmentChecker only have two static check method. Please review the code and give me more suggestions~ https://github.com/apache/nutch/compare/trunk...areshero:NUTCH-1771 > Solrindex fails if a segment is corrupted or incomplete > ------------------------------------------------------- > > Key: NUTCH-1771 > URL: https://issues.apache.org/jira/browse/NUTCH-1771 > Project: Nutch > Issue Type: Bug > Components: indexer > Affects Versions: 1.8, 1.10 > Reporter: Diaa > Priority: Minor > Fix For: 1.11 > > > When using solrindex to index multiple segments via -dir segment, > the indexing fails if one or more segments are corrupted/incomplete > (generated but not fetched for example) > The failure is simply java.io exception. > Deleting the segment fixes the issue. > The expected behavior should be one of the following: > * skipping the segment and proceeding with others (while logging) > * stopping the indexing and logging the failed segment -- This message was sent by Atlassian JIRA (v6.3.4#6332)