[ https://issues.apache.org/jira/browse/NUTCH-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sebastian Nagel resolved NUTCH-1389. ------------------------------------ Resolution: Fixed committed to trunk (r1461854) and 2.x (r1461857) > parsechecker and indexchecker to report truncated content > --------------------------------------------------------- > > Key: NUTCH-1389 > URL: https://issues.apache.org/jira/browse/NUTCH-1389 > Project: Nutch > Issue Type: Improvement > Components: indexer, parser > Affects Versions: nutchgora, 1.5 > Reporter: Sebastian Nagel > Assignee: Sebastian Nagel > Priority: Minor > Fix For: 1.7, 2.2 > > Attachments: NUTCH-1389-2x.patch, NUTCH-1389-trunk.patch > > > ParserChecker and IndexingFiltersChecker should report when a document is > truncated due to {http,file,ftp}.content.limit. > Truncated content may cause text and metadata extraction to fail for PDF and > other binary document formats. > A hint that truncation (and not a broken plugin) is the possible reason would > be useful. > See NUTCH-965 and {{ParseSegment.isTruncated(content)}}. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira