[ https://issues.apache.org/jira/browse/CONNECTORS-214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13054440#comment-13054440 ]
Karl Wright commented on CONNECTORS-214: ---------------------------------------- I added the necessary infrastructure in the framework for all of these related pieces in r1139294. > Add post-extraction inclusions and exclusions into the web connector > -------------------------------------------------------------------- > > Key: CONNECTORS-214 > URL: https://issues.apache.org/jira/browse/CONNECTORS-214 > Project: ManifoldCF > Issue Type: Improvement > Components: Web connector > Affects Versions: ManifoldCF 0.1, ManifoldCF 0.2 > Reporter: Erlend GarĂ¥sen > Assignee: Karl Wright > Fix For: ManifoldCF next > > > If html files are excluded for a job, links in these files will not be > followed. If we add inclusion and exclusion filters based on post-extraction, > it will be possible to fetch only certain types of documents, such as PDFs. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira