[ 
https://issues.apache.org/jira/browse/NUTCH-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593974#comment-14593974
 ] 

ASF GitHub Bot commented on NUTCH-2038:
---------------------------------------

Github user chrismattmann commented on a diff in the pull request:

    https://github.com/apache/nutch/pull/34#discussion_r32869870
  
    --- Diff: src/java/org/apache/nutch/net/URLFilters.java ---
    @@ -41,4 +42,28 @@ public String filter(String urlString) throws 
URLFilterException {
         }
         return urlString;
       }
    +
    +  /**
    +   * Get a filter with the full classname if only it is activated through 
the
    +   * nutch-site.xml
    +   */
    +  public URLFilter getFilter(String classname) {
    --- End diff --
    
    this is orthogonal to this patch, no?


> Naive Bayes classifier based url filter
> ---------------------------------------
>
>                 Key: NUTCH-2038
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2038
>             Project: Nutch
>          Issue Type: New Feature
>          Components: fetcher, injector, parser
>            Reporter: Asitang Mishra
>            Assignee: Chris A. Mattmann
>              Labels: memex, nutch
>             Fix For: 1.11
>
>
> A url filter that will filter out the urls (after the parsing stage,  will 
> keep only those urls that contain some "hot words" provided again in a list.) 
> from that pages that are classified irrelevant by the classifier.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to