[ https://issues.apache.org/jira/browse/NUTCH-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593973#comment-14593973 ]
ASF GitHub Bot commented on NUTCH-2038: --------------------------------------- Github user chrismattmann commented on a diff in the pull request: https://github.com/apache/nutch/pull/34#discussion_r32869857 --- Diff: ivy/ivy.xml --- @@ -78,7 +78,11 @@ <dependency org="org.apache.cxf" name="cxf-rt-transports-http-jetty" rev="3.0.4"/> <dependency org="com.fasterxml.jackson.core" name="jackson-databind" rev="2.5.1" /> <dependency org="com.fasterxml.jackson.dataformat" name="jackson-dataformat-cbor" rev="2.5.1" /> - <dependency org="com.fasterxml.jackson.jaxrs" name="jackson-jaxrs-json-provider" rev="2.5.1" /> + <dependency org="com.fasterxml.jackson.jaxrs" name="jackson-jaxrs-json-provider" rev="2.5.1" /> + <dependency org="org.apache.mahout" name="mahout-math" rev="0.8" /> --- End diff -- can these just be in the plugin's ivy.xml? > Naive Bayes classifier based url filter > --------------------------------------- > > Key: NUTCH-2038 > URL: https://issues.apache.org/jira/browse/NUTCH-2038 > Project: Nutch > Issue Type: New Feature > Components: fetcher, injector, parser > Reporter: Asitang Mishra > Assignee: Chris A. Mattmann > Labels: memex, nutch > Fix For: 1.11 > > > A url filter that will filter out the urls (after the parsing stage, will > keep only those urls that contain some "hot words" provided again in a list.) > from that pages that are classified irrelevant by the classifier. -- This message was sent by Atlassian JIRA (v6.3.4#6332)