Re: [jira] Updated: (NUTCH-755) DomainURLFilter crashes on malformed URL
unsubscribe --- On Tue, 12/29/09, Mike Baranczak (JIRA) wrote: From: Mike Baranczak (JIRA) Subject: [jira] Updated: (NUTCH-755) DomainURLFilter crashes on malformed URL To: nutch-dev@lucene.apache.org Date: Tuesday, December 29, 2009, 2:31 PM [ https://issues.apache.org/jira/browse/NUTCH-755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Baranczak updated NUTCH-755: - Attachment: DomainURLFilter.java > DomainURLFilter crashes on malformed URL > > > Key: NUTCH-755 > URL: https://issues.apache.org/jira/browse/NUTCH-755 > Project: Nutch > Issue Type: Bug > Components: fetcher > Affects Versions: 1.0.0 > Environment: Tomcat 6.0.14 > Java 1.6.0_14 > Linux > Reporter: Mike Baranczak > Assignee: Andrzej Bialecki > Attachments: DomainURLFilter.java > > > 2009-09-16 21:54:17,001 ERROR [Thread-156] DomainURLFilter - Could not apply > filter on url: http:/comments.php > java.lang.NullPointerException > at >org.apache.nutch.urlfilter.domain.DomainURLFilter.filter(DomainURLFilter.java:173) > at org.apache.nutch.net.URLFilters.filter(URLFilters.java:88) > at >org.apache.nutch.parse.ParseOutputFormat$1.write(ParseOutputFormat.java:200) > at >org.apache.nutch.parse.ParseOutputFormat$1.write(ParseOutputFormat.java:113) > at >org.apache.nutch.fetcher.FetcherOutputFormat$1.write(FetcherOutputFormat.java:96) > at >org.apache.nutch.fetcher.FetcherOutputFormat$1.write(FetcherOutputFormat.java:70) > at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:410) > at >org.apache.hadoop.mapred.lib.IdentityReducer.reduce(IdentityReducer.java:39) > at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:436) > at >org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:170) > Expected behavior would be to recognize the URL as malformed, and reject it. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (NUTCH-775) Enhance Searcher interface
[ https://issues.apache.org/jira/browse/NUTCH-775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sami Siren updated NUTCH-775: - Attachment: NUTCH-775.patch I ended up changing the Query API instead since the changes were smaller from API perspective that way. > Enhance Searcher interface > -- > > Key: NUTCH-775 > URL: https://issues.apache.org/jira/browse/NUTCH-775 > Project: Nutch > Issue Type: Improvement > Components: searcher >Reporter: Sami Siren >Assignee: Sami Siren > Fix For: 1.1 > > Attachments: NUTCH-775.patch > > > Current Searcher interface is too limited for many purposes: > Hits search(Query query, int numHits, String dedupField, String sortField, > boolean reverse) throws IOException; > It would be nice that we had an interface that allowed adding different > features without changing the interface. I am proposing that we deprecate the > current search method and introduce something like: > Hits search(Query query, Metadata context) throws IOException; > Also at the same time we should enhance the QueryFilter interface to look > something like: > BooleanQuery filter(Query input, BooleanQuery translation, Metadata context) > throws QueryException; > I would like to hear your comments before proceeding with a patch. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
unsubscribe
unsubscribe --- On Wed, 12/30/09, Sami Siren (JIRA) wrote: From: Sami Siren (JIRA) Subject: [jira] Updated: (NUTCH-775) Enhance Searcher interface To: nutch-dev@lucene.apache.org Date: Wednesday, December 30, 2009, 11:09 AM [ https://issues.apache.org/jira/browse/NUTCH-775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sami Siren updated NUTCH-775: - Attachment: NUTCH-775.patch I ended up changing the Query API instead since the changes were smaller from API perspective that way. > Enhance Searcher interface > -- > > Key: NUTCH-775 > URL: https://issues.apache.org/jira/browse/NUTCH-775 > Project: Nutch > Issue Type: Improvement > Components: searcher > Reporter: Sami Siren > Assignee: Sami Siren > Fix For: 1.1 > > Attachments: NUTCH-775.patch > > > Current Searcher interface is too limited for many purposes: > Hits search(Query query, int numHits, String dedupField, String sortField, > boolean reverse) throws IOException; > It would be nice that we had an interface that allowed adding different > features without changing the interface. I am proposing that we deprecate the > current search method and introduce something like: > Hits search(Query query, Metadata context) throws IOException; > Also at the same time we should enhance the QueryFilter interface to look > something like: > BooleanQuery filter(Query input, BooleanQuery translation, Metadata context) > throws QueryException; > I would like to hear your comments before proceeding with a patch. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
