[
https://issues.apache.org/jira/browse/NUTCH-489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12499777
]
Doğacan Güney commented on NUTCH-489:
-------------------------------------
Please ignore my last comment. I don't know what I was on when I wrote that.
Your patch seems to be correct.
Andrzej, (hope you are reading this:) isn't javadoc in SuffixURLFilter wrong?
It says "...., you should use "+.jpg" instead.", but AFAICS, that line would
have no effect except possibly switching mode to accept. Since, first character
after '+' is not 'I', filter will just skip rest of the line. Am I missing
something here?
> URLFilter-suffix management of the url path when the url contains some query
> parameters
> ---------------------------------------------------------------------------------------
>
> Key: NUTCH-489
> URL: https://issues.apache.org/jira/browse/NUTCH-489
> Project: Nutch
> Issue Type: Improvement
> Affects Versions: 0.9.0
> Environment: Windows, Java 1.5
> Reporter: Emmanuel Joke
> Attachments: suffix-urlfilter.txt.patch, SuffixURLFilter.java.patch,
> SuffixURLFilter_v2.java.patch
>
>
> The current filter compares only on string level. It try to apply the filter
> to the full URL (path + query parameters).
> So, even if we have define in our filter to exclude all js extension, it
> won't exclude this URL http://www.toto.com/from.js?id=5.
> I've added a new parameter in the filter which can be use to configure the
> filter to exclude URL based on the url path.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
-------------------------------------------------------------------------
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
_______________________________________________
Nutch-developers mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-developers