[
https://issues.apache.org/jira/browse/NUTCH-44?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12569428#action_12569428
]
Andrzej Bialecki commented on NUTCH-44:
----------------------------------------
The name of the property is somewhat misleading, because it applies to Web GUI
and the OpenSearch servlet. Can we come up with a better name (and shorter too
;) )?
Also, this patch doesn't solve the whole issue, though it addresses the
specific scenario described by the reporter. In general, even if hitsPerPage is
small, it is still very expensive to retrieve a page of results far down the
list, e.g. results 1000-10010. Currently Nutch will attempt to retrieve 10
results no matter what is the starting point, which represents a potential way
to launch a DoS attack. Still, we can first fix this issue, and address this
problem in a new issue.
> too many search results
> -----------------------
>
> Key: NUTCH-44
> URL: https://issues.apache.org/jira/browse/NUTCH-44
> Project: Nutch
> Issue Type: Bug
> Components: web gui
> Environment: web environment
> Reporter: Emilijan Mirceski
> Assignee: Dennis Kubes
> Attachments: NUTCH-44.patch
>
>
> There should be a limitation (user defined) on the number of results the
> search engine can return.
> For example, if one modifies the seach url as:
> http://<my>/search.jsp?query=<some quiery>&hitsPerPage=20000&hitsPerSite=0
> The search will try to return 20,000 pages which isn't good for the server
> side performance.
> Is it possible to have a setting in the config xml files to control this?
> Thanks,
> Emilijan
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
