Harvested links shouldn't get db.score.injected in addition to inbound
contributions
------------------------------------------------------------------------------------
Key: NUTCH-336
URL: http://issues.apache.org/jira/browse/NUTCH-336
Project: Nutch
Issue Type: Bug
Components: fetcher
Affects Versions: 0.8
Reporter: Chris Schneider
Priority: Minor
Currently (even with Stefan's fix for NUTCH-324), harvested links have their
initial scores set to db.score.injected + (sum of inbound contributions *
db.score.link.[internal | external]), but this will place (at least external)
harvested links even higher than injected URLs on the fetch list. Perhaps more
importantly, this effect cascades.
As a simple example, if each page in A->B->C->D has exactly one external link
and only A is injected, then D will receive an initial score of at least
(4*db.score.injected) with the default db.score.link.external of 1.0. Higher
values of db.score.injected and db.score.link.external obviously exacerbate
this problem.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
