Generic LinkRank plugin for Nutch

2013-05-29 Thread Ahmet Emre Aladağ
Hi, I'm working on LinkRank Implementation with Giraph for both Nutch 1.x and 2.x. What I'm planning [1] is to get the outlink data and give it as a graph to Giraph and perform LinkRank calculation . Then read the results and inject them back to Nutch. Summary of the task: 1. Get the outlin

[jira] [Resolved] (NUTCH-1563) FetchSchedule#getFields is never used by GeneraterJob

2013-05-29 Thread lufeng (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufeng resolved NUTCH-1563. --- Resolution: Fixed > FetchSchedule#getFields is never used by GeneraterJob > -

[jira] [Closed] (NUTCH-1563) FetchSchedule#getFields is never used by GeneraterJob

2013-05-29 Thread lufeng (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-1563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufeng closed NUTCH-1563. - > FetchSchedule#getFields is never used by GeneraterJob > - >

[jira] [Resolved] (NUTCH-1575) support solr authentication in nutch 2.x

2013-05-29 Thread lufeng (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lufeng resolved NUTCH-1575. --- Resolution: Fixed > support solr authentication in nutch 2.x > >

[jira] [Commented] (NUTCH-1575) support solr authentication in nutch 2.x

2013-05-29 Thread lufeng (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13669351#comment-13669351 ] lufeng commented on NUTCH-1575: --- Committed for 2.2 revision 1487521 by Feng. Thanks Lewis

[jira] [Commented] (NUTCH-1545) capture batchId and remove references to segments in 2.x crawl script.

2013-05-29 Thread Lewis John McGibbney (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-1545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13669392#comment-13669392 ] Lewis John McGibbney commented on NUTCH-1545: - Hi Feng, do you want to commit

[jira] [Commented] (NUTCH-1575) support solr authentication in nutch 2.x

2013-05-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/NUTCH-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13669419#comment-13669419 ] Hudson commented on NUTCH-1575: --- Integrated in Nutch-nutchgora #623 (See [https://builds.ap

RE: Generic LinkRank plugin for Nutch

2013-05-29 Thread Markus Jelsma
Hi Ahmet! This is really interesting and i'm very curious about performance improvements. For example, it can take many hours to calculate a billions of records for 10 power iterations in 1.x! Please open a new issue at Jira whenever you're ready and consider copying your wiki page to the Nutch