[jira] [Commented] (NUTCH-1569) Upgrade 2.x to Gora 0.3
[ https://issues.apache.org/jira/browse/NUTCH-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13665991#comment-13665991 ] Hudson commented on NUTCH-1569: --- Integrated in Nutch-nutchgora #617 (See [https://builds.apache.org/job/Nutch-nutchgora/617/]) NUTCH-1569 Upgrade 2.x to Gora 0.3 (Revision 1485846) Result = SUCCESS lewismc : http://svn.apache.org/viewvc/nutch/branches/2.x/?view=revrev=1485846 Files : * /nutch/branches/2.x/CHANGES.txt * /nutch/branches/2.x/build.xml * /nutch/branches/2.x/ivy/ivy.xml * /nutch/branches/2.x/src/java/org/apache/nutch/api/DbReader.java * /nutch/branches/2.x/src/java/org/apache/nutch/crawl/WebTableReader.java * /nutch/branches/2.x/src/java/org/apache/nutch/host/HostDb.java * /nutch/branches/2.x/src/java/org/apache/nutch/host/HostDbReader.java * /nutch/branches/2.x/src/test/org/apache/nutch/crawl/TestGenerator.java * /nutch/branches/2.x/src/test/org/apache/nutch/crawl/TestInjector.java * /nutch/branches/2.x/src/test/org/apache/nutch/fetcher/TestFetcher.java * /nutch/branches/2.x/src/test/org/apache/nutch/storage/TestGoraStorage.java * /nutch/branches/2.x/src/test/org/apache/nutch/util/AbstractNutchTest.java * /nutch/branches/2.x/src/test/org/apache/nutch/util/CrawlTestUtil.java Upgrade 2.x to Gora 0.3 --- Key: NUTCH-1569 URL: https://issues.apache.org/jira/browse/NUTCH-1569 Project: Nutch Issue Type: Improvement Components: build, storage Affects Versions: 2.2 Reporter: Lewis John McGibbney Assignee: Lewis John McGibbney Fix For: 2.2 Attachments: NUTCH-1569.patch, NUTCH-1569.v2.patch, NUTCH-1569-v3.patch We just released the Maven artifacts and I would like to upgrade before we push the RC for 2.2 :) Patch coming up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1569) Upgrade 2.x to Gora 0.3
[ https://issues.apache.org/jira/browse/NUTCH-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663974#comment-13663974 ] Hudson commented on NUTCH-1569: --- Integrated in Nutch-nutchgora #614 (See [https://builds.apache.org/job/Nutch-nutchgora/614/]) NUTCH-1569 Upgrade 2.x to Gora 0.3 (Revision 1485044) Result = FAILURE lewismc : http://svn.apache.org/viewvc/nutch/branches/2.x/?view=revrev=1485044 Files : * /nutch/branches/2.x/CHANGES.txt * /nutch/branches/2.x/build.xml * /nutch/branches/2.x/ivy/ivy.xml * /nutch/branches/2.x/src/java/org/apache/nutch/api/DbReader.java * /nutch/branches/2.x/src/java/org/apache/nutch/crawl/WebTableReader.java * /nutch/branches/2.x/src/java/org/apache/nutch/host/HostDb.java * /nutch/branches/2.x/src/java/org/apache/nutch/host/HostDbReader.java * /nutch/branches/2.x/src/test/org/apache/nutch/crawl/TestGenerator.java * /nutch/branches/2.x/src/test/org/apache/nutch/crawl/TestInjector.java * /nutch/branches/2.x/src/test/org/apache/nutch/fetcher/TestFetcher.java * /nutch/branches/2.x/src/test/org/apache/nutch/storage/TestGoraStorage.java * /nutch/branches/2.x/src/test/org/apache/nutch/util/AbstractNutchTest.java * /nutch/branches/2.x/src/test/org/apache/nutch/util/CrawlTestUtil.java Upgrade 2.x to Gora 0.3 --- Key: NUTCH-1569 URL: https://issues.apache.org/jira/browse/NUTCH-1569 Project: Nutch Issue Type: Improvement Components: build, storage Affects Versions: 2.2 Reporter: Lewis John McGibbney Assignee: Lewis John McGibbney Fix For: 2.2 Attachments: NUTCH-1569.patch, NUTCH-1569.v2.patch We just released the Maven artifacts and I would like to upgrade before we push the RC for 2.2 :) Patch coming up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1569) Upgrade 2.x to Gora 0.3
[ https://issues.apache.org/jira/browse/NUTCH-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663413#comment-13663413 ] Chris Hairfield commented on NUTCH-1569: I applied your v2 patch an hour ago and, after re-running my crawls, everything looks great. For reference, here's my setup: Nutch 2.x (fully updated to rev. 1484961) + NUTCH-1486-2.x.v2.patch (Upgrade to Solr 4.2.1) HBase 0.90.4 Upgrade 2.x to Gora 0.3 --- Key: NUTCH-1569 URL: https://issues.apache.org/jira/browse/NUTCH-1569 Project: Nutch Issue Type: Improvement Components: build, storage Affects Versions: 2.2 Reporter: Lewis John McGibbney Assignee: Lewis John McGibbney Fix For: 2.2 Attachments: NUTCH-1569.patch, NUTCH-1569.v2.patch We just released the Maven artifacts and I would like to upgrade before we push the RC for 2.2 :) Patch coming up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1569) Upgrade 2.x to Gora 0.3
[ https://issues.apache.org/jira/browse/NUTCH-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663431#comment-13663431 ] Lewis John McGibbney commented on NUTCH-1569: - Dynamite Chris, thanks for the heads up. Upgrade 2.x to Gora 0.3 --- Key: NUTCH-1569 URL: https://issues.apache.org/jira/browse/NUTCH-1569 Project: Nutch Issue Type: Improvement Components: build, storage Affects Versions: 2.2 Reporter: Lewis John McGibbney Assignee: Lewis John McGibbney Fix For: 2.2 Attachments: NUTCH-1569.patch, NUTCH-1569.v2.patch We just released the Maven artifacts and I would like to upgrade before we push the RC for 2.2 :) Patch coming up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1569) Upgrade 2.x to Gora 0.3
[ https://issues.apache.org/jira/browse/NUTCH-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663561#comment-13663561 ] Lewis John McGibbney commented on NUTCH-1569: - I will commit this patch and push the 2.2RC tonight unless there are any objections. Upgrade 2.x to Gora 0.3 --- Key: NUTCH-1569 URL: https://issues.apache.org/jira/browse/NUTCH-1569 Project: Nutch Issue Type: Improvement Components: build, storage Affects Versions: 2.2 Reporter: Lewis John McGibbney Assignee: Lewis John McGibbney Fix For: 2.2 Attachments: NUTCH-1569.patch, NUTCH-1569.v2.patch We just released the Maven artifacts and I would like to upgrade before we push the RC for 2.2 :) Patch coming up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1569) Upgrade 2.x to Gora 0.3
[ https://issues.apache.org/jira/browse/NUTCH-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13662497#comment-13662497 ] Tejas Patil commented on NUTCH-1569: I am running 2.x with this patch since past few hours and so far have not found anything breaking. Crawl is running smooth. Will keep you posted. Upgrade 2.x to Gora 0.3 --- Key: NUTCH-1569 URL: https://issues.apache.org/jira/browse/NUTCH-1569 Project: Nutch Issue Type: Improvement Components: build, storage Affects Versions: 2.2 Reporter: Lewis John McGibbney Assignee: Lewis John McGibbney Fix For: 2.2 Attachments: NUTCH-1569.patch, NUTCH-1569.v2.patch We just released the Maven artifacts and I would like to upgrade before we push the RC for 2.2 :) Patch coming up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1569) Upgrade 2.x to Gora 0.3
[ https://issues.apache.org/jira/browse/NUTCH-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13662540#comment-13662540 ] Tejas Patil commented on NUTCH-1569: Hey Lewis, I took a fresh checkout of 2.x and applied that patch. I am using HBase for storage. About disabling the junits: Is there anything else apart from 'MemStore' that can be used ? If not, then what we are currently should be fine. Upgrade 2.x to Gora 0.3 --- Key: NUTCH-1569 URL: https://issues.apache.org/jira/browse/NUTCH-1569 Project: Nutch Issue Type: Improvement Components: build, storage Affects Versions: 2.2 Reporter: Lewis John McGibbney Assignee: Lewis John McGibbney Fix For: 2.2 Attachments: NUTCH-1569.patch, NUTCH-1569.v2.patch We just released the Maven artifacts and I would like to upgrade before we push the RC for 2.2 :) Patch coming up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1569) Upgrade 2.x to Gora 0.3
[ https://issues.apache.org/jira/browse/NUTCH-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13662548#comment-13662548 ] Lewis John McGibbney commented on NUTCH-1569: - RE: MemStore, I logged a bunch of issues (bugs) which I found out by activating MemStore for the Nutch unit testing. Realistically, we could embed or use any supported backend (with the exception of sql) to do the tests, but in my opinion this is overkill. Such testing should really be done at Gora level (we now have the ball rolling on this one) and here we really only want to know if the Nutch tools are working as we expect. I am +1 for disabling the tests until we fix the MemStore down in Gora. We can then address NUTCH-1572 and re-factor out all of the embedded SQL stuff from our unit tests. Upgrade 2.x to Gora 0.3 --- Key: NUTCH-1569 URL: https://issues.apache.org/jira/browse/NUTCH-1569 Project: Nutch Issue Type: Improvement Components: build, storage Affects Versions: 2.2 Reporter: Lewis John McGibbney Assignee: Lewis John McGibbney Fix For: 2.2 Attachments: NUTCH-1569.patch, NUTCH-1569.v2.patch We just released the Maven artifacts and I would like to upgrade before we push the RC for 2.2 :) Patch coming up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1569) Upgrade 2.x to Gora 0.3
[ https://issues.apache.org/jira/browse/NUTCH-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13662571#comment-13662571 ] Tejas Patil commented on NUTCH-1569: If using some other backend would be an overkill, then lets stick to MemStore. +1 for me too. Upgrade 2.x to Gora 0.3 --- Key: NUTCH-1569 URL: https://issues.apache.org/jira/browse/NUTCH-1569 Project: Nutch Issue Type: Improvement Components: build, storage Affects Versions: 2.2 Reporter: Lewis John McGibbney Assignee: Lewis John McGibbney Fix For: 2.2 Attachments: NUTCH-1569.patch, NUTCH-1569.v2.patch We just released the Maven artifacts and I would like to upgrade before we push the RC for 2.2 :) Patch coming up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (NUTCH-1569) Upgrade 2.x to Gora 0.3
[ https://issues.apache.org/jira/browse/NUTCH-1569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13662588#comment-13662588 ] Lewis John McGibbney commented on NUTCH-1569: - OK thanks Tejas. Lets leave this a while longer with this hope that others can run with the patch and provide input. The Nutch release process is pretty straightforward so committing and just waiting to some more intensive testing at the RC level is also an option? Upgrade 2.x to Gora 0.3 --- Key: NUTCH-1569 URL: https://issues.apache.org/jira/browse/NUTCH-1569 Project: Nutch Issue Type: Improvement Components: build, storage Affects Versions: 2.2 Reporter: Lewis John McGibbney Assignee: Lewis John McGibbney Fix For: 2.2 Attachments: NUTCH-1569.patch, NUTCH-1569.v2.patch We just released the Maven artifacts and I would like to upgrade before we push the RC for 2.2 :) Patch coming up -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
