[ https://issues.apache.org/jira/browse/NUTCH-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris A. Mattmann updated NUTCH-1844: ------------------------------------- Description: While working on NUTCH-1526 in Review Board https://reviews.apache.org/r/9119/ [~lewismc] tried to test out the ./bin/nutch dump tool on src/testresources/testcrawl and found that it failed due to an old o.a.h.io.UTF8 key type (instead of the o.a.h.io.Text) type. I looked into this - how were Nutch tests passing using this old code? I found that Andrzej a long time ago wrote a tool to update the index from the old UFT8 key format to Text - I also found that *no where in the Nutch code* is the testcrawl referenced. My suggestion: * we remove the testcrawl (it's not used) * if we don't remove it, we at least run Andrzej's tool on it and then upgrade it to use o.a.h.io.Text keys. I'll take care of this. was: While working on NUTCH-1526 in Review Board http://reviews.apache.org/r9119/ [~lewismc] tried to test out the ./bin/nutch dump tool on src/testresources/testcrawl and found that it failed due to an old o.a.h.io.UTF8 key type (instead of the o.a.h.io.Text) type. I looked into this - how were Nutch tests passing using this old code? I found that Andrzej a long time ago wrote a tool to update the index from the old UFT8 key format to Text - I also found that *no where in the Nutch code* is the testcrawl referenced. My suggestion: * we remove the testcrawl (it's not used) * if we don't remove it, we at least run Andrzej's tool on it and then upgrade it to use o.a.h.io.Text keys. I'll take care of this. > testresources/testcrawl not referenced anywhere in code. > -------------------------------------------------------- > > Key: NUTCH-1844 > URL: https://issues.apache.org/jira/browse/NUTCH-1844 > Project: Nutch > Issue Type: Bug > Components: test > Reporter: Chris A. Mattmann > Assignee: Chris A. Mattmann > Fix For: 1.10 > > > While working on NUTCH-1526 in Review Board > https://reviews.apache.org/r/9119/ [~lewismc] tried to test out the > ./bin/nutch dump tool on src/testresources/testcrawl and found that it failed > due to an old o.a.h.io.UTF8 key type (instead of the o.a.h.io.Text) type. > I looked into this - how were Nutch tests passing using this old code? I > found that Andrzej a long time ago wrote a tool to update the index from the > old UFT8 key format to Text - I also found that *no where in the Nutch code* > is the testcrawl referenced. > My suggestion: > * we remove the testcrawl (it's not used) > * if we don't remove it, we at least run Andrzej's tool on it and then > upgrade it to use o.a.h.io.Text keys. > I'll take care of this. -- This message was sent by Atlassian JIRA (v6.3.4#6332)