Launching Distributed Searchers with URI indicating filesystem to use rather
than relying on hadoop config files.
-----------------------------------------------------------------------------------------------------------------
Key: NUTCH-638
URL: https://issues.apache.org/jira/browse/NUTCH-638
Project: Nutch
Issue Type: Improvement
Components: searcher
Affects Versions: 1.0.0
Reporter: Aaron Nall
Priority: Minor
I wanted to conduct all index creation operations in hdfs but search from the
local file system using the same cluster of machines. I believe that this is a
common use case.
This required either a parallel nutch install or edits (scripted or manual) to
hadoop-site.xml to change the file system from hdfs to local when starting a
distributed searcher service. This minor patch makes IndexSearcher and
NutchBean honor URIs as supported by hadoop 0.17 without altering existing
functionality if simple paths are entered.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
