Larry,
My best guess is that you would have to modify the
org.apache.hadoop.fs.LocalFileSystem class to use the MMap. Right now
it uses channels which can be extremely fast as well. I don't think
this functionality works right out the box in Nutch. It does look like
it works out of the box in Lucene though. I would take a look at the
lucene javadocs for FSDirectory and MMapDirectory as well as the Nutch
javadocs for FsDirectory and LocalFileSystem. The NIO book from Oreilly
is also a good resource on Memory Mapping in java.
Dennis
Hi Dennis, I have given more consideration to your suggestion and it looks
quite sound, did a search on it on the web but didn't have a great deal of
luck in locating any information on how to actually use it in this situation
(for searching an index), could you perhaps give me a few pointers or
perhaps a link or two with some good documentation on FSDirectory.
Thanks in advance.
Larry
--
View this message in context:
http://www.nabble.com/Swap-with-Nutch-t1434922.html#a3942795
Sent from the Nutch - Dev forum at Nabble.com.
