[ https://issues.apache.org/jira/browse/HDFS-516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12755121#action_12755121 ]
Todd Lipcon commented on HDFS-516: ---------------------------------- Jay: that sounds good to me. Let's explicitly mark the API as "Experimental" and "Likely to disappear in a future release with little or no warning - use at your own risk" :) I think especially as security and authentication begin to take form in the next couple months it will be a headache to try to maintain this code. If branching in SVN weren't such a pain, I'd suggest we maintain this in a separate branch that didn't go into releases... c'est la vie ;-) > Low Latency distributed reads > ----------------------------- > > Key: HDFS-516 > URL: https://issues.apache.org/jira/browse/HDFS-516 > Project: Hadoop HDFS > Issue Type: New Feature > Reporter: Jay Booth > Priority: Minor > Attachments: hdfs-516-20090912.patch > > Original Estimate: 168h > Remaining Estimate: 168h > > I created a method for low latency random reads using NIO on the server side > and simulated OS paging with LRU caching and lookahead on the client side. > Some applications could include lucene searching (term->doc and doc->offset > mappings are likely to be in local cache, thus much faster than nutch's > current FsDirectory impl and binary search through record files (bytes at > 1/2, 1/4, 1/8 marks are likely to be cached) -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.