That would be cool, I think we should probably also push for HSDF-347 while we are at it as well. The situation for HDFS improvements has not been good, but might improve in the mid-future.
Thanks for the pointer! -ryan On Wed, Feb 16, 2011 at 11:40 AM, Jason Rutherglen <[email protected]> wrote: >> One of my coworker is reminding me that major compactions do have the >> well know side effect of slowing down a busy system. > > I think where this is going is the system IO cache problem could be > solved with something like DirectIOLinuxDirectory: > https://issues.apache.org/jira/browse/LUCENE-2500 Of course the issue > would be integrating DIOLD or it's underlying native implementation > into HDFS somehow? >
