Distributing index over N disks

2009-11-24 Thread Otis Gospodnetic
Hello, Would it make sense and be possible to spread different index files over multiple disks (without resorting to putting an index on a RAID)? For example, what if the index files didn't live in a single index dir, but were organized by their type in a snallow dir tree, like this: /path/to/i

RE: Distributing index over N disks

2009-11-24 Thread Uwe Schindler
gt; To: java-dev@lucene.apache.org > Subject: Distributing index over N disks > > Hello, > > Would it make sense and be possible to spread different index files over > multiple disks (without resorting to putting an index on a RAID)? > For example, what if the index files

Re: Distributing index over N disks

2009-11-25 Thread Michael McCandless
I think this is a good idea, for indexes that can't fit in IO cache. Report back if you get good results :) I think FSD opens up all sorts of interesting possibilities. Mike On Tue, Nov 24, 2009 at 5:31 PM, Otis Gospodnetic wrote: > Hello, > > Would it make sense and be possible to spread diffe

Re: Distributing index over N disks

2009-11-25 Thread Andrzej Bialecki
Uwe Schindler wrote: It is technically doable since 2.9 with FileSwitchDirectory, where you can define file name endings as a filter to which underlying directory the requests go, see http://lucene.apache.org/java/2_9_1/api/core/org/apache/lucene/store/FileSwi tchDirectory.html To have more dire