Hello,
Is there a way I can control the IO bandwidth utilized by Lucene?
Here is my scenario. RAMDirectory is used to build a in-memory index
and finally the index size approaches a limit, the contents are
flushed to a FSDirectory. The index size could be approximately 512
MB. I'm a bit concerne
While not exactly what you are describing, you can use one of the
IndexWriter parameters (maxBufferedDocs) to control the size of the
RAMDirectory that's used as a buffer during indexing.
Otis
--- Gopikrishnan Subramani <[EMAIL PROTECTED]> wrote:
> Hello,
>
> Is there a way I can control the IO
Ok, let me rephrase the question. Assuming the RAMDirectory holds
approximately 500 MB of data which needs to be written to the
filesystem, I'm afraid that sending this much data in one shot might
choke the NFS. Is there a parameter with FSDirectory with which I can
instruct Lucene to restrict the
Hi,
> Ok, let me rephrase the question. Assuming the RAMDirectory holds
> approximately 500 MB of data which needs to be written to the
> filesystem, I'm afraid that sending this much data in one shot might
> choke the NFS. Is there a parameter with FSDirectory with which I can
> instruct Lucene t
I've wanted something similar, for the same purpose -- to keep lucene
from consuming disk I/O resources when another process is running on
the same machine.
A general solution might be to define a simple interface such as
interface IndexInputOutputListener {
void willReadBytes(int numberOfByt
ubject: Re: IO bandwidth throttling
I've wanted something similar, for the same purpose -- to keep lucene
from consuming disk I/O resources when another process is running on
the same machine.
A general solution might be to define a simple interface such as
interface IndexInputOutputList
Hi Ben,
Yes -- I would prefer to let the OS handle his, especially if it can
save me some coding. Is there is a way (under linux) to limit a
certain process's disk utilization? It seems like nice(1) just
modifies the scheduling priority, I'm assuming this means CPU
scheduling. In my case, I'm t
Try this: (CFQ) I/O scheduler
http://lwn.net/Articles/57732/
Rajesh Munavalli
> -Original Message-
> From: Chris Lamprecht [mailto:[EMAIL PROTECTED]
> Sent: Thursday, September 01, 2005 4:00 PM
> To: java-user@lucene.apache.org
> Subject: Re: IO bandwidth throttl
Chris Lamprecht wrote:
> I've wanted something similar, for the same purpose -- to keep lucene
> from consuming disk I/O resources when another process is running on
> the same machine.
Sorry for jumping in (I'm a Lucene newb) but isn't this better handled
by the OS? On a Unix box I would just ren
Ben Gollmer wrote:
>Chris Lamprecht wrote:
>
>
>>I've wanted something similar, for the same purpose -- to keep lucene
>>from consuming disk I/O resources when another process is running on
>>the same machine.
>>
>>
>
>Sorry for jumping in (I'm a Lucene newb) but isn't this better handled
>
Rajesh Munavalli wrote:
> Try this: (CFQ) I/O scheduler
> http://lwn.net/Articles/57732/
>
> Rajesh Munavalli
>
The CFQ scheduler is the default in Red Hat Enterprise 4 and recent
Fedoras (3 and 4 IIRC). My FC4 system is usable even with processes like
'updatedb' running.
http://www.redhat.com
11 matches
Mail list logo
