Not really, as I don't know that code well, Uwe and company
are the masters of that realm ;)....

Sorry I can't be more help there....

Erick

On Thu, Nov 24, 2016 at 7:29 AM, Kumaran Ramasubramanian
<kums....@gmail.com> wrote:
> Erick, Thanks a lot for sharing an excellent post...
>
> Btw, am using NIOFSDirectory, could you please elaborate on below mentioned
> lines? or any further pointers?
>
> NIOFSDirectory or SimpleFSDirectory, we have to pay another price: Our code
>> has to do a lot of syscalls to the O/S kernel to copy blocks of data
>> between the disk or filesystem cache and our buffers residing in Java heap.
>> This needs to be done on every search request, over and over again.
>
>
>
>
> --
> Kumaran R
>
>
>
> On Wed, Nov 23, 2016 at 9:17 PM, Erick Erickson <erickerick...@gmail.com>
> wrote:
>
>> see Uwe's blog:
>> http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html
>>
>> Short form: files are read into the OS's memory as needed. the whole
>> file isn't read at once.
>>
>> Best,
>> Erick
>>
>> On Wed, Nov 23, 2016 at 12:04 AM, Kumaran Ramasubramanian
>> <kums....@gmail.com> wrote:
>> > Hi All,
>> >
>> > how do lucene read large index files?
>> > for example, if one file (for eg: .dat file) is 4GB.
>> > lucene read only part of file to RAM? or
>> > is it different approach for different lucene file formats?
>> >
>> >
>> > Related Link:
>> > How do applications (and OS) handle very big files?
>> > http://superuser.com/a/361201
>> >
>> >
>> > --
>> > Kumaran R
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
>> For additional commands, e-mail: java-user-h...@lucene.apache.org
>>
>>

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org

Reply via email to