Not really, as I don't know that code well, Uwe and company are the masters of that realm ;)....
Sorry I can't be more help there.... Erick On Thu, Nov 24, 2016 at 7:29 AM, Kumaran Ramasubramanian <[email protected]> wrote: > Erick, Thanks a lot for sharing an excellent post... > > Btw, am using NIOFSDirectory, could you please elaborate on below mentioned > lines? or any further pointers? > > NIOFSDirectory or SimpleFSDirectory, we have to pay another price: Our code >> has to do a lot of syscalls to the O/S kernel to copy blocks of data >> between the disk or filesystem cache and our buffers residing in Java heap. >> This needs to be done on every search request, over and over again. > > > > > -- > Kumaran R > > > > On Wed, Nov 23, 2016 at 9:17 PM, Erick Erickson <[email protected]> > wrote: > >> see Uwe's blog: >> http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html >> >> Short form: files are read into the OS's memory as needed. the whole >> file isn't read at once. >> >> Best, >> Erick >> >> On Wed, Nov 23, 2016 at 12:04 AM, Kumaran Ramasubramanian >> <[email protected]> wrote: >> > Hi All, >> > >> > how do lucene read large index files? >> > for example, if one file (for eg: .dat file) is 4GB. >> > lucene read only part of file to RAM? or >> > is it different approach for different lucene file formats? >> > >> > >> > Related Link: >> > How do applications (and OS) handle very big files? >> > http://superuser.com/a/361201 >> > >> > >> > -- >> > Kumaran R >> >> --------------------------------------------------------------------- >> To unsubscribe, e-mail: [email protected] >> For additional commands, e-mail: [email protected] >> >> --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
