Re: Queries to help warm up (mmap)

2016-10-06 Thread Pushkar Raste
One of the tricks I had read somewhere was to cat all files in the index directory and OS will have file in the disk cache. On Thu, Oct 6, 2016 at 11:55 AM, Rallavagu wrote: > Looking for clues/recommendations to help warm up during startup. Not > necessarily Solr caches but mmap as w

Re: Queries to help warm up (mmap)

2016-10-06 Thread Walter Underwood
log analysis. Use your most frequent queries. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Oct 6, 2016, at 8:55 AM, Rallavagu wrote: > > Looking for clues/recommendations to help warm up during startup. Not > necessarily Solr caches

Queries to help warm up (mmap)

2016-10-06 Thread Rallavagu
Looking for clues/recommendations to help warm up during startup. Not necessarily Solr caches but mmap as well. I have used some like "q=:[* TO *]" for various fields and it seems to help with mmap population around 40-50%. Is there anything else that could help achieve 90% or more? Thanks.

Re: Does MMap works on the Virtual Box?

2013-08-16 Thread Paul Masurel
Hi, You can MMAP a size bigger than your memory without having any problem. Part of your file will just not be loaded into RAM, because you don't access it too often. If you are short in memory, consider deactivating page Host IO Caching, as it will be only redundant with your guest OS

Re: Does MMap works on the Virtual Box?

2013-08-16 Thread Shawn Heisey
On 8/16/2013 1:02 PM, vibhoreng04 wrote: I have a big index of 256 GB .Right now it is on one physical box of 256 GB RAM . I am planning to virtualize it to the size of 32 GB Ram*8 boxes.Whether the MMap will work regardless in this condition ? As far as MMap goes, if the operating system you

Does MMap works on the Virtual Box?

2013-08-16 Thread vibhoreng04
Hi All, I have a big index of 256 GB .Right now it is on one physical box of 256 GB RAM . I am planning to virtualize it to the size of 32 GB Ram*8 boxes.Whether the MMap will work regardless in this condition ? Vibhor Jaiswal -- View this message in context: http://lucene.472066.n3

Re: Why solr 4.0 use FSIndexOutput to write file, otherwise MMap/NIO

2013-06-28 Thread Michael McCandless
og.mikemccandless.com On Fri, Jun 28, 2013 at 2:23 AM, Jeffery Wang wrote: > > I have checked the FSDirectory, it will create "MMapDirectory" or > "NIOFSDirectory" for Directory. > This two directory only supply IndexInput extend for read file > (MMapIndexInpu

Why solr 4.0 use FSIndexOutput to write file, otherwise MMap/NIO

2013-06-27 Thread Jeffery Wang
I have checked the FSDirectory, it will create "MMapDirectory" or "NIOFSDirectory" for Directory. This two directory only supply IndexInput extend for read file (MMapIndexInput extends ByteBufferIndexInput), why not there is not MMap/NIO IndexOutput extend for fil

Re: Mmap

2012-07-16 Thread William Bell
> http://www.appinions.com > > > On Mon, Jul 16, 2012 at 9:32 PM, Bill Bell wrote: >> Any thought on this? Is the default Mmap? >> >> >> >> Sent from my mobile device >> 720-256-8076 >> >> On Feb 14, 2012, at 7:16 AM, Bill Bell wrote: &

Re: Mmap

2012-07-16 Thread Michael Della Bitta
Appinions, Inc. -- Where Influence Isn’t a Game. http://www.appinions.com On Mon, Jul 16, 2012 at 9:32 PM, Bill Bell wrote: > Any thought on this? Is the default Mmap? > > > > Sent from my mobile device > 720-256-8076 > > On Feb 14, 2012, at 7:16 AM, Bill Bell wrote: &

Re: Mmap

2012-07-16 Thread Bill Bell
Any thought on this? Is the default Mmap? Sent from my mobile device 720-256-8076 On Feb 14, 2012, at 7:16 AM, Bill Bell wrote: > Does someone have an example of using unmap in 3.5 and chunksize? > > I am using Solr 3.5. > > I noticed in solrconfig.x

Mmap

2012-02-14 Thread Bill Bell
Does someone have an example of using unmap in 3.5 and chunksize? I am using Solr 3.5. I noticed in solrconfig.xml: I don't see this parameter taking.. When I set -Dsolr.directoryFactory=solr.MMapDirectoryFactory How do I see the setting in the log or in stats.jsp ? I cannot find a place t

Re: Fwd: Lucene MMAP Usage with Solr

2009-11-13 Thread Lance Norskog
gt; > - Original Message >> From: ST ST >> To: solr-user@lucene.apache.org >> Sent: Fri, November 13, 2009 6:03:57 PM >> Subject: Fwd: Lucene MMAP Usage with Solr >> >> Folks, >> >> I am trying to get Lucene MMAP to work in solr. >> >> I a

Re: Fwd: Lucene MMAP Usage with Solr

2009-11-13 Thread Otis Gospodnetic
er 13, 2009 6:03:57 PM > Subject: Fwd: Lucene MMAP Usage with Solr > > Folks, > > I am trying to get Lucene MMAP to work in solr. > > I am assuming that when I configure MMAP the entire index will be loaded > into RAM. > Is that the right assumption ? > > I have

Fwd: Lucene MMAP Usage with Solr

2009-11-13 Thread ST ST
Folks, I am trying to get Lucene MMAP to work in solr. I am assuming that when I configure MMAP the entire index will be loaded into RAM. Is that the right assumption ? I have tried the following ways for using MMAP: Option 1. Using the solr config below for MMAP configuration

Re: Set MMap in Solr

2009-11-05 Thread ba ba
R, IR > > > > - Original Message > > From: ba ba > > To: solr-user@lucene.apache.org > > Sent: Thu, November 5, 2009 2:55:42 PM > > Subject: Set MMap in Solr > > > > Hi, > > > > I'm trying to set my default director

Re: Set MMap in Solr

2009-11-05 Thread Otis Gospodnetic
2009 2:55:42 PM > Subject: Set MMap in Solr > > Hi, > > I'm trying to set my default directory to MMap. I saw that this is done by > specifying here > > A DirectoryProvider plugin can be configured in solrconfig.xml with the > following XML: > > > >

Set MMap in Solr

2009-11-05 Thread ba ba
Hi, I'm trying to set my default directory to MMap. I saw that this is done by specifying here A DirectoryProvider plugin can be configured in solrconfig.xml with the following XML: in solrconfig.xml. This did not work for me when I put in the MMapDirectory class name. I got