Re: Pressed optimize and now SOLR is not indexing while optimize is going on

Hello Shawn, I'm sorry to diverge this thread a little bit. But could please point me to resources that explain deeply how this process of OS using the non-java memory to cache index data? > Whatever RAM is left over after you give 12GB to Java for Solr will be > used automatically by the

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

On Wed, 2015-10-07 at 07:03 -0300, Eric Torti wrote: > I'm sorry to diverge this thread a little bit. But could please point me to > resources that explain deeply how this process of OS using the non-java > memory to cache index data?

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

On 10/7/2015 4:03 AM, Eric Torti wrote: > I'm sorry to diverge this thread a little bit. But could please point me to > resources that explain deeply how this process of OS using the non-java > memory to cache index data? > >> Whatever RAM is left over after you give 12GB to Java for Solr will be

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

Thanks from my end too. And thanks for the question Eric that added a lot to my understanding as well. Regards. Sid. On Wed, Oct 7, 2015 at 10:04 AM, Eric Torti wrote: > Cool, Toke and Shawn! > > That's exactly what I was looking for. I'll have a look at those resources >

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

Cool, Toke and Shawn! That's exactly what I was looking for. I'll have a look at those resources and if something is yet unclear I'll open a thread for it. Thanks for the information, Eric On Wed, Oct 7, 2015 at 10:29 AM, Shawn Heisey wrote: > On 10/7/2015 4:03 AM, Eric

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

Unix has a “buffer cache”, often called a file cache. This chapter discusses the Linux buffer cache, which is very similar to other Unix implementations. Essentially, all unused RAM is used to make disk access faster. http://www.tldp.org/LDP/sag/html/buffer-cache.html

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

Nice. Will port it onto an SSD. A have a few questions about optimize. Is the search index fully searchable after a commit? How much time does one have to wait in case of a hard commit for the index to be available? I have an index of 180G. Do I need to hit the optimize on this chunk. This is

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

On 10/6/2015 8:18 AM, Siddhartha Singh Sandhu wrote: > A have a few questions about optimize. Is the search index fully searchable > after a commit? If openSearcher is true on the commit, then changes to the index (additions, replacements, deletions) will be visible when the commit completes. >

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

Thank you for helping out. Further inquiry: I am committing records to my solr implementation and they are not getting showing up in my search. I am search on the default id. Is this related to the fact that I dont have enough memory so my SOLR is taking a lot of time to actually making the

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

On Mon, 2015-10-05 at 17:26 -0400, Siddhartha Singh Sandhu wrote: > Following up on that: Would having an SSD make considerable difference in > speed? Yes, but only to a point. The UK Web Archive has done some tests on optimizing indexes on both spinning drives and SSDs:

Pressed optimize and now SOLR is not indexing while optimize is going on

Hi, I pressed the optimize switch. Wasn't the best decision I made today. The aftermath of it was that when I tried to index more documents the curl just waited and waited. I pinged my SOLR and all is well. I am able to access the admin console also. I can query the SOLR machine too. But, I

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

I restarted my SOLR and it is now not reloading the configuration. Is my solr index corrupted? Sid. On Mon, Oct 5, 2015 at 5:09 PM, Erick Erickson wrote: > You should be able to insert while optimizing. Do be aware that > optimize will probably require that your disk

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

Thank you Eric. I think your explanation was the reason. Following up on that: Would having an SSD make considerable difference in speed? On Mon, Oct 5, 2015 at 5:18 PM, Siddhartha Singh Sandhu < sandhus...@gmail.com> wrote: > Scrap the last one. It just took 10 mins to load. I panicked too

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

You should be able to insert while optimizing. Do be aware that optimize will probably require that your disk have free _at least_ as much space as the index takes up. It may just be that the disk is so busy with the optimize (it's mostly just writing from one file to another) that it's appearing

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

Scrap the last one. It just took 10 mins to load. I panicked too quick. On Mon, Oct 5, 2015 at 5:15 PM, Siddhartha Singh Sandhu < sandhus...@gmail.com> wrote: > I restarted my SOLR and it is now not reloading the configuration. > Is my solr index corrupted? > > Sid. > > On Mon, Oct 5, 2015 at

Re: Pressed optimize and now SOLR is not indexing while optimize is going on

bq: Would having an SSD make considerable difference in speed Almost certainly. Optimize is rarely necessary, especially if you're indexing relatively constantly so just avoiding that might do the trick ;). But reloading shouldn't be taking 10 minutes. Before 5.2, if you had suggesters