On Tue, 2018-09-11 at 10:26 -0700, Erick Erickson wrote: > The memory usage is probably MMapDirectory, see: > http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.ht > ml, > that's not a problem I'd guess. We're using NRTCachingDirectoryFactory
> The open file handles... and ones being open many times. > 1> how many _total_ segment files do you have in all the replicas in > the JVM? I counted 542 segments total across all shards (using UI) > 2> Do you have any custom code? It's very easy to open a searcher and > _not_ close it in custom code, which will keep file handles open. We do use ICU plugins which come with solr as contributions, but no custom code. > > 3> Are you using CDCR? And if so, are you buffering? That might keep > tlog files open. Nope, we're not using CDCR > > 4> If you shut down the JVM and restart Solr, do the index files > (segment files and/or TLOGs) disappear? Not sure you can run this > experiment on your system if it's prod, but it'd be some information > to go on, indicating "something" is not closing searchers or the > like. I have test env which (having less load than production) uses RSIZE=35Gb. I can try it right now. /var/db/solr/data$ find . -type f | wc -l 1664 /var/db/solr/data$ sudo service solr restart /var/db/solr/data$ sleep 120 /var/db/solr/data$ find . -type f | wc -l 1586 So..hm. Some segments were merged I guess... The production file count is not much higher though: /var/db/solr/data$ find . -type f | wc -l 3272 > > Best, > Erick > On Tue, Sep 11, 2018 at 10:11 AM Boris Pasko <bpa...@exiger.com> > wrote: > > > > > > > > > > > > Same picture on Solr 6.6.2, tested on various Oracle JVMs ranging > > > from 1.8.0_171 to 1.8.0_171 > > From 1.8.0_171 to 1.8.0_181 > > > > > > ––––––––––––––––––––––––––––––––––––– > > The information contained in this message and any attachments may > > be confidential and/or restricted and protected from disclosure. If > > the reader of this message is not the intended recipient, > > disclosure, copying, use, or distribution of the information > > included in this message is prohibited - please destroy all > > electronic and paper copies and notify the sender immediately. ––––––––––––––––––––––––––––––––––––– The information contained in this message and any attachments may be confidential and/or restricted and protected from disclosure. If the reader of this message is not the intended recipient, disclosure, copying, use, or distribution of the information included in this message is prohibited - please destroy all electronic and paper copies and notify the sender immediately.
