RE: Solr uses lots of shared memory!

2017-09-04 Thread Markus Jelsma
rd September 2017 17:08 > To: solr-user@lucene.apache.org > Subject: Re: Solr uses lots of shared memory! > > Hi all > Malloc has a lock while it is active in the heap. If there is more than one > thread, and malloc finds the lock in use, then it avoids waiting on the lock >

Re: Solr uses lots of shared memory!

2017-09-03 Thread Rick Leir
-2.24.so >> 0x7fdf5fa0f000 110K/lib/x86_64-linux-gnu/libz.so.1.2.11 >> 0x7fdf5fc2b000 1813K /lib/x86_64-linux-gnu/libc-2.24.so >> 0x00007fdf5fff2000 58K >/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/jli/libjli.so >> 0x7fdf60201000

Re: Solr uses lots of shared memory!

2017-09-02 Thread Kevin Risden
-Original message- >> From:Bernd Fehling <bernd.fehl...@uni-bielefeld.de> >> Sent: Thursday 24th August 2017 15:39 >> To: solr-user@lucene.apache.org >> Subject: Re: Solr uses lots of shared memory! >> >> Just an idea, how about taking a dump with jmap

RE: Solr uses lots of shared memory!

2017-09-01 Thread Markus Jelsma
kus Jelsma <markus.jel...@openindex.io> > Sent: Thursday 24th August 2017 17:20 > To: solr-user@lucene.apache.org > Subject: RE: Solr uses lots of shared memory! > > Hello Bernd, > > According to the man page, i should get a list of stuff in shared memory if i > invok

RE: Solr uses lots of shared memory!

2017-08-24 Thread Markus Jelsma
> > > > NRTCachingDirectoryFactory implies MMapDirectory right? > > > > Thanks, > > Markus > > > > -Original message- > >> From:Shalin Shekhar Mangar <shalinman...@gmail.com> > >> Sent: Thursday 24th August 2017 5:51 &

Re: Solr uses lots of shared memory!

2017-08-24 Thread Bernd Fehling
.directoryFactory:solr.NRTCachingDirectoryFactory}"> > false > > > NRTCachingDirectoryFactory implies MMapDirectory right? > > Thanks, > Markus > > -Original message- >> From:Shalin Shekhar Mangar <shalinman...@gmail.com> >> S

RE: Solr uses lots of shared memory!

2017-08-24 Thread Markus Jelsma
seeing this on their 6.6 cloud production or local machines? > > > > Thanks, > > Markus > > > > [1]: http://www.evanjones.ca/java-bytebuffer-leak.html > > > > -Original message- > >> From:Shawn Heisey <apa...@elyograg.org>

RE: Solr uses lots of shared memory!

2017-08-24 Thread Markus Jelsma
me know what you think. Thanks, Markus -Original message- > From:Erick Erickson <erickerick...@gmail.com> > Sent: Thursday 24th August 2017 3:35 > To: solr-user <solr-user@lucene.apache.org> > Subject: Re: Solr uses lots of shared memory! > > I suspect you

Re: Solr uses lots of shared memory!

2017-08-23 Thread Shalin Shekhar Mangar
e to index size? > Is anyone else seeing this on their 6.6 cloud production or local machines? > > Thanks, > Markus > > [1]: http://www.evanjones.ca/java-bytebuffer-leak.html > > -Original message- >> From:Shawn Heisey <apa...@elyograg.org> >> Sent: Tuesday 2

Re: Solr uses lots of shared memory!

2017-08-23 Thread Erick Erickson
cute few > thousands queries against it? We immediately see a sharp rise in shared > memory, MB's per second until it reaches some sort of plateau. > > -Original message- >> From:Shawn Heisey <apa...@elyograg.org> >> Sent: Wednesday 23rd August 2017 16:37 >> To:

RE: Solr uses lots of shared memory!

2017-08-23 Thread Markus Jelsma
it reaches some sort of plateau. -Original message- > From:Shawn Heisey <apa...@elyograg.org> > Sent: Wednesday 23rd August 2017 16:37 > To: solr-user@lucene.apache.org > Subject: Re: Solr uses lots of shared memory! > > On 8/23/2017 7:32 AM, Markus Jelsma wrote: > > W

Re: Solr uses lots of shared memory!

2017-08-23 Thread Shawn Heisey
On 8/23/2017 7:32 AM, Markus Jelsma wrote: > Why does it slowly increase over time? > Why does it appear to correlate to index size? > Is anyone else seeing this on their 6.6 cloud production or local machines? More detailed information included here.  My 6.6 dev install is NOT having the

RE: Solr uses lots of shared memory!

2017-08-23 Thread Markus Jelsma
Subject: Re: Solr uses lots of shared memory! > > On 8/22/2017 7:24 AM, Markus Jelsma wrote: > > I have never seen this before, one of our collections, all nodes eating > > tons of shared memory! > > > > Here's one of the nodes: > > 10497 solr  20   0 19.439g

Re: Solr uses lots of shared memory!

2017-08-22 Thread Shawn Heisey
On 8/22/2017 7:24 AM, Markus Jelsma wrote: > I have never seen this before, one of our collections, all nodes eating tons > of shared memory! > > Here's one of the nodes: > 10497 solr 20 0 19.439g 4.505g 3.139g S 1.0 57.8 2511:46 java > > RSS is roughly equal to heap size + usual

Solr uses lots of shared memory!

2017-08-22 Thread Markus Jelsma
Hi, I have never seen this before, one of our collections, all nodes eating tons of shared memory! Here's one of the nodes: 10497 solr 20 0 19.439g 4.505g 3.139g S 1.0 57.8 2511:46 java RSS is roughly equal to heap size + usual off-heap space + shared memory. Virtual is equal to