Re: Out of memory errors with Spatial indexing

2020-07-06 Thread David Smiley
I believe you are experiencing this bug: LUCENE-5056 The fix would probably be adjusting code in here org.apache.lucene.spatial.query.SpatialArgs#calcDistanceFromErrPct ~ David Smiley Apache Lucene/Solr Search Developer http://www.linkedin.com/in

Re: Out of memory errors with Spatial indexing

2020-07-06 Thread Sunil Varma
Hi David Thanks for your response. Yes, I noticed that all the data causing issue were at the poles. I tried the "RptWithGeometrySpatialField" field type definition but get a "Spatial context does not support S2 spatial index"error. Setting "spatialContextFactory="Geo3D" I still see the original OO

Re: Out of memory errors with Spatial indexing

2020-07-03 Thread David Smiley
Hi Sunil, Your shape is at a pole, and I'm aware of a bug causing an exponential explosion of needed grid squares when you have polygons super-close to the pole. Might you try S2PrefixTree instead? I forget if this would fix it or not by itself. For indexing non-point data, I recommend class="s

Out of memory errors with Spatial indexing

2020-07-03 Thread Sunil Varma
We are seeing OOM errors when trying to index some spatial data. I believe the data itself might not be valid but it shouldn't cause the Server to crash. We see this on both Solr 7.6 and Solr 8. Below is the input that is causing the error. { "id": "bad_data_1", "spatialwkt_srpt": "LINESTRING (-1

Re: FuzzyQuery causing Out of Memory Errors in 8.5.x

2020-04-23 Thread Colvin Cowie
https://issues.apache.org/jira/browse/SOLR-14428 On Thu, 23 Apr 2020 at 08:45, Colvin Cowie wrote: > I created a little test that fires off fuzzy queries from random UUID > strings for 5 minutes > *FIELD_NAME + ":" + UUID.randomUUID().toString().replace("-", "") + "~2"* > > The change in heap

Re: FuzzyQuery causing Out of Memory Errors in 8.5.x

2020-04-23 Thread Colvin Cowie
I created a little test that fires off fuzzy queries from random UUID strings for 5 minutes *FIELD_NAME + ":" + UUID.randomUUID().toString().replace("-", "") + "~2"* The change in heap usage is really severe. On 8.5.1 Solr went OOM almost immediately on a 512mb heap, and with a 4GB heap it only j

FuzzyQuery causing Out of Memory Errors in 8.5.x

2020-04-22 Thread Colvin Cowie
Hello, I'm moving our product from 8.3.1 to 8.5.1 in dev and we've got tests failing because Solr is getting OOMEs with a 512mb heap where it was previously fine. I ran our tests on both versions with jconsole to track the heap usage. Here's a little comparison. 8.5.1 dies part way through https:

Re: Out of Memory Errors

2017-06-14 Thread Susheel Kumar
eel Kumar > wrote: > >> You may have gc logs saved when OOM happened. Can you draw it in GC Viewer >> or so and share. >> >> Thnx >> >> On Wed, Jun 14, 2017 at 11:26 AM, Satya Marivada < >> satya.chaita...@gmail.com> >> wrote: >> >&g

Re: Out of Memory Errors

2017-06-14 Thread Satya Marivada
AM, Satya Marivada < > satya.chaita...@gmail.com> > wrote: > > > Hi, > > > > I am getting Out of Memory Errors after a while on solr-6.3.0. > > The > -XX:OnOutOfMemoryError=/sanfs/mnt/vol01/solr/solr-6.3.0/bin/oom_solr.sh > > just kills the jvm right af

Re: Out of Memory Errors

2017-06-14 Thread Susheel Kumar
You may have gc logs saved when OOM happened. Can you draw it in GC Viewer or so and share. Thnx On Wed, Jun 14, 2017 at 11:26 AM, Satya Marivada wrote: > Hi, > > I am getting Out of Memory Errors after a while on solr-6.3.0. > The -XX:OnOutOfMemoryError=/sanfs/mnt/vol01/solr/so

Out of Memory Errors

2017-06-14 Thread Satya Marivada
Hi, I am getting Out of Memory Errors after a while on solr-6.3.0. The -XX:OnOutOfMemoryError=/sanfs/mnt/vol01/solr/solr-6.3.0/bin/oom_solr.sh just kills the jvm right after. Using Jconsole, I see the nice triangle pattern, where it uses the heap and being reclaimed back. The heap size is set at

Re: Detect Out of Memory Errors

2011-02-04 Thread Otis Gospodnetic
/ - Original Message > From: saureen > To: solr-user@lucene.apache.org > Sent: Thu, January 27, 2011 9:41:56 AM > Subject: Detect Out of Memory Errors > > > Hi, > > is ther a way by which i could detect the out of memory errors in solr so > that i coul

Detect Out of Memory Errors

2011-01-27 Thread saureen
Hi, is ther a way by which i could detect the out of memory errors in solr so that i could implement some functionality such as restarting the tomcat or alert me via email whenever such error is detected.? -- View this message in context: http://lucene.472066.n3.nabble.com/Detect-Out-of-Memory

Re: Out of Memory Errors

2008-10-22 Thread Jae Joo
AIL PROTECTED]>wrote: > Hello, > > I've been having issues with out of memory errors on searches in Solr. I > was wondering if I'm hitting a limit with solr or if I've configured > something seriously wrong. > > Solr Setup > - 3 cores > - 3163615 do

Re: Out of Memory Errors

2008-10-22 Thread Otis Gospodnetic
14 PM > Subject: Out of Memory Errors > > Hello, > > I've been having issues with out of memory errors on searches in Solr. I > was wondering if I'm hitting a limit with solr or if I've configured > something seriously wrong. > > Solr Setup > - 3 core

RE: Out of Memory Errors

2008-10-22 Thread r.prieto
. -Mensaje original- De: Willie Wong [mailto:[EMAIL PROTECTED] Enviado el: miƩrcoles, 22 de octubre de 2008 3:48 Para: solr-user@lucene.apache.org Asunto: Out of Memory Errors Hello, I've been having issues with out of memory errors on searches in Solr. I was wondering if I'm hitti

Re: Out of Memory Errors

2008-10-22 Thread Nick Jenkin
Wong wrote: >> >> Hello, >> >> I've been having issues with out of memory errors on searches in Solr. I >> was wondering if I'm hitting a limit with solr or if I've configured >> something seriously wrong. >> >> Solr Setup >> - 3 c

Re: Out of Memory Errors

2008-10-21 Thread Mark Miller
How much RAM in the box total? How many sort fields and what types? Sorts on each core? Willie Wong wrote: Hello, I've been having issues with out of memory errors on searches in Solr. I was wondering if I'm hitting a limit with solr or if I've configured something seriousl

Out of Memory Errors

2008-10-21 Thread Willie Wong
Hello, I've been having issues with out of memory errors on searches in Solr. I was wondering if I'm hitting a limit with solr or if I've configured something seriously wrong. Solr Setup - 3 cores - 3163615 documents each - 10 GB size - approx 10 fields - document sizes vary f