[ https://issues.apache.org/jira/browse/LUCENE-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13683596#comment-13683596 ]
Hal Deadman commented on LUCENE-5056: ------------------------------------- This might not be the same issue, but we have a small rectangle that uses a really large amount of memory: POLYGON((1.025 1.025, 1.025 1.101, 1.101 1.101, 1.101 1.025, 1.025 1.025)) If we change it just a little we don't get out of memory errors: POLYGON((1.025001 1.025, 1.025 1.101, 1.101 1.101, 1.101 1.025, 1.025001 1.025)) > Indexing non-point shapes close to the poles doesn't scale > ---------------------------------------------------------- > > Key: LUCENE-5056 > URL: https://issues.apache.org/jira/browse/LUCENE-5056 > Project: Lucene - Core > Issue Type: Bug > Components: modules/spatial > Affects Versions: 4.3 > Reporter: Hal Deadman > Attachments: indexed circle close to the pole.png > > > From: [~hdeadman] > We are seeing an issue where certain shapes are causing Solr to use up all > available heap space when a record with one of those shapes is indexed. We > were indexing polygons where we had the points going clockwise instead of > counter-clockwise and the shape would be so large that we would run out of > memory. We fixed those shapes but we are seeing this circle eat up about > 700MB of memory before we get an OutOfMemory error (heap space) with a 1GB > JVM heap. > Circle(3.0 90 d=0.0499542757922153) > Google Earth can't plot that circle either, maybe it is invalid or too close > to the north pole due to the latitude of 90, but it would be nice if there > was a way for shapes to be validated before they cause an OOM error. > The objects (4.5 million) are all GeohashPrefixTree$GhCell objects in an > ArrayList owned by PrefixTreeStrategy$CellTokenStream. > Is there anyway to have a max number of cells in a shape before it is > considered too large and is not indexed? Is there a geo library that could > validate the shape as being reasonably sized and bounded before it is > processed? > We are currently using Solr 4.1. > <fieldType name="location_rpt" > class="solr.SpatialRecursivePrefixTreeFieldType" > spatialContextFactory="com.spatial4j.core.context.jts.JtsSpatialContextFactory" > geo="true" distErrPct="0.025" maxDistErr="0.000009" units="degrees" /> -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org