[
https://issues.apache.org/jira/browse/SOLR-6306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14082447#comment-14082447
]
Brett Hoerner commented on SOLR-6306:
-------------------------------------
Robert, I was afraid of that, but it's reasonable. :)
I'm not sure on exact svn rev, but it was built with branch_4x as of that day
(6-16), which to me means something must have "fixed" the issue in here (6-16
up to 4.9 release, from git):
{code}
* 36c54b1 - (tag: lucene_solr_4_9_0) tag 4.9 Robert Muir (5 weeks ago)
* bfcb37f - SOLR-6182: correctly cast managedData as a List<Object> when
loading stored RestManager data; solution verified with manual testing only as
the unit tests use in-memory storage so will need to re-work the backing store
to test this behavior in the unit test; backport to 4.9 branch Timothy Potter
(6 weeks a
* c733b8e - LUCENE-5767: remove bogus cast (in this case can exceed
Integer.MAX_VALUE, and the underlying delta reader takes long anyway) Robert
Muir (6 weeks ago)
* f7c3fd8 - fix off-by-one in checkBufferSize, it must be >= 8 Robert Muir (6
weeks ago)
* fb7c50f - svn:eol-style Robert Muir (6 weeks ago)
* 22fb394 - LUCENE-5777: fix double escaping of dash in hunspell conditions
Robert Muir (6 weeks ago)
* f19581a - LUCENE-5773: Fix ram usage estimation on PositiveIntOutputs. Adrien
Grand (6 weeks ago)
* c88eb15 - SOLR-6161: Walk the entire cause chain looking for an Error shalin
Shekhar Mangar (6 weeks ago)
* 1143ff5 - LUCENE-5773: Test SegmentReader.ramBytesUsed. Adrien Grand (6 weeks
ago)
* 7d625d2 - SOLR-6128: Removed deprecated analysis factories and fieldTypes
from the example schema.xml (merge r1603644 via r1603649) Chris M. Hostetter (6
weeks ago)
* fc53ee8 - SOLR-6064: Return DebugComponent track output as JSON object Alan
Woodward (6 weeks ago)
* 71fae50 - SOLR-6125: Allow SolrIndexWriter to close without waiting for
merges Alan Woodward (6 weeks ago)
* f2b8c78 - LUCENE-5775: Deprecate JaspellLookup; fix its ramBytesUsed to not
StackOverflow Michael McCandless (6 weeks ago)
* 5894d26 - LUCENE-5772: implement getSortedNumericDocValues in
SortingAtomicReader Shai Erera (6 weeks ago)
* 2d0042b - SOLR-6160: bugfix when facet query or range with group facets and
distributed David Wayne Smiley (6 weeks ago)
* dfedf04 - SOLR-6164: Copy Fields Schema additions are not distributed to
other nodes (merged trunk r1603300 and r1603301) Steven Rowe (6 weeks ago)
* 2d811ac - SOLR-6175: Merged test fixes from branch_4x shalin Shekhar Mangar
(6 weeks ago)
* 8c6fc93 - LUCENE-5761: upgrade note for solr (merge r1603227) Chris M.
Hostetter (6 weeks ago)
* 3bee1c3 - branch for 4.9 Robert Muir (6 weeks ago)
* 8d9a5f5 - SOLR-6129: DateFormatTransformer doesn't resolve dateTimeFormat
shalin Shekhar Mangar (6 weeks ago)
* aff7dc9 - SOLR-6175: DebugComponent throws NPE on shard exceptions when using
shards.tolerant shalin Shekhar Mangar (6 weeks ago)
* 973ed13 - LUCENE-5769: SingletonSortedSetDocValues now supports random access
ordinals Robert Muir (7 weeks ago)
* 2fa15c3 - Remove javadoc @see tag. I can't manage to make it work with
precommit. Adrien Grand (7 weeks ago)
* 95c697a - LUCENE-5768: hunspell condition checks with character classes were
buggy Robert Muir (7 weeks ago)
* 3acb593 - LUCENE-5767: OrdinalMap optimizations. Adrien Grand (7 weeks ago)
* 059a7b5 - SOLR-6015: Backport fixes from trunk to branch_4x. Timothy Potter
(7 weeks ago)
* de203d5 - LUCENE-5765: Add tests to OrdinalMap.ramBytesUsed. Adrien Grand (7
weeks ago)
* 5fc0871 - LUCENE-5764: Add tests to DocIdSet.ramBytesUsed. Adrien Grand (7
weeks ago)
* 9e0e17e - LUCENE-5759: Add PackedInts.unsignedBitsRequired. Adrien Grand (7
weeks ago)
* 51924f0 - LUCENE-5761: Remove DiskDocValuesFormat Robert Muir (7 weeks ago)
* 171ae5a - SOLR-6151: Intermittent TestReplicationHandlerBackup failures.
Dawid Weiss (7 weeks ago)
* 9ad403f - LUCENE-5762: Disable old codecs as much as possible Robert Muir (7
weeks ago)
{code}
> Problem using Solr 4.9 index with 4.10 build (merge failures with DocValues?)
> -----------------------------------------------------------------------------
>
> Key: SOLR-6306
> URL: https://issues.apache.org/jira/browse/SOLR-6306
> Project: Solr
> Issue Type: Bug
> Affects Versions: 4.10
> Reporter: Brett Hoerner
>
> I have a SolrCloud cluster that has been running 4.9, I tried a 4.10 build as
> a test and our indexing slowed to a crawl. I noticed the number of segments
> (typically under 25) was up to 75 and climbing. In the logs it seems like
> merges were failing with the following.
> Happy to provide any other info as needed.
> {code}
> 15:06:24.624 [qtp1728790703-1634] ERROR o.a.solr.servlet.SolrDispatchFilter -
> null:java.io.IOException: background merge hit exception:
> _9n6s(4.9):C14802716/827586:delGen=97 _9nbh(4.9):C2903594/263527:delGen=100
> _9no8(4.9):C2190621/20968:delGen=58 _9nak(4.9):C712244/78919:delGen=100
> _9nfr(4.9):C686466/84576:delGen=97
> _9ngy(4.9):C679031/90147:delGen=96 _9ncx(4.9):C641773/81866:delGen=99
> _9nht(4.9):C415750/68337:delGen=94 _9mvj(4.9):C338961/39283:delGen=110
> _9nje(4.9):C215123/41594:delGen=87 _9nmn(4.9):C156084/40673:delGen=69
> _9nsk(4.9):C60958/7357:delGen=21 _9nka(4.9):C69625/22375:delGen=83
> _9nrl(4.9):C27522/4326:delGen=31 _9nqr(4.
> 9):C27216/7540:delGen=39 _9nqm(4.9):C24252/5597:delGen=40
> _9nto(4.9):C10324/1882:delGen=10 _9ntx(4.9):C9581/1218:delGen=8
> _9nts(4.9):C9731/1619:delGen=9 _9nv1(4.10):C3425
> _9ntz(4.9):C1437/919:delGen=8 _9nu7(4.10):C1130/697:delGen=5
> _9nuw(4.10):C611/218:delGen=2 _9nun(4.10):C625/308:delGen=3
> _9nug(4.10):C828/489:delGen
> =4 into _9nv2 [maxNumSegments=1]
> at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1865)
> at
> org.apache.lucene.index.IndexWriter.forceMerge(IndexWriter.java:1801)
> at
> org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:563)
> at
> org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:95)
> at
> org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:64)
> at
> org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalCommit(DistributedUpdateProcessor.java:1648)
> at
> org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1625)
> at
> org.apache.solr.handler.RequestHandlerUtils.handleCommit(RequestHandlerUtils.java:69)
> at
> org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68)
> at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1963)
> at
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:777)
> at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:418)
> at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:207)
> at
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
> at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
> at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
> at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
> at
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
> at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
> at
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
> at
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
> at org.eclipse.jetty.server.Server.handle(Server.java:368)
> at
> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
> at
> org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
> at
> org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
> at
> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
> at
> org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
> at
> org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
> at
> org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
> at
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
> at java.lang.Thread.run(Thread.java:744)
> Caused by: java.lang.IndexOutOfBoundsException
> at java.nio.Buffer.checkIndex(Buffer.java:546)
> at java.nio.DirectByteBuffer.getInt(DirectByteBuffer.java:681)
> at
> org.apache.lucene.store.ByteBufferIndexInput$SingleBufferImpl.readInt(ByteBufferIndexInput.java:480)
> at
> org.apache.lucene.util.packed.DirectReader$DirectPackedReader20.get(DirectReader.java:184)
> at
> org.apache.lucene.codecs.lucene49.Lucene49DocValuesProducer$1.get(Lucene49DocValuesProducer.java:351)
> at
> org.apache.lucene.codecs.lucene49.Lucene49DocValuesProducer$8.nextOrd(Lucene49DocValuesProducer.java:616)
> at
> org.apache.lucene.codecs.DocValuesConsumer.mergeSortedSetField(DocValuesConsumer.java:599)
> at
> org.apache.lucene.index.SegmentMerger.mergeDocValues(SegmentMerger.java:213)
> at org.apache.lucene.index.SegmentMerger.merge(SegmentMerger.java:122)
> at
> org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4217)
> at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3812)
> at
> org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:405)
> at
> org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:482)
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
