[ 
https://issues.apache.org/jira/browse/SOLR-12691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16592767#comment-16592767
 ] 

Shawn Heisey commented on SOLR-12691:
-------------------------------------

An additional thought:  Even if the problem can be found and fixed so the 
two-core reproduction scenario works perfectly, I can tell you that the 
performance will be *awful* as Solr continually unloads and loads cores.  The 
same thing might happen in the real-world scenario.  That would likely be 
preferable to index corruption, though.

[~erickerickson], should we have another issue to improve choosing which 
transient core to unload?  Do it on an LRU basis, instead of load order?  I was 
looking into request handler code.  A number of request handlers implement 
SolrCoreAware, but it's done on an individual handler basis, not on 
RequestHandlerBase.  If the base class were to implement SolrCoreAware and 
handle updating the timestamp, I think the handler code would be overall 
cleaner, and we might be in a better position to make LRU unloading happen.

> Index corruption when sending updates to multiple cores, if those cores can 
> get unloaded by LotsOfCores
> -------------------------------------------------------------------------------------------------------
>
>                 Key: SOLR-12691
>                 URL: https://issues.apache.org/jira/browse/SOLR-12691
>             Project: Solr
>          Issue Type: Bug
>      Security Level: Public(Default Security Level. Issues are Public) 
>    Affects Versions: 7.4
>            Reporter: Shawn Heisey
>            Priority: Minor
>
> When the LotsOfCores setting 'transientCacheSize' results in the unloading of 
> cores that are getting updates, the indexes in one or more of those cores can 
> get corrupted.
> How to reproduce:
>  * Set the "transientCacheSize" to 1
>  * Create two cores that are both set to transient.
>  * Ingest high load to core1 only (no issue at this time)
>  * Continue ingest high load to core1 and start ingest load to core2 
> simultaneously (core2 immediately corrupted)
> Error with stacktrace:
> {noformat}
> 2018-08-16 23:02:31.212 ERROR (qtp225472281-4098) [   
> x:aggregator-core-be43376de27b1675562841f64c498] o.a.s.u.SolrIndexWriter 
> Error closing IndexWriter
> java.nio.file.NoSuchFileException: 
> /opt/solr/volumes/data1/4cf838d4b9e4675-core-897/index/_2_Lucene50_0.pos
>         at 
> sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) 
> ~[?:1.8.0_162]
>         at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) 
> ~[?:1.8.0_162]
>         at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) 
> ~[?:1.8.0_162]
>         at 
> sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55)
>  ~[?:1.8.0_162]
>         at 
> sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:144)
>  ~[?:1.8.0_162]
>         at 
> sun.nio.fs.LinuxFileSystemProvider.readAttributes(LinuxFileSystemProvider.java:99)
>  ~[?:1.8.0_162]
>         at java.nio.file.Files.readAttributes(Files.java:1737) ~[?:1.8.0_162]
>         at java.nio.file.Files.size(Files.java:2332) ~[?:1.8.0_162]
>         at 
> org.apache.lucene.store.FSDirectory.fileLength(FSDirectory.java:243) 
> ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>         at 
> org.apache.lucene.store.NRTCachingDirectory.fileLength(NRTCachingDirectory.java:128)
>  ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>         at 
> org.apache.lucene.index.SegmentCommitInfo.sizeInBytes(SegmentCommitInfo.java:217)
>  ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>         at org.apache.lucene.index.MergePolicy.size(MergePolicy.java:558) 
> ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>         at 
> org.apache.lucene.index.TieredMergePolicy.getSegmentSizes(TieredMergePolicy.java:279)
>  ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>         at 
> org.apache.lucene.index.TieredMergePolicy.findMerges(TieredMergePolicy.java:300)
>  ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>         at 
> org.apache.lucene.index.IndexWriter.updatePendingMerges(IndexWriter.java:2199)
>  ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>         at 
> org.apache.lucene.index.IndexWriter.maybeMerge(IndexWriter.java:2162) 
> ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>         at org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3571) 
> ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>         at 
> org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1028) 
> ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>         at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1071) 
> ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>         at 
> org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:286) 
> [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz 
> - 2018-06-18 16:55:13]
>         at 
> org.apache.solr.update.DirectUpdateHandler2.closeWriter(DirectUpdateHandler2.java:917)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>         at 
> org.apache.solr.update.DefaultSolrCoreState.closeIndexWriter(DefaultSolrCoreState.java:105)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>         at 
> org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:399)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>         at 
> org.apache.solr.update.SolrCoreState.decrefSolrCoreState(SolrCoreState.java:83)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>         at org.apache.solr.core.SolrCore.close(SolrCore.java:1572) 
> [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz 
> - 2018-06-18 16:55:13]
>         at 
> com.vmware.ops.data.solr.handler.AggregateIngestionHandler.handleRequestBody(AggregateIngestionHandler.java:163)
>  [ops-data-solr-1.0.0-SNAPSHOT.jar:?]
>         at 
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:2539) 
> [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz 
> - 2018-06-18 16:55:13]
>         at 
> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:709) 
> [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz 
> - 2018-06-18 16:55:13]
>         at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:515) 
> [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz 
> - 2018-06-18 16:55:13]
>         at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:377)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>         at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:323)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>         at 
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634)
>  [jetty-servlet-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) 
> [jetty-servlet-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) 
> [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) 
> [jetty-security-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) 
> [jetty-servlet-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) 
> [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:219)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at org.eclipse.jetty.server.Server.handle(Server.java:531) 
> [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) 
> [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) 
> [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
>  [jetty-io-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) 
> [jetty-io-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) 
> [jetty-io-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:760)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at 
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:678)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>         at java.lang.Thread.run(Thread.java:748) [?:1.8.0_162]
>         Suppressed: java.nio.file.NoSuchFileException: 
> /opt/solr/volumes/data1/4cf838d4b9e4675-core-897/index/_2_Lucene50_0.pos
>                 at 
> sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) 
> ~[?:1.8.0_162]
>                 at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) 
> ~[?:1.8.0_162]
>                 at 
> sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) 
> ~[?:1.8.0_162]
>                 at 
> sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244) 
> ~[?:1.8.0_162]
>                 at 
> sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103)
>  ~[?:1.8.0_162]
>                 at java.nio.file.Files.delete(Files.java:1126) ~[?:1.8.0_162]
>                 at 
> org.apache.lucene.store.FSDirectory.privateDeleteFile(FSDirectory.java:371) 
> ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>                 at 
> org.apache.lucene.store.FSDirectory.deleteFile(FSDirectory.java:340) 
> ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>                 at 
> org.apache.lucene.store.NRTCachingDirectory.deleteFile(NRTCachingDirectory.java:119)
>  ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>                 at 
> org.apache.lucene.store.LockValidatingDirectoryWrapper.deleteFile(LockValidatingDirectoryWrapper.java:38)
>  ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>                 at 
> org.apache.lucene.index.IndexFileDeleter.deleteFile(IndexFileDeleter.java:696)
>  ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>                 at 
> org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:690)
>  ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>                 at 
> org.apache.lucene.index.IndexFileDeleter.decRef(IndexFileDeleter.java:589) 
> ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>                 at 
> org.apache.lucene.index.IndexFileDeleter.checkpoint(IndexFileDeleter.java:531)
>  ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>                 at 
> org.apache.lucene.index.IndexWriter.rollbackInternalNoCommit(IndexWriter.java:2331)
>  ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>                 at 
> org.apache.lucene.index.IndexWriter.rollbackInternal(IndexWriter.java:2274) 
> ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>                 at 
> org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1035) 
> ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>                 at 
> org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1071) 
> ~[lucene-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:51:45]
>                 at 
> org.apache.solr.update.SolrIndexWriter.close(SolrIndexWriter.java:286) 
> [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz 
> - 2018-06-18 16:55:13]
>                 at 
> org.apache.solr.update.DirectUpdateHandler2.closeWriter(DirectUpdateHandler2.java:917)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>                 at 
> org.apache.solr.update.DefaultSolrCoreState.closeIndexWriter(DefaultSolrCoreState.java:105)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>                 at 
> org.apache.solr.update.DefaultSolrCoreState.close(DefaultSolrCoreState.java:399)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>                 at 
> org.apache.solr.update.SolrCoreState.decrefSolrCoreState(SolrCoreState.java:83)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>                 at org.apache.solr.core.SolrCore.close(SolrCore.java:1572) 
> [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz 
> - 2018-06-18 16:55:13]
>                 at 
> com.vmware.ops.data.solr.handler.AggregateIngestionHandler.handleRequestBody(AggregateIngestionHandler.java:163)
>  [ops-data-solr-1.0.0-SNAPSHOT.jar:?]
>                 at 
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:199)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>                 at org.apache.solr.core.SolrCore.execute(SolrCore.java:2539) 
> [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz 
> - 2018-06-18 16:55:13]
>                 at 
> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:709) 
> [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz 
> - 2018-06-18 16:55:13]
>                 at 
> org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:515) 
> [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - jpountz 
> - 2018-06-18 16:55:13]
>                 at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:377)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>                 at 
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:323)
>  [solr-core-7.4.0.jar:7.4.0 9060ac689c270b02143f375de0348b7f626adebc - 
> jpountz - 2018-06-18 16:55:13]
>                 at 
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1634)
>  [jetty-servlet-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) 
> [jetty-servlet-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) 
> [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) 
> [jetty-security-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) 
> [jetty-servlet-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) 
> [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:219)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
>  [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at org.eclipse.jetty.server.Server.handle(Server.java:531) 
> [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:352) 
> [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) 
> [jetty-server-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:281)
>  [jetty-io-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) 
> [jetty-io-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) 
> [jetty-io-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:760)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at 
> org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:678)
>  [jetty-util-9.4.10.v20180503.jar:9.4.10.v20180503]
>                 at java.lang.Thread.run(Thread.java:748) [?:1.8.0_162]
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to