Build: https://builds.apache.org/job/Solr-trunk/1899/
1 tests failed. FAILED: org.apache.solr.cloud.RecoveryZkTest.testDistribSearch Error Message: Thread threw an uncaught exception, thread: Thread[Lucene Merge Thread #2,6,] Stack Trace: java.lang.RuntimeException: Thread threw an uncaught exception, thread: Thread[Lucene Merge Thread #2,6,] at com.carrotsearch.randomizedtesting.RunnerThreadGroup.processUncaught(RunnerThreadGroup.java:96) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:857) at com.carrotsearch.randomizedtesting.RandomizedRunner.access$700(RandomizedRunner.java:132) at com.carrotsearch.randomizedtesting.RandomizedRunner$3$1.run(RandomizedRunner.java:669) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:695) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:734) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:745) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleReportUncaughtExceptions$1.evaluate(TestRuleReportUncaughtExceptions.java:68) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) at org.apache.lucene.util.TestRuleIcuHack$1.evaluate(TestRuleIcuHack.java:51) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at org.apache.lucene.util.TestRuleNoInstanceHooksOverrides$1.evaluate(TestRuleNoInstanceHooksOverrides.java:53) at org.apache.lucene.util.TestRuleNoStaticHooksShadowing$1.evaluate(TestRuleNoStaticHooksShadowing.java:52) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:36) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:605) at com.carrotsearch.randomizedtesting.RandomizedRunner.access$400(RandomizedRunner.java:132) at com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:551) Caused by: org.apache.lucene.index.MergePolicy$MergeException: org.apache.lucene.store.AlreadyClosedException: this Directory is closed at __randomizedtesting.SeedInfo.seed([BD9802CED4A8287]:0) at org.apache.lucene.index.ConcurrentMergeScheduler.handleMergeException(ConcurrentMergeScheduler.java:507) at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:480) Caused by: org.apache.lucene.store.AlreadyClosedException: this Directory is closed at org.apache.lucene.store.Directory.ensureOpen(Directory.java:244) at org.apache.lucene.store.FSDirectory.listAll(FSDirectory.java:241) at org.apache.lucene.index.IndexFileDeleter.refresh(IndexFileDeleter.java:320) at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3135) at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:382) at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:451) Build Log: [...truncated 43682 lines...] [junit4] 2> 28995 T54 oascc.ZkStateReader$3.process Updating live nodes [junit4] 2> 28996 T41 oaz.ClientCnxn$EventThread.run EventThread shut down [junit4] 2> 28996 T22 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:38088 which had sessionid 0x1383865c5b90002 [junit4] 2> 28997 T20 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null} [junit4] 2> 28998 T54 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader [junit4] 2> 29006 T54 oasc.Overseer.<init> Overseer (id=87882202493812739-127.0.0.1:63883_solr-n_0000000001) starting [junit4] 2> 29006 T25 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x1383865c5b90003 type:create cxid:0x60 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer [junit4] 2> 29008 T25 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x1383865c5b90003 type:create cxid:0x61 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer [junit4] 2> 29009 T25 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x1383865c5b90003 type:create cxid:0x62 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer [junit4] 2> 29019 T184 oasc.Overseer$CloudStateUpdater.run Starting to work on the main queue [junit4] 2> 29053 T20 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1702525663 [junit4] 2> 29053 T20 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@2d6acad2 [junit4] 2> 29058 T20 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request. [junit4] 2> 29059 T20 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=1532,cumulative_deletesById=765,cumulative_deletesByQuery=0,cumulative_errors=0} [junit4] 2> 29101 T20 C2 P63883 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits:num=3 [junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-1340975990134/jetty1/index,segFN=segments_3,generation=3,filenames=[_44_Lucene40_0.prx, _42.fdt, _42.fdx, _40.fdx, _40_Lucene40_0.tip, _40.fdt, _43_Lucene40_0.tim, _41_Lucene40_0.prx, _41.fnm, _44_nrm.cfs, _45.fnm, _43_Lucene40_0.tip, _43.fnm, _45.fdt, _45.fdx, _40_nrm.cfs, _42_nrm.cfe, _44.fdx, _45_Lucene40_0.frq, _41_nrm.cfs, _44.fdt, _44_Lucene40_0.tip, _44_Lucene40_0.tim, _40.si, _43_Lucene40_0.prx, _44_Lucene40_0.frq, _45_nrm.cfe, _44.si, _43_nrm.cfe, _41_Lucene40_0.tim, _43_nrm.cfs, _41_Lucene40_0.tip, _40_1.del, _42.fnm, _40_nrm.cfe, _42_Lucene40_0.prx, _41.si, _42_nrm.cfs, _45_Lucene40_0.tim, _44.fnm, _42.si, _45_Lucene40_0.tip, _40_Lucene40_0.prx, _43_Lucene40_0.frq, _41.fdt, _41.fdx, _42_Lucene40_0.frq, _45.si, _42_Lucene40_0.tim, _41_nrm.cfe, _42_Lucene40_0.tip, _45_Lucene40_0.prx, _40.fnm, _41_Lucene40_0.frq, _43.si, _40_Lucene40_0.frq, _43.fdx, _40_Lucene40_0.tim, _44_nrm.cfe, _45_nrm.cfs, segments_3, _43.fdt] [junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-1340975990134/jetty1/index,segFN=segments_4,generation=4,filenames=[_4v.si, _4q_nrm.cfs, _4o_Lucene40_0.frq, _4q.fdt, _4r_Lucene40_0.frq, _4t_nrm.cfe, _4v_Lucene40_0.prx, _4v_nrm.cfs, _4t_Lucene40_0.tim, _4q.fdx, _4r_Lucene40_0.prx, _4s_Lucene40_0.frq, _4t.si, _4t_Lucene40_0.tip, _4t_Lucene40_0.prx, _4q_Lucene40_0.tim, _4s_Lucene40_0.tim, _4q_Lucene40_0.tip, _4r_nrm.cfs, _4s.fdt, _4s_Lucene40_0.tip, _4u_nrm.cfe, _4s.si, _4s.fdx, _4p.fdx, _4p.fdt, _4u.si, _4o.fnm, _4p_Lucene40_0.tip, _4s_nrm.cfs, _4t_Lucene40_0.frq, _4v_Lucene40_0.frq, _4s_1.del, _4p.si, _4r_Lucene40_0.tip, _4r_2.del, _4r_Lucene40_0.tim, _4q.si, _4o_nrm.cfs, _4r.fdx, _4r.si, _4v_Lucene40_0.tim, _4o.fdt, _4p_nrm.cfs, _4t.fdx, _4o.fdx, _4t.fdt, _4v_Lucene40_0.tip, _4r.fdt, _4q_Lucene40_0.prx, _4o_1.del, _4v.fnm, _4u_Lucene40_0.prx, _4o_nrm.cfe, _4s.fnm, _4s_Lucene40_0.prx, _4p_nrm.cfe, _4v.fdt, _4u.fdx, _4p_Lucene40_0.tim, _4s_nrm.cfe, _4v.fdx, _4u.fdt, _4t.fnm, _4q_2.del, _4u_Lucene40_0.frq, _4q.fnm, _4o_Lucene40_0.tim, _4p_Lucene40_0.frq, _4o_Lucene40_0.tip, _4u_Lucene40_0.tim, _4o.si, _4r_nrm.cfe, _4u_Lucene40_0.tip, _4u_nrm.cfs, _4t_1.del, _4p_1.del, _4p.fnm, _4q_Lucene40_0.frq, _4q_nrm.cfe, _4r.fnm, _4t_nrm.cfs, _4u.fnm, _4o_Lucene40_0.prx, _4v_nrm.cfe, segments_4, _4p_Lucene40_0.prx] [junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Solr-trunk/checkout/solr/build/solr-core/test/J0/org.apache.solr.cloud.RecoveryZkTest-1340975990134/jetty1/index,segFN=segments_5,generation=5,filenames=[_4w.fdx, _4w_Lucene40_0.tip, _4w_nrm.cfe, _4w.fnm, _4w.fdt, _4w_Lucene40_0.prx, _4w.si, segments_5, _4w_Lucene40_0.tim, _4w_nrm.cfs, _4w_Lucene40_0.frq] [junit4] 2> 29102 T20 C2 P63883 oasc.SolrDeletionPolicy.updateCommits newest commit = 5 [junit4] 2> 29119 T25 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x1383865c5b90003 [junit4] 2> 29121 T74 oascc.ZkStateReader$3.process Updating live nodes [junit4] 2> 29121 T54 oascc.ZkStateReader$3.process Updating live nodes [junit4] 2> 29121 T20 oaz.ZooKeeper.close Session: 0x1383865c5b90003 closed [junit4] 2> 29121 T70 oascc.ZkStateReader$3.process Updating live nodes [junit4] 2> 29121 T22 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:50749 which had sessionid 0x1383865c5b90003 [junit4] 2> 29122 T54 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK [junit4] 2> 29122 T54 oaz.ClientCnxn$EventThread.run EventThread shut down [junit4] 2> 29123 T20 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null} [junit4] 2> 29124 T116 oasu.PeerSync.sync PeerSync: core=collection1 url=127.0.0.1:37960/solr START replicas=[] nUpdates=100 [junit4] 2> 29126 T116 oasu.PeerSync.sync PeerSync: core=collection1 url=127.0.0.1:37960/solr DONE. sync succeeded [junit4] 2> 29126 T116 oasc.SyncStrategy.syncToMe try and ask http://127.0.0.1:63883/solr/collection1/ to sync [junit4] 2> 29129 T121 C3 P15490 oasu.PeerSync.sync PeerSync: core=collection1 url=127.0.0.1:37960/solr START replicas=[127.0.0.1:15490/solr/collection1/] nUpdates=100 [junit4] 2> 29132 T119 C3 P15490 REQ /get {distrib=false&qt=/get&wt=javabin&version=2&getVersions=100} status=0 QTime=2 [junit4] 2> 29133 T42 oasc.Overseer$CloudStateUpdater.amILeader WARNING org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118) [junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42) [junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:927) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:289) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:286) [junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65) [junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:286) [junit4] 2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.amILeader(Overseer.java:185) [junit4] 2> at org.apache.solr.cloud.Overseer$CloudStateUpdater.run(Overseer.java:111) [junit4] 2> at java.lang.Thread.run(Thread.java:679) [junit4] 2> [junit4] 2> 29133 T42 oasc.Overseer$CloudStateUpdater.amILeader According to ZK I (id=87882202493812738-127.0.0.1:50523_solr-n_0000000000) am no longer a leader. [junit4] 2> 29134 T121 C3 P15490 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=127.0.0.1:37960/solr Received 100 versions from 127.0.0.1:15490/solr/collection1/ [junit4] 2> 29134 T121 C3 P15490 oasu.PeerSync.handleVersions PeerSync: core=collection1 url=127.0.0.1:37960/solr Our versions are newer. ourLowThreshold=1406115269106991104 otherHigh=1406115269561024512 [junit4] 2> 29135 T121 C3 P15490 oasu.PeerSync.sync PeerSync: core=collection1 url=127.0.0.1:37960/solr DONE. sync succeeded [junit4] 2> 29135 T121 C3 P15490 REQ /get {sync=127.0.0.1:15490/solr/collection1/&getVersions=100&distrib=false&qt=/get&wt=javabin&version=2} status=0 QTime=7 [junit4] 2> 29136 T116 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:15490_solr_collection1 [junit4] 2> 29138 T116 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1 [junit4] 2> 29141 T25 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x1383865c5b90007 type:create cxid:0x49 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer [junit4] 2> 29151 T116 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader [junit4] 2> 29154 T116 oasc.Overseer.<init> Overseer (id=87882202493812743-127.0.0.1:15490_solr-n_0000000004) starting [junit4] 2> 29154 T25 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x1383865c5b90007 type:create cxid:0x50 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer [junit4] 2> 29155 T25 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x1383865c5b90007 type:create cxid:0x51 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer [junit4] 2> 29157 T25 oazs.PrepRequestProcessor.pRequest Got user-level KeeperException when processing sessionid:0x1383865c5b90007 type:create cxid:0x52 zxid:0xfffffffffffffffe txntype:unknown reqpath:n/a Error Path:/solr/overseer Error:KeeperErrorCode = NodeExists for /solr/overseer [junit4] 2> 29166 T116 oascc.ZkStateReader$3.process Updating live nodes [junit4] 2> 29167 T187 oasc.Overseer$CloudStateUpdater.run Starting to work on the main queue [junit4] 2> 29168 T187 oascc.ZkStateReader.updateCloudState Manual update of cluster state initiated [junit4] 2> 29168 T187 oascc.ZkStateReader.updateCloudState Updating cloud state from ZooKeeper... [junit4] 2> 29175 T20 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=880764402 [junit4] 2> 29175 T20 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:15490_solr_collection1 [junit4] 2> 29175 T20 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@637533df [junit4] 2> 29182 T20 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request. [junit4] 2> 29182 T20 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=4,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=860,cumulative_deletesById=422,cumulative_deletesByQuery=0,cumulative_errors=0} [junit4] 2> 29184 T20 oasc.RecoveryStrategy.close WARNING Stopping recovery for core collection1 zkNodeName=127.0.0.1:15490_solr_collection1 [junit4] 2> 29184 T25 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x1383865c5b90007 [junit4] 2> 29185 T187 oasc.Overseer$CloudStateUpdater.run WARNING Overseer cannot talk to ZK [junit4] 2> 29194 T116 oascc.ZkStateReader$3.process Updating live nodes [junit4] 2> 29194 T70 oascc.ZkStateReader$3.process Updating live nodes [junit4] 2> 29194 T116 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK [junit4] 2> 29194 T20 oaz.ZooKeeper.close Session: 0x1383865c5b90007 closed [junit4] 2> 29194 T116 oaz.ClientCnxn$EventThread.run EventThread shut down [junit4] 2> 29194 T74 oascc.ZkStateReader$3.process Updating live nodes [junit4] 2> 29194 T22 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:62261 which had sessionid 0x1383865c5b90007 [junit4] 2> 29195 T20 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null} [junit4] 2> 29248 T25 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x1383865c5b90006 [junit4] 2> 29253 T74 oaz.ClientCnxn$EventThread.run EventThread shut down [junit4] 2> 29252 T20 oaz.ZooKeeper.close Session: 0x1383865c5b90006 closed [junit4] 2> 29253 T22 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:20045 which had sessionid 0x1383865c5b90006 [junit4] 2> 29253 T25 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x1383865c5b90005 [junit4] 2> 29258 T70 oaz.ClientCnxn$EventThread.run EventThread shut down [junit4] 2> 29258 T20 oaz.ZooKeeper.close Session: 0x1383865c5b90005 closed [junit4] 2> 29258 T22 oazs.NIOServerCnxn.closeSock Closed socket connection for client /140.211.11.196:52386 which had sessionid 0x1383865c5b90005 [junit4] 2> 29259 T25 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop! [junit4] 2> 29259 T24 oazs.SyncRequestProcessor.run SyncRequestProcessor exited! [junit4] 2> 29259 T20 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete [junit4] 2> 29396 T22 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method [junit4] 2> 29396 T20 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete [junit4] 2> 29424 T20 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RecoveryZkTest -Dtests.method=testDistribSearch -Dtests.seed=BD9802CED4A8287 -Dtests.slow=true -Dtests.locale=fr -Dtests.timezone=Europe/Tirane -Dargs="-Dfile.encoding=ISO8859-1" [junit4] 2> [junit4] > (@AfterClass output) [junit4] 2> 29457 T20 oas.SolrTestCaseJ4.deleteCore ###deleteCore [junit4] 2> NOTE: test params are: codec=Lucene40: {}, sim=RandomSimilarityProvider(queryNorm=false,coord=true): {}, locale=fr, timezone=Europe/Tirane [junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Sun Microsystems Inc. 1.6.0_32 (64-bit)/cpus=16,threads=9,free=86235656,total=148045824 [junit4] 2> NOTE: All tests run in this JVM: [TestNGramFilters, TestIndonesianStemFilterFactory, SolrRequestParserTest, RecoveryZkTest] [junit4] 2> [junit4] Completed in 29.49s, 1 test, 1 error <<< FAILURES! [...truncated 873 lines...] [...truncated 44656 lines...] [...truncated 44656 lines...] [...truncated 44656 lines...] [...truncated 44656 lines...] [...truncated 44656 lines...]
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org