See <http://sierranevada.servebeer.com:8080/job/slow-io-beasting/5032/>
------------------------------------------ [...truncated 13130 lines...] [junit4:junit4] 2> 20719 T506 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4:junit4] 2> 20719 T506 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler [junit4:junit4] 2> 20735 T506 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler [junit4:junit4] 2> 20937 T506 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4:junit4] 2> 20984 T506 oasc.SolrCore.initDeprecatedSupport WARNING solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler. [junit4:junit4] 2> 21047 T506 oasc.SolrCore.initDeprecatedSupport WARNING adding ShowFileRequestHandler with hidden files: [SCHEMA.XML, OLD_SYNONYMS.TXT, STOPWORDS.TXT, PROTWORDS.TXT, OPEN-EXCHANGE-RATES.JSON, SYNONYMS.TXT, CURRENCY.XML, MAPPING-ISOLATIN1ACCENT.TXT] [junit4:junit4] 2> 21047 T506 oass.SolrIndexSearcher.<init> Opening Searcher@11365ad main [junit4:junit4] 2> 21047 T506 oass.SolrIndexSearcher.getIndexDir WARNING WARNING: Directory impl does not support setting indexDir: org.apache.lucene.store.MockDirectoryWrapper [junit4:junit4] 2> 21047 T506 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4:junit4] 2> 21047 T506 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4:junit4] 2> 21047 T506 oashc.SpellCheckComponent.inform Initializing spell checkers [junit4:junit4] 2> 21047 T506 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3} [junit4:junit4] 2> 21062 T506 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4:junit4] 2> 21078 T532 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@11365ad main{StandardDirectoryReader(segments_1:1)} [junit4:junit4] 2> 21405 T518 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... [junit4:junit4] 2> 21405 T518 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={ [junit4:junit4] 2> "operation":"state", [junit4:junit4] 2> "numShards":null, [junit4:junit4] 2> "shard":null, [junit4:junit4] 2> "roles":null, [junit4:junit4] 2> "state":"down", [junit4:junit4] 2> "core":"collection1", [junit4:junit4] 2> "collection":"collection1", [junit4:junit4] 2> "node_name":"BIGBOY:8983_solr", [junit4:junit4] 2> "base_url":"http://BIGBOY:8983/solr"} [junit4:junit4] 2> 21437 T517 oascc.ZkStateReader$2.process A cluster state change has occurred - updating... (2) [junit4:junit4] 2> 82713 T506 oasc.SolrException.log SEVERE null:org.apache.solr.common.SolrException: Could not get shard_id for core: collection1 [junit4:junit4] 2> at org.apache.solr.cloud.ZkController.doGetShardIdProcess(ZkController.java:996) [junit4:junit4] 2> at org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1054) [junit4:junit4] 2> at org.apache.solr.core.CoreContainer.register(CoreContainer.java:657) [junit4:junit4] 2> at org.apache.solr.core.CoreContainer.load(CoreContainer.java:530) [junit4:junit4] 2> at org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:306) [junit4:junit4] 2> at org.apache.solr.cloud.ClusterStateUpdateTest.testCoreRegistration(ClusterStateUpdateTest.java:223) [junit4:junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit4:junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit4:junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit4:junit4] 2> at java.lang.reflect.Method.invoke(Method.java:597) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) [junit4:junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) [junit4:junit4] 2> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51) [junit4:junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) [junit4:junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) [junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) [junit4:junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) [junit4:junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [junit4:junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4:junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43) [junit4:junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) [junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) [junit4:junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4:junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358) [junit4:junit4] 2> at java.lang.Thread.run(Thread.java:662) [junit4:junit4] 2> [junit4:junit4] 2> 82713 T506 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=32595 [junit4:junit4] 2> 82713 T506 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@167d438 [junit4:junit4] 2> 82713 T506 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0} [junit4:junit4] 2> 82713 T506 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState [junit4:junit4] 2> 82713 T506 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter [junit4:junit4] 2> 82713 T506 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser [junit4:junit4] 2> 82713 T506 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request. [junit4:junit4] 2> 82713 T506 oasc.SolrCore.close [testcore] CLOSING SolrCore org.apache.solr.core.SolrCore@1bfcdbd [junit4:junit4] 2> 82713 T506 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0} [junit4:junit4] 2> 82713 T506 oasc.SolrCore.decrefSolrCoreState Closing SolrCoreState [junit4:junit4] 2> 82713 T506 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter [junit4:junit4] 2> 82713 T506 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser [junit4:junit4] 2> 82729 T506 oasc.SolrCore.closeSearcher [testcore] Closing main searcher on request. [junit4:junit4] 2> 82729 T518 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=88570570901880834-127.0.0.1:1661_solr-n_0000000000) am no longer a leader. [junit4:junit4] 2> 82729 T511 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13aaa7708290002 [junit4:junit4] 2> 82729 T517 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK [junit4:junit4] 2> 82729 T506 oaz.ZooKeeper.close Session: 0x13aaa7708290002 closed [junit4:junit4] 2> 82729 T508 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57129 which had sessionid 0x13aaa7708290002 [junit4:junit4] 2> 82729 T517 oaz.ClientCnxn$EventThread.run EventThread shut down [junit4:junit4] 2> 82729 T506 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=23247730 [junit4:junit4] 2> 82729 T511 oazs.PrepRequestProcessor.pRequest Processed session termination for sessionid: 0x13aaa7708290006 [junit4:junit4] 2> 82744 T506 oaz.ZooKeeper.close Session: 0x13aaa7708290006 closed [junit4:junit4] 2> 82744 T508 oazs.NIOServerCnxn.closeSock Closed socket connection for client /127.0.0.1:57285 which had sessionid 0x13aaa7708290006 [junit4:junit4] 2> 82744 T506 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=4075103 [junit4:junit4] 2> 82744 T511 oazs.PrepRequestProcessor.run PrepRequestProcessor exited loop! [junit4:junit4] 2> 82744 T510 oazs.SyncRequestProcessor.run SyncRequestProcessor exited! [junit4:junit4] 2> 82744 T506 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete [junit4:junit4] 2> 83025 T509 oazs.SessionTrackerImpl.run SessionTrackerImpl exited loop! [junit4:junit4] 2> 83743 T531 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader [junit4:junit4] 2> 85037 T508 oazs.NIOServerCnxn$Factory.run WARNING Ignoring unexpected runtime exception java.nio.channels.CancelledKeyException [junit4:junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:55) [junit4:junit4] 2> at sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:69) [junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn$Factory.run(NIOServerCnxn.java:241) [junit4:junit4] 2> [junit4:junit4] 2> 85037 T531 oasc.LeaderElector$1.process WARNING org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect [junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:118) [junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:42) [junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:815) [junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:176) [junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:173) [junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:63) [junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:173) [junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:384) [junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:353) [junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:340) [junit4:junit4] 2> at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:383) [junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:155) [junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:99) [junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55) [junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:128) [junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:526) [junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502) [junit4:junit4] 2> [junit4:junit4] 2> 85037 T508 oazs.NIOServerCnxn$Factory.run NIOServerCnxn factory exited run method [junit4:junit4] 2> 85037 T531 oascc.ZkStateReader$3.process WARNING ZooKeeper watch triggered, but Solr cannot talk to ZK [junit4:junit4] 2> 85037 T531 oaz.ClientCnxn$EventThread.run EventThread shut down [junit4:junit4] 2> 85037 T506 oazs.FinalRequestProcessor.shutdown shutdown of request processor complete [junit4:junit4] 2> 85037 T506 oas.SolrTestCaseJ4.tearDown ###Ending testCoreRegistration [junit4:junit4] 2> 85037 T506 oas.SolrTestCaseJ4.deleteCore ###deleteCore [junit4:junit4] 2> 207856 T506 oas.SolrTestCaseJ4.endTrackingSearchers SEVERE ERROR: SolrIndexSearcher opens=5 closes=4 [junit4:junit4] 2> 207856 T505 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s). [junit4:junit4] 2> 228011 T505 ccr.ThreadLeakControl.checkThreadLeaks SEVERE 1 thread leaked from SUITE scope at org.apache.solr.cloud.ClusterStateUpdateTest: [junit4:junit4] 2> 1) Thread[id=532, name=searcherExecutor-272-thread-1, state=WAITING, group=TGRP-ClusterStateUpdateTest] [junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method) [junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) [junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) [junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) [junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) [junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) [junit4:junit4] 2> at java.lang.Thread.run(Thread.java:662) [junit4:junit4] 2> 228011 T505 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads: [junit4:junit4] 2> 1) Thread[id=532, name=searcherExecutor-272-thread-1, state=WAITING, group=TGRP-ClusterStateUpdateTest] [junit4:junit4] 2> 231100 T505 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated: [junit4:junit4] 2> 1) Thread[id=532, name=searcherExecutor-272-thread-1, state=WAITING, group=TGRP-ClusterStateUpdateTest] [junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method) [junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) [junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) [junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) [junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) [junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) [junit4:junit4] 2> at java.lang.Thread.run(Thread.java:662) [junit4:junit4] 2> NOTE: test params are: codec=Lucene3x, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=en_PH, timezone=Africa/Gaborone [junit4:junit4] 2> NOTE: Windows Vista 6.0 x86/Sun Microsystems Inc. 1.6.0_23 (32-bit)/cpus=4,threads=2,free=34715056,total=79253504 [junit4:junit4] 2> NOTE: All tests run in this JVM: [BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, TestSolrDeletionPolicy1, TestElisionMultitermQuery, TestSurroundQueryParser, WordBreakSolrSpellCheckerTest, SolrIndexConfigTest, DistributedSpellCheckComponentTest, TestBadConfig, TestAnalyzedSuggestions, UUIDFieldTest, CacheHeaderTest, TermVectorComponentDistributedTest, TestRandomFaceting, CopyFieldTest, TestDistributedSearch, DocumentBuilderTest, XsltUpdateRequestHandlerTest, FastVectorHighlighterTest, JSONWriterTest, LoggingHandlerTest, BadIndexSchemaTest, TestDocSet, TestNumberUtils, TestSolrCoreProperties, TestConfig, TestSuggestSpellingConverter, ClusterStateUpdateTest] [junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ClusterStateUpdateTest -Dtests.seed=4D090A43BE725FE8 -Dtests.slow=true -Dtests.locale=en_PH -Dtests.timezone=Africa/Gaborone -Dtests.file.encoding=UTF-8 [junit4:junit4] ERROR 0.00s J7 | ClusterStateUpdateTest (suite) <<< [junit4:junit4] > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=5 closes=4 [junit4:junit4] > at __randomizedtesting.SeedInfo.seed([4D090A43BE725FE8]:0) [junit4:junit4] > at org.junit.Assert.fail(Assert.java:93) [junit4:junit4] > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:242) [junit4:junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:97) [junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit4:junit4] > at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) [junit4:junit4] > at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) [junit4:junit4] > at java.lang.reflect.Method.invoke(Method.java:597) [junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559) [junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79) [junit4:junit4] > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700) [junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) [junit4:junit4] > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) [junit4:junit4] > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) [junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) [junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) [junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) [junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4:junit4] > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43) [junit4:junit4] > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) [junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70) [junit4:junit4] > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) [junit4:junit4] > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) [junit4:junit4] > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358) [junit4:junit4] > at java.lang.Thread.run(Thread.java:662) [junit4:junit4] > Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ClusterStateUpdateTest: [junit4:junit4] > 1) Thread[id=532, name=searcherExecutor-272-thread-1, state=WAITING, group=TGRP-ClusterStateUpdateTest] [junit4:junit4] > at sun.misc.Unsafe.park(Native Method) [junit4:junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) [junit4:junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) [junit4:junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) [junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) [junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) [junit4:junit4] > at java.lang.Thread.run(Thread.java:662) [junit4:junit4] > at __randomizedtesting.SeedInfo.seed([4D090A43BE725FE8]:0) [junit4:junit4] > Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated: [junit4:junit4] > 1) Thread[id=532, name=searcherExecutor-272-thread-1, state=WAITING, group=TGRP-ClusterStateUpdateTest] [junit4:junit4] > at sun.misc.Unsafe.park(Native Method) [junit4:junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) [junit4:junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987) [junit4:junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399) [junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947) [junit4:junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) [junit4:junit4] > at java.lang.Thread.run(Thread.java:662) [junit4:junit4] > at __randomizedtesting.SeedInfo.seed([4D090A43BE725FE8]:0) [junit4:junit4] Completed on J7 in 231.13s, 1 test, 1 failure, 2 errors <<< FAILURES! [junit4:junit4] [junit4:junit4] [junit4:junit4] Tests with failures: [junit4:junit4] - org.apache.solr.cloud.ClusterStateUpdateTest (suite) [junit4:junit4] [junit4:junit4] [junit4:junit4] JVM J0: 2.61 .. 278.90 = 276.30s [junit4:junit4] JVM J1: 2.61 .. 313.18 = 310.58s [junit4:junit4] JVM J2: 2.59 .. 262.97 = 260.38s [junit4:junit4] JVM J3: 2.61 .. 259.02 = 256.42s [junit4:junit4] JVM J4: 3.40 .. 319.03 = 315.63s [junit4:junit4] JVM J5: 2.36 .. 270.71 = 268.36s [junit4:junit4] JVM J6: 2.61 .. 271.80 = 269.19s [junit4:junit4] JVM J7: 2.09 .. 474.39 = 472.30s [junit4:junit4] Execution time total: 7 minutes 54 seconds [junit4:junit4] Tests summary: 233 suites, 965 tests, 3 suite-level errors, 12 ignored (7 assumptions) BUILD FAILED <http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/build.xml>:39: The following error occurred while executing this line: <http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/solr/build.xml>:178: The following error occurred while executing this line: <http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/lucene/module-build.xml>:61: The following error occurred while executing this line: <http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/lucene/common-build.xml>:1159: The following error occurred while executing this line: <http://sierranevada.servebeer.com:8080/job/slow-io-beasting/ws/lucene/common-build.xml>:827: There were test failures: 233 suites, 965 tests, 3 suite-level errors, 12 ignored (7 assumptions) Total time: 16 minutes 46 seconds Build step 'Invoke Ant' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org