Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4253/ Java: 32bit/jdk1.8.0_40-ea-b04 -server -XX:+UseSerialGC
1 tests failed. REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch Error Message: expected:<0> but was:<1> Stack Trace: java.lang.AssertionError: expected:<0> but was:<1> at __randomizedtesting.SeedInfo.seed([464AFC91D9F84B66:C7AC7289AEA72B5A]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:472) at org.junit.Assert.assertEquals(Assert.java:456) at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:153) at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869) at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at java.lang.Thread.run(Thread.java:745) Build Log: [...truncated 11472 lines...] [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest [junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\init-core-data-001 [junit4] 2> 3192481 T8079 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true) [junit4] 2> 3192482 T8079 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_k/ [junit4] 2> 3192489 T8079 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch [junit4] 2> 3192491 T8079 oasc.ZkTestServer.run STARTING ZK TEST SERVER [junit4] 1> client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 3192492 T8080 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server [junit4] 2> 3192596 T8079 oasc.ZkTestServer.run start zk server on port:53957 [junit4] 2> 3192597 T8079 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 3192599 T8079 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 3192606 T8086 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a807d name:ZooKeeperConnection Watcher:127.0.0.1:53957 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 3192606 T8079 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 3192606 T8079 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 3192606 T8079 oascc.SolrZkClient.makePath makePath: /solr [junit4] 2> 3192613 T8079 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 3192613 T8081 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x148e165aa4d0000, likely client has closed socket [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> [junit4] 2> 3192617 T8079 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 3192619 T8088 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bcfbf6 name:ZooKeeperConnection Watcher:127.0.0.1:53957/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 3192620 T8079 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 3192620 T8079 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 3192620 T8079 oascc.SolrZkClient.makePath makePath: /collections/collection1 [junit4] 2> 3192628 T8079 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards [junit4] 2> 3192633 T8079 oascc.SolrZkClient.makePath makePath: /collections/control_collection [junit4] 2> 3192636 T8079 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards [junit4] 2> 3192640 T8079 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 3192640 T8079 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml [junit4] 2> 3192651 T8079 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml [junit4] 2> 3192651 T8079 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml [junit4] 2> 3192657 T8079 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 3192657 T8079 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 3192667 T8079 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 3192667 T8079 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt [junit4] 2> 3192673 T8079 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 3192673 T8079 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt [junit4] 2> 3192678 T8079 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml [junit4] 2> 3192679 T8079 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml [junit4] 2> 3192684 T8079 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 3192684 T8079 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 3192691 T8079 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 3192691 T8079 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 3192696 T8079 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 3192696 T8079 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 3192703 T8079 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 3192703 T8079 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 3192708 T8079 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 3192709 T8079 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt [junit4] 2> 3194398 T8079 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 3194439 T8079 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53964 [junit4] 2> 3194440 T8079 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 3194440 T8079 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 3194441 T8079 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-002 [junit4] 2> 3194441 T8079 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-002\' [junit4] 2> 3194478 T8079 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-002\solr.xml [junit4] 2> 3194491 T8079 oasc.CoreContainer.<init> New CoreContainer 25096963 [junit4] 2> 3194492 T8079 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-002\] [junit4] 2> 3194492 T8079 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 3194492 T8079 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 3194493 T8079 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 3194493 T8079 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 3194494 T8079 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 3194494 T8079 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 3194494 T8079 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 3194495 T8079 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 3194495 T8079 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 3194496 T8079 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 3194496 T8079 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 3194496 T8079 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 3194497 T8079 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 3194497 T8079 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53957/solr [junit4] 2> 3194498 T8079 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 3194498 T8079 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 3194501 T8079 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 3194503 T8099 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4da5f9 name:ZooKeeperConnection Watcher:127.0.0.1:53957 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 3194503 T8079 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 3194504 T8079 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 3194506 T8081 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x148e165aa4d0002, likely client has closed socket [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> [junit4] 2> 3194508 T8079 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 3194509 T8101 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65176a name:ZooKeeperConnection Watcher:127.0.0.1:53957/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 3194510 T8079 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 3194511 T8079 oascc.SolrZkClient.makePath makePath: /overseer/queue [junit4] 2> 3194516 T8079 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work [junit4] 2> 3194520 T8079 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running [junit4] 2> 3194525 T8079 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed [junit4] 2> 3194532 T8079 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure [junit4] 2> 3194537 T8079 oascc.SolrZkClient.makePath makePath: /live_nodes [junit4] 2> 3194539 T8079 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53964__k [junit4] 2> 3194540 T8079 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53964__k [junit4] 2> 3194544 T8079 oascc.SolrZkClient.makePath makePath: /overseer_elect [junit4] 2> 3194547 T8079 oascc.SolrZkClient.makePath makePath: /overseer_elect/election [junit4] 2> 3194550 T8079 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 3194552 T8079 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:53964__k [junit4] 2> 3194552 T8079 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader [junit4] 2> 3194555 T8079 oasc.Overseer.start Overseer (id=92571619126214659-127.0.0.1:53964__k-n_0000000000) starting [junit4] 2> 3194558 T8079 oascc.SolrZkClient.makePath makePath: /overseer/queue-work [junit4] 2> 3194571 T8079 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 3194573 T8103 oasc.OverseerCollectionProcessor.run Process current queue of collection creations [junit4] 2> 3194574 T8079 oascc.SolrZkClient.makePath makePath: /clusterstate.json [junit4] 2> 3194578 T8079 oascc.SolrZkClient.makePath makePath: /aliases.json [junit4] 2> 3194581 T8079 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 3194587 T8102 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue [junit4] 2> 3194607 T8105 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection [junit4] 2> 3194608 T8105 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 3194609 T8105 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 3194610 T8106 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 3194615 T8102 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:53964/_k", [junit4] 2> "node_name":"127.0.0.1:53964__k", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} [junit4] 2> 3194615 T8102 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1] [junit4] 2> 3194615 T8102 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1 [junit4] 2> 3194615 T8102 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1 [junit4] 2> 3194620 T8106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 3195649 T8105 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 [junit4] 2> 3195649 T8105 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection [junit4] 2> 3195650 T8105 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 3195650 T8105 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection [junit4] 2> 3195652 T8105 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 3195652 T8105 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-002\collection1\' [junit4] 2> 3195654 T8105 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001/tempDir-002/collection1/lib/.svn/' to classloader [junit4] 2> 3195656 T8105 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001/tempDir-002/collection1/lib/classes/' to classloader [junit4] 2> 3195656 T8105 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001/tempDir-002/collection1/lib/README' to classloader [junit4] 2> 3195691 T8105 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 3195698 T8105 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 3195701 T8105 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 3195705 T8105 oass.IndexSchema.readSchema [collection1] Schema name=test [junit4] 2> 3195812 T8105 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 3195814 T8105 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 3195815 T8105 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 3195818 T8105 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 3195852 T8105 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection [junit4] 2> 3195852 T8105 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory [junit4] 2> 3195853 T8105 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-002\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001/control/data\ [junit4] 2> 3195853 T8105 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e12a5 [junit4] 2> 3195857 T8105 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\control\data [junit4] 2> 3195858 T8105 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001/control/data\index/ [junit4] 2> 3195859 T8105 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\control\data\index' doesn't exist. Creating new index... [junit4] 2> 3195860 T8105 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\control\data\index [junit4] 2> 3195861 T8105 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=95.578125, floorSegmentMB=1.755859375, forceMergeDeletesPctAllowed=4.501162587699624, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 3195866 T8105 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\control\data\index,segFN=segments_1,generation=1} [junit4] 2> 3195867 T8105 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 3195869 T8105 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 3195869 T8105 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 3195870 T8105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 3195870 T8105 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 3195870 T8105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 3195870 T8105 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 3195871 T8105 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 3195871 T8105 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 3195871 T8105 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 3195872 T8105 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 3195872 T8105 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 3195872 T8105 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 3195873 T8105 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 3195873 T8105 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 3195873 T8105 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 3195874 T8105 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 3195874 T8105 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 3195874 T8105 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 3195875 T8105 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 3195875 T8105 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 3195882 T8105 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 3195883 T8105 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 3195885 T8105 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 3195886 T8105 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 3195888 T8105 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4] 2> 3195889 T8105 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4] 2> 3195889 T8105 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34845766228550723] [junit4] 2> 3195890 T8105 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\control\data\index,segFN=segments_1,generation=1} [junit4] 2> 3195891 T8105 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 3195891 T8105 oass.SolrIndexSearcher.<init> Opening Searcher@10f443d[collection1] main [junit4] 2> 3195891 T8105 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection [junit4] 2> 3195893 T8105 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper [junit4] 2> 3195893 T8105 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 3195894 T8105 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 3195894 T8105 oasr.RestManager.init Initializing RestManager with initArgs: {} [junit4] 2> 3195894 T8105 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 3195896 T8105 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 3195896 T8105 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 3195897 T8105 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json [junit4] 2> 3195900 T8105 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json [junit4] 2> 3195900 T8105 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 3195900 T8105 oasr.RestManager.init Initializing 0 registered ManagedResources [junit4] 2> 3195903 T8107 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10f443d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 3195904 T8105 oasc.CoreContainer.registerCore registering core: collection1 [junit4] 2> 3195905 T8110 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53964/_k collection:control_collection shard:shard1 [junit4] 2> 3195906 T8079 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0 [junit4] 2> 3195906 T8079 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 3195907 T8079 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 3195907 T8110 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election [junit4] 2> 3195909 T8079 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 3195911 T8112 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bfbd13 name:ZooKeeperConnection Watcher:127.0.0.1:53957/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 3195911 T8079 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 3195911 T8079 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 3195913 T8079 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 3195918 T8110 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1 [junit4] 2> 3195919 T8079 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 3195946 T8106 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 3197503 T8110 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. [junit4] 2> 3197503 T8110 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C4186 name=collection1 org.apache.solr.core.SolrCore@1200ce0 url=http://127.0.0.1:53964/_k/collection1 node=127.0.0.1:53964__k C4186_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:53964/_k, node_name=127.0.0.1:53964__k, state=down} [junit4] 2> 3197503 T8110 C4186 P53964 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53964/_k/collection1/ [junit4] 2> 3197503 T8110 C4186 P53964 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me [junit4] 2> 3197503 T8110 C4186 P53964 oasc.SyncStrategy.syncToMe http://127.0.0.1:53964/_k/collection1/ has no replicas [junit4] 2> 3197503 T8110 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53964/_k/collection1/ shard1 [junit4] 2> 3197505 T8110 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1 [junit4] 2> 3197644 T8106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 3197652 T8113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 3197653 T8106 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 3197674 T8079 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 [junit4] 2> 3197675 T8079 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 3197679 T8079 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53976 [junit4] 2> 3197681 T8079 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 3197681 T8079 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 3197682 T8079 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-003 [junit4] 2> 3197683 T8079 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-003\' [junit4] 2> 3197752 T8079 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-003\solr.xml [junit4] 2> 3197771 T8113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 3197772 T8106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 3197775 T8079 oasc.CoreContainer.<init> New CoreContainer 3568349 [junit4] 2> 3197777 T8079 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-003\] [junit4] 2> 3197779 T8079 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 3197780 T8079 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 3197781 T8079 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 3197782 T8079 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 3197783 T8079 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 3197784 T8079 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 3197785 T8079 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 3197785 T8079 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 3197785 T8079 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 3197785 T8079 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 3197788 T8079 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 3197789 T8079 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 3197789 T8079 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 3197789 T8079 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53957/solr [junit4] 2> 3197789 T8079 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 3197791 T8079 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 3197794 T8079 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 3197796 T8124 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21dc45 name:ZooKeeperConnection Watcher:127.0.0.1:53957 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 3197796 T8079 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 3197796 T8079 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 3197801 T8079 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 3197803 T8126 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@91727b name:ZooKeeperConnection Watcher:127.0.0.1:53957/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 3197803 T8079 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 3197814 T8110 oasc.ZkController.register We are http://127.0.0.1:53964/_k/collection1/ and leader is http://127.0.0.1:53964/_k/collection1/ [junit4] 2> 3197814 T8079 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 3197814 T8110 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53964/_k [junit4] 2> 3197815 T8110 oasc.ZkController.checkRecovery I am the leader, no recovery necessary [junit4] 2> 3197815 T8110 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection [junit4] 2> 3197815 T8110 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 3197819 T8106 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 3197828 T8102 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:53964/_k", [junit4] 2> "node_name":"127.0.0.1:53964__k", [junit4] 2> "numShards":"3", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} [junit4] 2> 3197939 T8113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 3197940 T8106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 3197941 T8127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 3198865 T8079 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53976__k [junit4] 2> 3198867 T8079 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53976__k [junit4] 2> 3198873 T8079 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 3198879 T8128 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1 [junit4] 2> 3198879 T8128 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 3198880 T8106 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 3198881 T8128 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 3198886 T8102 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:53976/_k", [junit4] 2> "node_name":"127.0.0.1:53976__k", [junit4] 2> "numShards":"3", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state"} [junit4] 2> 3198886 T8102 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3] [junit4] 2> 3198886 T8102 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 1 [junit4] 2> 3198886 T8102 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2 [junit4] 2> 3198997 T8113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 3198997 T8127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 3198998 T8106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 3199958 T8128 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 [junit4] 2> 3199958 T8128 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1 [junit4] 2> 3199960 T8128 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 3199960 T8128 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 3199965 T8128 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 3199965 T8128 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-003\collection1\' [junit4] 2> 3199969 T8128 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001/tempDir-003/collection1/lib/.svn/' to classloader [junit4] 2> 3199971 T8128 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001/tempDir-003/collection1/lib/classes/' to classloader [junit4] 2> 3199973 T8128 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001/tempDir-003/collection1/lib/README' to classloader [junit4] 2> 3200031 T8128 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 3200041 T8128 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 3200047 T8128 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 3200054 T8128 oass.IndexSchema.readSchema [collection1] Schema name=test [junit4] 2> 3200187 T8128 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 3200202 T8128 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 3200203 T8128 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 3200209 T8128 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 3200247 T8128 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1 [junit4] 2> 3200248 T8128 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory [junit4] 2> 3200248 T8128 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-003\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001/jetty1\ [junit4] 2> 3200248 T8128 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e12a5 [junit4] 2> 3200250 T8128 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty1 [junit4] 2> 3200251 T8128 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001/jetty1\index/ [junit4] 2> 3200252 T8128 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty1\index' doesn't exist. Creating new index... [junit4] 2> 3200254 T8128 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty1\index [junit4] 2> 3200254 T8128 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=95.578125, floorSegmentMB=1.755859375, forceMergeDeletesPctAllowed=4.501162587699624, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 3200258 T8128 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1} [junit4] 2> 3200259 T8128 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 3200261 T8128 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 3200262 T8128 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 3200262 T8128 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 3200262 T8128 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 3200264 T8128 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 3200264 T8128 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 3200264 T8128 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 3200265 T8128 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 3200265 T8128 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 3200265 T8128 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 3200266 T8128 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 3200266 T8128 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 3200267 T8128 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 3200267 T8128 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 3200267 T8128 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 3200267 T8128 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 3200268 T8128 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 3200268 T8128 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 3200269 T8128 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 3200269 T8128 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 3200276 T8128 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 3200277 T8128 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 3200278 T8128 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 3200280 T8128 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 3200283 T8128 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4] 2> 3200283 T8128 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4] 2> 3200284 T8128 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34845766228550723] [junit4] 2> 3200285 T8128 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1} [junit4] 2> 3200285 T8128 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 3200286 T8128 oass.SolrIndexSearcher.<init> Opening Searcher@112391f[collection1] main [junit4] 2> 3200286 T8128 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 3200287 T8128 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 3200288 T8128 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 3200289 T8128 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 3200289 T8128 oasr.RestManager.init Initializing RestManager with initArgs: {} [junit4] 2> 3200289 T8128 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 3200292 T8128 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json [junit4] 2> 3200292 T8128 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 3200292 T8128 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed [junit4] 2> 3200293 T8128 oasr.RestManager.init Initializing 0 registered ManagedResources [junit4] 2> 3200297 T8129 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@112391f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 3200299 T8128 oasc.CoreContainer.registerCore registering core: collection1 [junit4] 2> 3200302 T8132 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53976/_k collection:collection1 shard:shard2 [junit4] 2> 3200303 T8079 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0 [junit4] 2> 3200303 T8079 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 3200304 T8132 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election [junit4] 2> 3200328 T8132 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2 [junit4] 2> 3200333 T8106 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 3200335 T8132 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. [junit4] 2> 3200335 T8132 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C4187 name=collection1 org.apache.solr.core.SolrCore@1454779 url=http://127.0.0.1:53976/_k/collection1 node=127.0.0.1:53976__k C4187_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:53976/_k, node_name=127.0.0.1:53976__k, state=down} [junit4] 2> 3200335 T8132 C4187 P53976 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53976/_k/collection1/ [junit4] 2> 3200335 T8132 C4187 P53976 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me [junit4] 2> 3200336 T8132 C4187 P53976 oasc.SyncStrategy.syncToMe http://127.0.0.1:53976/_k/collection1/ has no replicas [junit4] 2> 3200336 T8132 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53976/_k/collection1/ shard2 [junit4] 2> 3200336 T8132 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2 [junit4] 2> 3201230 T8113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 3201231 T8127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 3201231 T8106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 3201251 T8106 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 3201902 T8079 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 [junit4] 2> 3201905 T8079 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 3201909 T8113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 3201909 T8127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 3201910 T8106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 3201926 T8079 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53985 [junit4] 2> 3201926 T8079 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 3201926 T8079 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 3201926 T8079 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-004 [junit4] 2> 3201926 T8079 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-004\' [junit4] 2> 3201984 T8079 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-004\solr.xml [junit4] 2> 3201997 T8132 oasc.ZkController.register We are http://127.0.0.1:53976/_k/collection1/ and leader is http://127.0.0.1:53976/_k/collection1/ [junit4] 2> 3201997 T8132 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53976/_k [junit4] 2> 3201997 T8132 oasc.ZkController.checkRecovery I am the leader, no recovery necessary [junit4] 2> 3201997 T8132 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1 [junit4] 2> 3201997 T8132 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 3202007 T8079 oasc.CoreContainer.<init> New CoreContainer 31402404 [junit4] 2> 3202007 T8079 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-004\] [junit4] 2> 3202010 T8079 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 3202010 T8079 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 3202010 T8079 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 3202010 T8079 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 3202010 T8079 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 3202012 T8079 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 3202012 T8079 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 3202012 T8079 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 3202012 T8079 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 3202014 T8079 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 3202014 T8079 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 3202014 T8079 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 3202014 T8079 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 3202016 T8079 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53957/solr [junit4] 2> 3202016 T8079 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 3202016 T8079 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 3202029 T8079 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 3202031 T8144 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 3202041 T8143 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@185a7d7 name:ZooKeeperConnection Watcher:127.0.0.1:53957 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 3202042 T8079 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 3202042 T8079 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 3202057 T8079 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 3202062 T8102 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:53976/_k", [junit4] 2> "node_name":"127.0.0.1:53976__k", [junit4] 2> "numShards":"3", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard2", [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state"} [junit4] 2> 3202064 T8146 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9b753b name:ZooKeeperConnection Watcher:127.0.0.1:53957/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 3202065 T8079 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 3202086 T8079 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 3202196 T8106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 3202197 T8113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 3202197 T8127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 3202198 T8147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) [junit4] 2> 3203240 T8079 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53985__k [junit4] 2> 3203241 T8079 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53985__k [junit4] 2> 3203248 T8079 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 3203256 T8148 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1 [junit4] 2> 3203256 T8148 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 3203257 T8106 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 3203257 T8148 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 3203263 T8102 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:53985/_k", [junit4] 2> "node_name":"127.0.0.1:53985__k", [junit4] 2> "numShards":"3", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state"} [junit4] 2> 3203263 T8102 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3 [junit4] 2> 3203263 T8102 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3 [junit4] 2> 3203384 T8147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 3203384 T8127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 3203384 T8113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 3203384 T8106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 3204402 T8148 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 [junit4] 2> 3204402 T8148 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1 [junit4] 2> 3204404 T8148 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 3204404 T8148 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 3204407 T8148 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 3204407 T8148 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-004\collection1\' [junit4] 2> 3204410 T8148 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001/tempDir-004/collection1/lib/.svn/' to classloader [junit4] 2> 3204413 T8148 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001/tempDir-004/collection1/lib/classes/' to classloader [junit4] 2> 3204414 T8148 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001/tempDir-004/collection1/lib/README' to classloader [junit4] 2> 3204449 T8148 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 3204457 T8148 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 3204462 T8148 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 3204466 T8148 oass.IndexSchema.readSchema [collection1] Schema name=test [junit4] 2> 3204585 T8148 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 3204586 T8148 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 3204587 T8148 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 3204591 T8148 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 3204633 T8148 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1 [junit4] 2> 3204633 T8148 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory [junit4] 2> 3204633 T8148 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-004\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001/jetty2\ [junit4] 2> 3204634 T8148 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5e12a5 [junit4] 2> 3204637 T8148 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty2 [junit4] 2> 3204638 T8148 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001/jetty2\index/ [junit4] 2> 3204639 T8148 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty2\index' doesn't exist. Creating new index... [junit4] 2> 3204642 T8148 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty2\index [junit4] 2> 3204642 T8148 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=95.578125, floorSegmentMB=1.755859375, forceMergeDeletesPctAllowed=4.501162587699624, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 3204649 T8148 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1} [junit4] 2> 3204649 T8148 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 3204655 T8148 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 3204655 T8148 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 3204656 T8148 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 3204656 T8148 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 3204657 T8148 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 3204657 T8148 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 3204657 T8148 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 3204658 T8148 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 3204658 T8148 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 3204659 T8148 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 3204659 T8148 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 3204661 T8148 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 3204662 T8148 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 3204662 T8148 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 3204663 T8148 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 3204663 T8148 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 3204664 T8148 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 3204664 T8148 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 3204665 T8148 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 3204665 T8148 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 3204668 T8148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 3204672 T8148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 3204673 T8148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 3204675 T8148 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 3204678 T8148 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4] 2> 3204678 T8148 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4] 2> 3204679 T8148 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34845766228550723] [junit4] 2> 3204679 T8148 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1} [junit4] 2> 3204679 T8148 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 3204681 T8148 oass.SolrIndexSearcher.<init> Opening Searcher@afd28a[collection1] main [junit4] 2> 3204681 T8148 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 [junit4] 2> 3204683 T8148 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper [junit4] 2> 3204683 T8148 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 3204684 T8148 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 3204684 T8148 oasr.RestManager.init Initializing RestManager with initArgs: {} [junit4] 2> 3204684 T8148 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 3204687 T8148 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json [junit4] 2> 3204687 T8148 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 3204687 T8148 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed [junit4] 2> 3204687 T8148 oasr.RestManager.init Initializing 0 registered ManagedResources [junit4] 2> 3204691 T8149 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@afd28a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 3204693 T8148 oasc.CoreContainer.registerCore registering core: collection1 [junit4] 2> 3204694 T8152 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53985/_k collection:collection1 shard:shard3 [junit4] 2> 3204695 T8079 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0 [junit4] 2> 3204696 T8079 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 3204697 T8152 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election [junit4] 2> 3204712 T8152 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3 [junit4] 2> 3204716 T8106 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 3204720 T8152 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. [junit4] 2> 3204720 T8152 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync [junit4] 2> ASYNC NEW_CORE C4188 name=collection1 org.apache.solr.core.SolrCore@9616b0 url=http://127.0.0.1:53985/_k/collection1 node=127.0.0.1:53985__k C4188_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:53985/_k, node_name=127.0.0.1:53985__k, state=down} [junit4] 2> 3204720 T8152 C4188 P53985 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53985/_k/collection1/ [junit4] 2> 3204720 T8152 C4188 P53985 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me [junit4] 2> 3204720 T8152 C4188 P53985 oasc.SyncStrategy.syncToMe http://127.0.0.1:53985/_k/collection1/ has no replicas [junit4] 2> 3204721 T8152 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53985/_k/collection1/ shard3 [junit4] 2> 3204722 T8152 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3 [junit4] 2> 3204860 T8106 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 3205181 T8147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 3205182 T8106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 3205183 T8113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 3205184 T8127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 3205243 T8152 oasc.ZkController.register We are http://127.0.0.1:53985/_k/collection1/ and leader is http://127.0.0.1:53985/_k/collection1/ [junit4] 2> 3205243 T8152 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53985/_k [junit4] 2> 3205243 T8152 oasc.ZkController.checkRecovery I am the leader, no recovery necessary [junit4] 2> 3205243 T8152 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1 [junit4] 2> 3205243 T8152 oasc.ZkController.publish numShards not found on descriptor - reading it from system property [junit4] 2> 3205246 T8106 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 3205254 T8102 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node2", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:53985/_k", [junit4] 2> "node_name":"127.0.0.1:53985__k", [junit4] 2> "numShards":"3", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard3", [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state"} [junit4] 2> 3205375 T8147 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 3205377 T8106 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 3205377 T8113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 3205378 T8127 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) [junit4] 2> 3206628 T8079 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3 [junit4] 2> 3206629 T8079 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 3206634 T8079 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53994 [junit4] 2> 3206636 T8079 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 3206637 T8079 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 3206637 T8079 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-005 [junit4] 2> 3206637 T8079 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-005\' [junit4] 2> 3206674 T8079 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-005\solr.xml [junit4] 2> 3206688 T8079 oasc.CoreContainer.<init> New CoreContainer 24275585 [junit4] 2> 3206689 T8079 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-005\] [junit4] 2> 3206690 T8079 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 3206690 T8079 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 3206690 T8079 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 3206691 T8079 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 3206691 T8079 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 3206691 T8079 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 3206693 T8079 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 3206693 T8079 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 3206693 T8079 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 3206694 T8079 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 3206694 T8079 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 3206695 T8079 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 3206695 T8079 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 3206695 T8079 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53957/solr [junit4] 2> 3206696 T8079 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 3206696 T8079 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 3206698 T8079 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 3206700 T8163 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f63923 name:ZooKeeperConnection Watcher:127.0.0.1:53957 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 3206700 T8079 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 3206700 T8079 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 3206705 T8079 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 3206707 T8165 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1147efd name:ZooKeeperConnection Watcher:127.0.0.1:53957/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 3206707 T8079 oascc.ConnectionManag [...truncated too long message...] g tracked [junit4] 2> 3250860 T8079 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty3 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty3;done=false>>] [junit4] 2> 3250860 T8079 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty3 [junit4] 2> 3250860 T8079 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty3\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty3\index;done=false>>] [junit4] 2> 3250860 T8079 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001\tempDir-001\jetty3\index [junit4] 2> 3250860 T8079 oasc.Overseer.close Overseer (id=92571619126214666-127.0.0.1:53994__k-n_0000000003) closing [junit4] 2> 3250864 T8222 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:53994__k [junit4] 2> 3250872 T8081 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x148e165aa4d000a, likely client has closed socket [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228) [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) [junit4] 2> at java.lang.Thread.run(Thread.java:745) [junit4] 2> [junit4] 2> 3250873 T8166 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK [junit4] 2> 3250898 T8079 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/_k,null} [junit4] 2> 3257785 T8079 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 54003 [junit4] 2> 3257785 T8079 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch [junit4] 2> 3257788 T8079 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53957 53957 [junit4] 2> 3260830 T8080 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:53957 53957 [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.method=testDistribSearch -Dtests.seed=464AFC91D9F84B66 -Dtests.slow=true -Dtests.locale=hu_HU -Dtests.timezone=Indian/Comoro -Dtests.file.encoding=US-ASCII [junit4] FAILURE 68.4s | ChaosMonkeySafeLeaderTest.testDistribSearch <<< [junit4] > Throwable #1: java.lang.AssertionError: expected:<0> but was:<1> [junit4] > at __randomizedtesting.SeedInfo.seed([464AFC91D9F84B66:C7AC7289AEA72B5A]:0) [junit4] > at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:153) [junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] 2> 3260843 T8079 oas.SolrTestCaseJ4.deleteCore ###deleteCore [junit4] 2> NOTE: leaving temporary files on disk at: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-464AFC91D9F84B66-001 [junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {rnd_b=Lucene41(blocksize=128), _version_=PostingsFormat(name=MockRandom), a_t=PostingsFormat(name=Memory doPackFST= true), a_i=Lucene41(blocksize=128), id=Lucene41(blocksize=128)}, docValues:{}, sim=DefaultSimilarity, locale=hu_HU, timezone=Indian/Comoro [junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0_40-ea (32-bit)/cpus=2,threads=1,free=104698536,total=302206976 [junit4] 2> NOTE: All tests run in this JVM: [HdfsSyncSliceTest, CachingDirectoryFactoryTest, RequestHandlersTest, CoreMergeIndexesAdminHandlerTest, CustomCollectionTest, TestBM25SimilarityFactory, TestQuerySenderNoQuery, BasicDistributedZkTest, BadIndexSchemaTest, BlockCacheTest, CloudExitableDirectoryReaderTest, SimpleFacetsTest, TestIndexSearcher, XmlUpdateRequestHandlerTest, SliceStateTest, DirectSolrConnectionTest, ChangedSchemaMergeTest, BJQParserTest, HighlighterTest, DeleteLastCustomShardedReplicaTest, DocExpirationUpdateProcessorFactoryTest, TestManagedSynonymFilterFactory, ZkCLITest, ChaosMonkeyNothingIsSafeTest, SolrTestCaseJ4Test, TestRemoteStreaming, DefaultValueUpdateProcessorTest, TestMergePolicyConfig, TestLRUCache, CopyFieldTest, TestNRTOpen, AtomicUpdatesTest, PingRequestHandlerTest, TestAnalyzeInfixSuggestions, TestFieldResource, TestRandomMergePolicy, HighlighterConfigTest, TestFileDictionaryLookup, ReturnFieldsTest, DocValuesMultiTest, ReplicationFactorTest, DistributedQueryComponentOptimizationTest, TestSolrQueryParser, TestRTGBase, TestFoldingMultitermQuery, TestFastOutputStream, TestDynamicFieldResource, DistributedIntervalFacetingTest, TestReplicationHandler, TimeZoneUtilsTest, TestBadConfig, TestFiltering, TestManagedSchema, TestSchemaNameResource, AnalysisAfterCoreReloadTest, HighlighterMaxOffsetTest, TestBulkSchemaAPI, TestCloudSchemaless, DeleteInactiveReplicaTest, SharedFSAutoReplicaFailoverUtilsTest, TestSuggestSpellingConverter, TestRandomFaceting, XsltUpdateRequestHandlerTest, TestConfig, DistribCursorPagingTest, TestQueryTypes, TestSchemaResource, TestXIncludeConfig, AliasIntegrationTest, LukeRequestHandlerTest, TestZkChroot, TestLuceneMatchVersion, CollectionsAPIDistributedZkTest, OverseerTest, TestSimpleQParserPlugin, AsyncMigrateRouteKeyTest, TestCollectionAPI, TestReRankQParserPlugin, SolrCoreTest, TestFaceting, CoreAdminHandlerTest, TestLeaderElectionZkExpiry, LeaderElectionTest, DocumentBuilderTest, OverseerCollectionProcessorTest, ShowFileRequestHandlerTest, EnumFieldTest, DistributedQueryElevationComponentTest, TestDistributedSearch, TestMultiCoreConfBootstrap, HdfsBasicDistributedZk2Test, ResourceLoaderTest, TestSearcherReuse, UnloadDistributedZkTest, SortByFunctionTest, TestExceedMaxTermLength, TestWordDelimiterFilterFactory, SignatureUpdateProcessorFactoryTest, HardAutoCommitTest, RecoveryZkTest, DistribDocExpirationUpdateProcessorTest, FullSolrCloudDistribCmdsTest, CollectionsAPIAsyncDistributedZkTest, SuggesterFSTTest, DistributedFacetPivotSmallTest, MBeansHandlerTest, TestDocSet, TestCollationFieldDocValues, EchoParamsTest, TestDFRSimilarityFactory, TestCharFilters, SuggesterWFSTTest, TestMaxScoreQueryParser, TestInitQParser, TestManagedResourceStorage, PreAnalyzedFieldTest, CoreAdminRequestStatusTest, OpenExchangeRatesOrgProviderTest, TestSerializedLuceneMatchVersion, OutputWriterTest, TestWriterPerf, ConnectionManagerTest, TestBinaryField, DistributedSuggestComponentTest, StandardRequestHandlerTest, TestBinaryResponseWriter, TestManagedStopFilterFactory, OutOfBoxZkACLAndCredentialsProvidersTest, TestDefaultSearchFieldResource, PreAnalyzedUpdateProcessorTest, SystemInfoHandlerTest, DocumentAnalysisRequestHandlerTest, TestChildDocTransformer, AlternateDirectoryTest, TestIntervalFaceting, TestPivotHelperCode, TestSolrQueryParserResource, TestJmxIntegration, TestModifyConfFiles, JsonLoaderTest, DocValuesTest, TestShortCircuitedRequests, TestRandomDVFaceting, SyncSliceTest, AutoCommitTest, DistributedFacetPivotLongTailTest, SchemaVersionSpecificBehaviorTest, IndexBasedSpellCheckerTest, CursorPagingTest, DeleteReplicaTest, TestIndexingPerformance, HdfsDirectoryTest, TestJoin, SuggestComponentTest, TestHighlightDedupGrouping, ClusterStateUpdateTest, AddBlockUpdateTest, DateRangeFieldTest, SuggesterTSTTest, TestSolrIndexConfig, CSVRequestHandlerTest, TestStressUserVersions, TestRealTimeGet, CoreContainerCoreInitFailuresTest, QueryElevationComponentTest, AnalyticsQueryTest, OpenCloseCoreStressTest, PeerSyncTest, IndexSchemaRuntimeFieldTest, DistributedExpandComponentTest, ChaosMonkeySafeLeaderTest] [junit4] Completed in 68.41s, 1 test, 1 failure <<< FAILURES! [...truncated 838 lines...] BUILD FAILED C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:524: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:472: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:61: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\extra-targets.xml:39: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build.xml:189: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\common-build.xml:496: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:1360: The following error occurred while executing this line: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:962: There were test failures: 436 suites, 1784 tests, 1 failure, 53 ignored (31 assumptions) Total time: 160 minutes 58 seconds Build step 'Invoke Ant' marked build as failure [description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b04 -server -XX:+UseSerialGC Archiving artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org