Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/11318/ Java: 32bit/jdk1.9.0-ea-b34 -server -XX:+UseG1GC
1 tests failed. REGRESSION: org.apache.solr.cloud.DeleteReplicaTest.testDistribSearch Error Message: No live SolrServers available to handle this request:[https://127.0.0.1:53322, https://127.0.0.1:33192, https://127.0.0.1:52307, https://127.0.0.1:40160, https://127.0.0.1:37102] Stack Trace: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:53322, https://127.0.0.1:33192, https://127.0.0.1:52307, https://127.0.0.1:40160, https://127.0.0.1:37102] at __randomizedtesting.SeedInfo.seed([AA540500A5C769ED:2BB28B18D29809D1]:0) at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:333) at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:1015) at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:793) at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:736) at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:172) at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:145) at org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:89) at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869) at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738) at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not remove replica : delLiveColl/shard1/core_node2 at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:569) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211) at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:354) at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:313) ... 46 more Build Log: [...truncated 11917 lines...] [junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest [junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/init-core-data-001 [junit4] 2> 2177574 T7455 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true) [junit4] 2> 2177574 T7455 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: / [junit4] 2> 2177576 T7455 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch [junit4] 2> 2177576 T7455 oasc.ZkTestServer.run STARTING ZK TEST SERVER [junit4] 1> client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 2177577 T7456 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server [junit4] 2> 2177677 T7455 oasc.ZkTestServer.run start zk server on port:58848 [junit4] 2> 2177677 T7455 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2177678 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2177680 T7462 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d4b33e name:ZooKeeperConnection Watcher:127.0.0.1:58848 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2177680 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2177680 T7455 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2177680 T7455 oascc.SolrZkClient.makePath makePath: /solr [junit4] 2> 2177683 T7455 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2177683 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2177684 T7464 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@94ef7 name:ZooKeeperConnection Watcher:127.0.0.1:58848/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2177684 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2177684 T7455 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2177685 T7455 oascc.SolrZkClient.makePath makePath: /collections/collection1 [junit4] 2> 2177686 T7455 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards [junit4] 2> 2177687 T7455 oascc.SolrZkClient.makePath makePath: /collections/control_collection [junit4] 2> 2177688 T7455 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards [junit4] 2> 2177689 T7455 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 2177690 T7455 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml [junit4] 2> 2177693 T7455 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 2177693 T7455 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml [junit4] 2> 2177695 T7455 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 2177696 T7455 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 2177697 T7455 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 2177698 T7455 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt [junit4] 2> 2177700 T7455 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 2177700 T7455 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt [junit4] 2> 2177702 T7455 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 2177702 T7455 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml [junit4] 2> 2177704 T7455 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 2177704 T7455 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 2177705 T7455 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 2177706 T7455 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 2177707 T7455 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 2177708 T7455 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 2177709 T7455 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 2177710 T7455 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 2177711 T7455 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 2177711 T7455 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt [junit4] 2> 2177713 T7455 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2177714 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2177714 T7466 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d8e752 name:ZooKeeperConnection Watcher:127.0.0.1:58848/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2177714 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2177715 T7455 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2177974 T7455 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 2177977 T7455 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 2177979 T7455 oejs.AbstractConnector.doStart Started [email protected]:40160 [junit4] 2> 2177981 T7455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 2177981 T7455 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 2177982 T7455 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002 [junit4] 2> 2177982 T7455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002/' [junit4] 2> 2177994 T7455 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002/solr.xml [junit4] 2> 2177999 T7455 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002 [junit4] 2> 2178000 T7455 oasc.CoreContainer.<init> New CoreContainer 7895406 [junit4] 2> 2178000 T7455 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002/] [junit4] 2> 2178000 T7455 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 2178001 T7455 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 2178001 T7455 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 2178001 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 2178002 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 2178002 T7455 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 2178002 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 2178003 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 2178003 T7455 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 2178003 T7455 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 2178004 T7455 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 2178005 T7455 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 2178005 T7455 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 2178006 T7455 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 2178006 T7455 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58848/solr [junit4] 2> 2178006 T7455 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 2178007 T7455 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2178007 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2178008 T7477 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e2512 name:ZooKeeperConnection Watcher:127.0.0.1:58848 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2178008 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2178009 T7455 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2178010 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2178010 T7479 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bcd651 name:ZooKeeperConnection Watcher:127.0.0.1:58848/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2178011 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2178011 T7455 oascc.SolrZkClient.makePath makePath: /overseer/queue [junit4] 2> 2178013 T7455 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work [junit4] 2> 2178014 T7455 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running [junit4] 2> 2178016 T7455 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed [junit4] 2> 2178017 T7455 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure [junit4] 2> 2178018 T7455 oascc.SolrZkClient.makePath makePath: /live_nodes [junit4] 2> 2178019 T7455 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40160_ [junit4] 2> 2178020 T7455 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40160_ [junit4] 2> 2178021 T7455 oascc.SolrZkClient.makePath makePath: /overseer_elect [junit4] 2> 2178022 T7455 oascc.SolrZkClient.makePath makePath: /overseer_elect/election [junit4] 2> 2178023 T7455 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 2178024 T7455 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:40160_ [junit4] 2> 2178024 T7455 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader [junit4] 2> 2178025 T7455 oasc.Overseer.start Overseer (id=92644461074251780-127.0.0.1:40160_-n_0000000000) starting [junit4] 2> 2178027 T7455 oascc.SolrZkClient.makePath makePath: /overseer/queue-work [junit4] 2> 2178031 T7455 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 2178031 T7481 oasc.OverseerCollectionProcessor.run Process current queue of collection creations [junit4] 2> 2178032 T7455 oascc.SolrZkClient.makePath makePath: /clusterstate.json [junit4] 2> 2178033 T7455 oascc.SolrZkClient.makePath makePath: /aliases.json [junit4] 2> 2178033 T7455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 2178035 T7480 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue [junit4] 2> 2178036 T7455 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002 [junit4] 2> 2178042 T7455 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002/conf/ [junit4] 2> 2178163 T7455 oasc.CorePropertiesLocator.discover Found 1 core definitions [junit4] 2> 2178164 T7455 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0 [junit4] 2> 2178164 T7455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 2178166 T7455 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2178166 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2178167 T7485 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50a8fc name:ZooKeeperConnection Watcher:127.0.0.1:58848/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2178167 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2178168 T7455 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2178168 T7455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 2178170 T7455 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 2178171 T7455 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2 [junit4] 2> 2178171 T7455 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2178171 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2178174 T7487 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e34b81 name:ZooKeeperConnection Watcher:127.0.0.1:58848/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2178174 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2178174 T7455 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2178176 T7488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 2178178 T7480 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1 [junit4] 2> 2178178 T7480 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2] [junit4] 2> 2178178 T7480 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2 [junit4] 2> 2178180 T7480 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json [junit4] 2> 2178180 T7488 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2178182 T7489 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) [junit4] 2> 2178434 T7455 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 [junit4] 2> 2178435 T7455 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 2178437 T7455 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 2178438 T7455 oejs.AbstractConnector.doStart Started [email protected]:33192 [junit4] 2> 2178440 T7455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 2178440 T7455 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 2178440 T7455 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003 [junit4] 2> 2178441 T7455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003/' [junit4] 2> 2178452 T7455 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003/solr.xml [junit4] 2> 2178457 T7455 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003 [junit4] 2> 2178458 T7455 oasc.CoreContainer.<init> New CoreContainer 7845920 [junit4] 2> 2178458 T7455 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003/] [junit4] 2> 2178458 T7455 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 2178459 T7455 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 2178459 T7455 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 2178459 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 2178460 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 2178460 T7455 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 2178460 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 2178460 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 2178461 T7455 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 2178461 T7455 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 2178462 T7455 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 2178463 T7455 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 2178463 T7455 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 2178464 T7455 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 2178464 T7455 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58848/solr [junit4] 2> 2178464 T7455 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 2178464 T7455 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2178465 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2178466 T7500 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d6cac9 name:ZooKeeperConnection Watcher:127.0.0.1:58848 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2178466 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2178467 T7455 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2178468 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2178469 T7502 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@762183 name:ZooKeeperConnection Watcher:127.0.0.1:58848/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2178469 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2178473 T7455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 2179476 T7455 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33192_ [junit4] 2> 2179477 T7455 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33192_ [junit4] 2> 2179480 T7455 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 2179482 T7455 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003 [junit4] 2> 2179499 T7455 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003/conf/ [junit4] 2> 2179626 T7455 oasc.CorePropertiesLocator.discover Found 1 core definitions [junit4] 2> 2179628 T7455 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0 [junit4] 2> 2179628 T7455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 2179885 T7455 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 [junit4] 2> 2179885 T7455 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 2179889 T7455 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 2179890 T7455 oejs.AbstractConnector.doStart Started [email protected]:37102 [junit4] 2> 2179891 T7455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 2179891 T7455 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 2179892 T7455 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-004 [junit4] 2> 2179892 T7455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-004/' [junit4] 2> 2179903 T7455 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-004/solr.xml [junit4] 2> 2179909 T7455 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-004 [junit4] 2> 2179909 T7455 oasc.CoreContainer.<init> New CoreContainer 12521142 [junit4] 2> 2179909 T7455 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-004/] [junit4] 2> 2179910 T7455 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 2179910 T7455 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 2179911 T7455 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 2179911 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 2179911 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 2179912 T7455 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 2179912 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 2179912 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 2179912 T7455 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 2179913 T7455 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 2179914 T7455 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 2179915 T7455 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 2179915 T7455 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 2179915 T7455 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 2179916 T7455 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58848/solr [junit4] 2> 2179916 T7455 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 2179916 T7455 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2179917 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2179918 T7515 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@721610 name:ZooKeeperConnection Watcher:127.0.0.1:58848 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2179918 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2179918 T7455 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2179920 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2179921 T7517 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14b5509 name:ZooKeeperConnection Watcher:127.0.0.1:58848/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2179921 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2179925 T7455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 2180929 T7455 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37102_ [junit4] 2> 2180931 T7455 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37102_ [junit4] 2> 2180935 T7455 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 2180938 T7455 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-004 [junit4] 2> 2180947 T7455 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-004/conf/ [junit4] 2> 2181069 T7455 oasc.CorePropertiesLocator.discover Found 1 core definitions [junit4] 2> 2181070 T7455 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0 [junit4] 2> 2181071 T7455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 2181326 T7455 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3 [junit4] 2> 2181327 T7455 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 2181329 T7455 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 2181330 T7455 oejs.AbstractConnector.doStart Started [email protected]:53322 [junit4] 2> 2181332 T7455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 2181332 T7455 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 2181332 T7455 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-005 [junit4] 2> 2181333 T7455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-005/' [junit4] 2> 2181344 T7455 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-005/solr.xml [junit4] 2> 2181349 T7455 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-005 [junit4] 2> 2181350 T7455 oasc.CoreContainer.<init> New CoreContainer 612642 [junit4] 2> 2181350 T7455 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-005/] [junit4] 2> 2181351 T7455 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 2181351 T7455 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 2181352 T7455 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 2181352 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 2181352 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 2181353 T7455 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 2181353 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 2181353 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 2181353 T7455 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 2181354 T7455 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 2181355 T7455 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 2181356 T7455 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 2181356 T7455 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 2181356 T7455 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 2181357 T7455 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58848/solr [junit4] 2> 2181357 T7455 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 2181358 T7455 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2181358 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2181359 T7530 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12f85fa name:ZooKeeperConnection Watcher:127.0.0.1:58848 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2181359 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2181360 T7455 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2181361 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2181362 T7532 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@721d73 name:ZooKeeperConnection Watcher:127.0.0.1:58848/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2181363 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2181366 T7455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 2182369 T7455 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53322_ [junit4] 2> 2182371 T7455 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53322_ [junit4] 2> 2182376 T7455 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 2182379 T7455 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-005 [junit4] 2> 2182387 T7455 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-005/conf/ [junit4] 2> 2182512 T7455 oasc.CorePropertiesLocator.discover Found 1 core definitions [junit4] 2> 2182513 T7455 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0 [junit4] 2> 2182513 T7455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 2182768 T7455 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4 [junit4] 2> 2182769 T7455 oejs.Server.doStart jetty-8.1.10.v20130312 [junit4] 2> 2182772 T7455 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] [junit4] 2> 2182773 T7455 oejs.AbstractConnector.doStart Started [email protected]:52307 [junit4] 2> 2182775 T7455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() [junit4] 2> 2182775 T7455 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 2182775 T7455 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-006 [junit4] 2> 2182776 T7455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-006/' [junit4] 2> 2182787 T7455 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-006/solr.xml [junit4] 2> 2182793 T7455 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-006 [junit4] 2> 2182793 T7455 oasc.CoreContainer.<init> New CoreContainer 33076284 [junit4] 2> 2182794 T7455 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-006/] [junit4] 2> 2182794 T7455 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 [junit4] 2> 2182795 T7455 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: [junit4] 2> 2182795 T7455 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 [junit4] 2> 2182795 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 [junit4] 2> 2182795 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000 [junit4] 2> 2182796 T7455 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 [junit4] 2> 2182796 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 [junit4] 2> 2182796 T7455 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 [junit4] 2> 2182797 T7455 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 [junit4] 2> 2182797 T7455 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false [junit4] 2> 2182798 T7455 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false [junit4] 2> 2182799 T7455 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 2182799 T7455 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 2182800 T7455 oasc.CoreContainer.load Host Name: 127.0.0.1 [junit4] 2> 2182800 T7455 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58848/solr [junit4] 2> 2182800 T7455 oasc.ZkController.checkChrootPath zkHost includes chroot [junit4] 2> 2182801 T7455 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2182802 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2182803 T7545 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f712f name:ZooKeeperConnection Watcher:127.0.0.1:58848 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2182803 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2182803 T7455 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2182805 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2182805 T7547 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@147f53c name:ZooKeeperConnection Watcher:127.0.0.1:58848/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2182806 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2182811 T7455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 2183814 T7455 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52307_ [junit4] 2> 2183816 T7455 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52307_ [junit4] 2> 2183820 T7455 oasc.Overseer.close Overseer (id=null) closing [junit4] 2> 2183824 T7455 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-006 [junit4] 2> 2183829 T7455 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-006/conf/ [junit4] 2> 2183948 T7455 oasc.CorePropertiesLocator.discover Found 1 core definitions [junit4] 2> 2183949 T7455 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0 [junit4] 2> 2183949 T7455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done [junit4] 2> 2183952 T7455 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2183953 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2183954 T7551 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dbf762 name:ZooKeeperConnection Watcher:127.0.0.1:58848/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2183954 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2183955 T7455 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2183956 T7455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 2183958 T7455 oasc.AbstractFullDistribZkTestBase.createCollection Creating collection with stateFormat=2: delLiveColl [junit4] 2> 2183958 T7455 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider [junit4] 2> 2183959 T7455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper [junit4] 2> 2183960 T7553 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ac6761 name:ZooKeeperConnection Watcher:127.0.0.1:58848/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 2183960 T7455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper [junit4] 2> 2183960 T7455 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider [junit4] 2> 2183961 T7455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... [junit4] 2> 2184041 T7542 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&maxShardsPerNode=2&name=delLiveColl&action=CREATE&numShards=2&stateFormat=2&wt=javabin&version=2 [junit4] 2> 2184042 T7488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged [junit4] 2> 2184043 T7481 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{ [junit4] 2> "operation":"create", [junit4] 2> "fromApi":"true", [junit4] 2> "name":"delLiveColl", [junit4] 2> "replicationFactor":"2", [junit4] 2> "numShards":"2", [junit4] 2> "maxShardsPerNode":"2", [junit4] 2> "stateFormat":"2"} [junit4] 2> 2184043 T7554 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , { [junit4] 2> "operation":"create", [junit4] 2> "fromApi":"true", [junit4] 2> "name":"delLiveColl", [junit4] 2> "replicationFactor":"2", [junit4] 2> "numShards":"2", [junit4] 2> "maxShardsPerNode":"2", [junit4] 2> "stateFormat":"2"} [junit4] 2> 2184044 T7554 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1 [junit4] 2> 2184045 T7554 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/delLiveColl [junit4] 2> 2184045 T7554 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl [junit4] 2> 2184047 T7488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 2184049 T7480 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: delLiveColl [junit4] 2> 2184049 T7480 oasc.Overseer$ClusterStateUpdater.createCollection Create collection delLiveColl with shards [shard1, shard2] [junit4] 2> 2184049 T7480 oasc.Overseer$ClusterStateUpdater.createCollection state version delLiveColl 2 [junit4] 2> 2184050 T7480 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/delLiveColl/state.json [junit4] 2> 2184051 T7533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 2184051 T7488 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 2184051 T7489 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 2184051 T7548 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 2184051 T7518 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 2184051 T7555 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 2184051 T7503 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 2184054 T7556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5) [junit4] 2> 2184147 T7554 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection delLiveColl, shardNames [shard1, shard2] , replicationFactor : 2 [junit4] 2> 2184147 T7554 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica1 as part of slice shard1 of collection delLiveColl on 127.0.0.1:52307_ [junit4] 2> 2184148 T7554 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica2 as part of slice shard1 of collection delLiveColl on 127.0.0.1:40160_ [junit4] 2> 2184149 T7554 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica1 as part of slice shard2 of collection delLiveColl on 127.0.0.1:33192_ [junit4] 2> 2184154 T7554 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica2 as part of slice shard2 of collection delLiveColl on 127.0.0.1:37102_ [junit4] 2> 2184237 T7496 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard2_replica1&action=CREATE&numShards=2&collection=delLiveColl&shard=shard2&wt=javabin&version=2 [junit4] 2> 2184239 T7496 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica1 state=down collection=delLiveColl [junit4] 2> 2184240 T7488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 2184241 T7496 oasc.ZkController.preRegister Registering watch for external collection delLiveColl [junit4] 2> 2184241 T7496 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl [junit4] 2> 2184242 T7496 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper... [junit4] 2> 2184245 T7475 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard1_replica2&action=CREATE&numShards=2&collection=delLiveColl&shard=shard1&wt=javabin&version=2 [junit4] 2> 2184245 T7496 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0 [junit4] 2> 2184245 T7496 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 2184246 T7480 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={ [junit4] 2> "core":"delLiveColl_shard2_replica1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"https://127.0.0.1:33192", [junit4] 2> "node_name":"127.0.0.1:33192_", [junit4] 2> "numShards":"2", [junit4] 2> "state":"down", [junit4] 2> "shard":"shard2", [junit4] 2> "collection":"delLiveColl", [junit4] 2> "operation":"state"} [junit4] 2> 2184247 T7475 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica2 state=down collection=delLiveColl [junit4] 2> 2184249 T7475 oasc.ZkController.preRegister Registering watch for external collection delLiveColl [junit4] 2> 2184250 T7480 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json [junit4] 2> 2184251 T7503 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 2184252 T7503 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1 [junit4] 2> 2184252 T7475 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl [junit4] 2> 2184253 T7475 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper... [junit4] 2> 2184254 T7475 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1 [junit4] 2> 2184254 T7475 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 2184256 T7480 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1 [junit4] 2> 2184257 T7480 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={ [junit4] 2> "core":"delLiveColl_shard1_replica2", [junit4] 2> "roles":null, [junit4] 2> "base_url":"https://127.0.0.1:40160", [junit4] 2> "node_name":"127.0.0.1:40160_", [junit4] 2> "numShards":"2", [junit4] 2> "state":"down", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"delLiveColl", [junit4] 2> "operation":"state"} [junit4] 2> 2184258 T7480 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json [junit4] 2> 2184258 T7503 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 2184259 T7561 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 2184260 T7503 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 [junit4] 2> 2184260 T7488 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 2184260 T7513 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard2_replica2&action=CREATE&numShards=2&collection=delLiveColl&shard=shard2&wt=javabin&version=2 [junit4] 2> 2184261 T7561 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 [junit4] 2> 2184262 T7543 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard1_replica1&action=CREATE&numShards=2&collection=delLiveColl&shard=shard1&wt=javabin&version=2 [junit4] 2> 2184262 T7513 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica2 state=down collection=delLiveColl [junit4] 2> 2184263 T7561 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 2184264 T7543 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica1 state=down collection=delLiveColl [junit4] 2> 2184264 T7513 oasc.ZkController.preRegister Registering watch for external collection delLiveColl [junit4] 2> 2184264 T7513 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl [junit4] 2> 2184265 T7513 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper... [junit4] 2> 2184265 T7543 oasc.ZkController.preRegister Registering watch for external collection delLiveColl [junit4] 2> 2184266 T7543 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl [junit4] 2> 2184266 T7543 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper... [junit4] 2> 2184266 T7513 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 [junit4] 2> 2184267 T7513 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 2184267 T7543 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 [junit4] 2> 2184267 T7480 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 [junit4] 2> 2184267 T7543 oasc.ZkController.waitForCoreNodeName look for our core node name [junit4] 2> 2184267 T7480 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={ [junit4] 2> "core":"delLiveColl_shard2_replica2", [junit4] 2> "roles":null, [junit4] 2> "base_url":"https://127.0.0.1:37102", [junit4] 2> "node_name":"127.0.0.1:37102_", [junit4] 2> "numShards":"2", [junit4] 2> "state":"down", [junit4] 2> "shard":"shard2", [junit4] 2> "collection":"delLiveColl", [junit4] 2> "operation":"state"} [junit4] 2> 2184269 T7480 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json [junit4] 2> 2184269 T7548 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 2184270 T7561 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 2184270 T7503 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 2184270 T7518 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 2184270 T7548 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 [junit4] 2> 2184271 T7503 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 [junit4] 2> 2184271 T7518 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 [junit4] 2> 2184271 T7561 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 [junit4] 2> 2184273 T7480 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 [junit4] 2> 2184273 T7480 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={ [junit4] 2> "core":"delLiveColl_shard1_replica1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"https://127.0.0.1:52307", [junit4] 2> "node_name":"127.0.0.1:52307_", [junit4] 2> "numShards":"2", [junit4] 2> "state":"down", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"delLiveColl", [junit4] 2> "operation":"state"} [junit4] 2> 2184274 T7561 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged [junit4] 2> 2184275 T7480 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json [junit4] 2> 2184275 T7548 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 2184275 T7518 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 2184275 T7503 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 2184276 T7561 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... [junit4] 2> 2184276 T7518 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 [junit4] 2> 2184276 T7548 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 [junit4] 2> 2184276 T7503 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 [junit4] 2> 2184278 T7561 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 [junit4] 2> 2185246 T7496 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica1 [junit4] 2> 2185246 T7496 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl [junit4] 2> 2185247 T7496 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 2185247 T7496 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl [junit4] 2> 2185248 T7496 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper [junit4] 2> 2185248 T7496 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003/delLiveColl_shard2_replica1/' [junit4] 2> 2185255 T7475 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica2 [junit4] 2> 2185255 T7475 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl [junit4] 2> 2185256 T7475 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 2185257 T7475 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl [junit4] 2> 2185258 T7475 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper [junit4] 2> 2185258 T7475 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002/delLiveColl_shard1_replica2/' [junit4] 2> 2185267 T7513 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica2 [junit4] 2> 2185268 T7513 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl [junit4] 2> 2185268 T7543 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica1 [junit4] 2> 2185268 T7513 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 2185269 T7513 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl [junit4] 2> 2185268 T7543 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl [junit4] 2> 2185269 T7513 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper [junit4] 2> 2185270 T7513 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-004/delLiveColl_shard2_replica2/' [junit4] 2> 2185276 T7496 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 2185281 T7543 oasc.ZkController.createCollectionZkNode Collection zkNode exists [junit4] 2> 2185282 T7543 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl [junit4] 2> 2185282 T7475 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 2185283 T7543 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper [junit4] 2> 2185284 T7543 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-006/delLiveColl_shard1_replica1/' [junit4] 2> 2185289 T7496 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 2185290 T7496 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 2185294 T7475 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 2185295 T7496 oass.IndexSchema.readSchema [delLiveColl_shard2_replica1] Schema name=test [junit4] 2> 2185295 T7475 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 2185302 T7475 oass.IndexSchema.readSchema [delLiveColl_shard1_replica2] Schema name=test [junit4] 2> 2185304 T7513 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 2185308 T7543 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0 [junit4] 2> 2185319 T7513 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 2185320 T7513 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 2185324 T7543 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml [junit4] 2> 2185326 T7543 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml [junit4] 2> 2185329 T7513 oass.IndexSchema.readSchema [delLiveColl_shard2_replica2] Schema name=test [junit4] 2> 2185336 T7543 oass.IndexSchema.readSchema [delLiveColl_shard1_replica1] Schema name=test [junit4] 2> 2185413 T7496 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 2185434 T7496 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 2185436 T7496 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 2185446 T7496 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2185449 T7496 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2185450 T7475 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 2185452 T7496 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 2185453 T7475 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 2185453 T7496 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 2185456 T7496 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 2185457 T7475 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 2185457 T7496 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 2185462 T7496 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 2185463 T7496 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 2185463 T7496 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard2_replica1' using configuration from collection delLiveColl [junit4] 2> 2185464 T7496 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory [junit4] 2> 2185464 T7496 oasc.SolrCore.<init> [delLiveColl_shard2_replica1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003/delLiveColl_shard2_replica1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003/delLiveColl_shard2_replica1/data/ [junit4] 2> 2185465 T7496 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e2f93b [junit4] 2> 2185466 T7496 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003/delLiveColl_shard2_replica1/data [junit4] 2> 2185466 T7496 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003/delLiveColl_shard2_replica1/data/index/ [junit4] 2> 2185467 T7496 oasc.SolrCore.initIndex WARN [delLiveColl_shard2_replica1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003/delLiveColl_shard2_replica1/data/index' doesn't exist. Creating new index... [junit4] 2> 2185467 T7496 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-003/delLiveColl_shard2_replica1/data/index [junit4] 2> 2185468 T7496 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1978617540, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1] [junit4] 2> 2185468 T7475 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2185469 T7496 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-169048d)),segFN=segments_1,generation=1} [junit4] 2> 2185470 T7496 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 2185473 T7475 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2185473 T7496 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 2185474 T7496 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 2185475 T7496 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 2185475 T7496 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 2185476 T7496 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 2185476 T7496 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 2185476 T7475 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 2185477 T7496 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 2185477 T7496 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 2185478 T7496 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 2185477 T7475 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 2185479 T7475 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 2185478 T7496 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2185479 T7475 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 2185479 T7496 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2185480 T7475 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 2185480 T7475 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 2185480 T7496 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2185481 T7475 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard1_replica2' using configuration from collection delLiveColl [junit4] 2> 2185482 T7496 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 2185482 T7475 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory [junit4] 2> 2185482 T7496 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 2185483 T7496 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 2185482 T7475 oasc.SolrCore.<init> [delLiveColl_shard1_replica2] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002/delLiveColl_shard1_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002/delLiveColl_shard1_replica2/data/ [junit4] 2> 2185483 T7496 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 2185483 T7475 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e2f93b [junit4] 2> 2185484 T7496 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 2185484 T7513 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 2185485 T7475 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002/delLiveColl_shard1_replica2/data [junit4] 2> 2185485 T7496 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 2185485 T7475 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002/delLiveColl_shard1_replica2/data/index/ [junit4] 2> 2185486 T7496 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 2185486 T7475 oasc.SolrCore.initIndex WARN [delLiveColl_shard1_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002/delLiveColl_shard1_replica2/data/index' doesn't exist. Creating new index... [junit4] 2> 2185486 T7496 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 2185487 T7475 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-002/delLiveColl_shard1_replica2/data/index [junit4] 2> 2185489 T7475 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1978617540, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1] [junit4] 2> 2185490 T7475 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-1a3755)),segFN=segments_1,generation=1} [junit4] 2> 2185490 T7475 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 2185490 T7513 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 2185490 T7496 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2185492 T7496 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2185492 T7513 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 2185493 T7496 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2185494 T7475 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" [junit4] 2> 2185494 T7475 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" [junit4] 2> 2185495 T7496 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2185495 T7475 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 2185496 T7475 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" [junit4] 2> 2185496 T7475 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 2185496 T7543 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 2185497 T7496 oasu.CommitTracker.<init> Hard AutoCommit: disabled [junit4] 2> 2185497 T7475 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 2185497 T7496 oasu.CommitTracker.<init> Soft AutoCommit: disabled [junit4] 2> 2185498 T7475 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 2185498 T7496 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=15, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=69.2626953125, floorSegmentMB=0.4560546875, forceMergeDeletesPctAllowed=17.681793480721325, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0 [junit4] 2> 2185498 T7475 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 2185499 T7475 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 2185499 T7496 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-169048d)),segFN=segments_1,generation=1} [junit4] 2> 2185499 T7475 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2185499 T7543 oass.IndexSchema.readSchema default search field in schema is text [junit4] 2> 2185499 T7496 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 [junit4] 2> 2185500 T7475 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2185501 T7496 oass.SolrIndexSearcher.<init> Opening Searcher@2dcf21[delLiveColl_shard2_replica1] main [junit4] 2> 2185501 T7475 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler [junit4] 2> 2185501 T7543 oass.IndexSchema.readSchema unique key field: id [junit4] 2> 2185501 T7496 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl [junit4] 2> 2185502 T7475 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler [junit4] 2> 2185503 T7475 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler [junit4] 2> 2185503 T7475 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler [junit4] 2> 2185503 T7496 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper [junit4] 2> 2185504 T7496 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 2185504 T7475 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler [junit4] 2> 2185505 T7513 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2185505 T7475 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler [junit4] 2> 2185505 T7496 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 2185506 T7475 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers [junit4] 2> 2185506 T7496 oasr.RestManager.init Initializing RestManager with initArgs: {} [junit4] 2> 2185506 T7475 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler [junit4] 2> 2185507 T7496 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2185507 T7475 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler [junit4] 2> 2185507 T7513 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2185508 T7496 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 2185508 T7496 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2185508 T7475 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2185509 T7496 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json [junit4] 2> 2185509 T7543 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2185510 T7475 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2185510 T7513 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 2185510 T7496 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json [junit4] 2> 2185511 T7496 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 2185511 T7475 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2185511 T7496 oasr.RestManager.init Initializing 0 registered ManagedResources [junit4] 2> 2185511 T7513 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE [junit4] 2> 2185512 T7513 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING [junit4] 2> 2185511 T7543 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml [junit4] 2> 2185512 T7513 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json [junit4] 2> 2185512 T7475 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 [junit4] 2> 2185513 T7562 oasc.SolrCore.registerSearcher [delLiveColl_shard2_replica1] Registered new searcher Searcher@2dcf21[delLiveColl_shard2_replica1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 2185514 T7513 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPOR [...truncated too long message...] /jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-006/delLiveColl_shard1_replica1/data/index [junit4] 2> 2391490 T7455 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-006/delLiveColl_shard1_replica1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-006/delLiveColl_shard1_replica1/data;done=false>>] [junit4] 2> 2391490 T7455 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001/tempDir-006/delLiveColl_shard1_replica1/data [junit4] 2> 2391491 T7455 oasc.Overseer.close Overseer (id=92644461074251790-127.0.0.1:52307_-n_0000000004) closing [junit4] 2> 2391492 T7608 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:52307_ [junit4] 2> 2391495 T7607 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK [junit4] 2> 2391520 T7455 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null} [junit4] 2> 2396508 T7455 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch [junit4] 2> 2396510 T7455 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:58848 58848 [junit4] 2> 2397052 T7456 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:58848 58848 [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DeleteReplicaTest -Dtests.method=testDistribSearch -Dtests.seed=AA540500A5C769ED -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr_RS_#Latn -Dtests.timezone=Australia/Adelaide -Dtests.file.encoding=UTF-8 [junit4] ERROR 219s J0 | DeleteReplicaTest.testDistribSearch <<< [junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:53322, https://127.0.0.1:33192, https://127.0.0.1:52307, https://127.0.0.1:40160, https://127.0.0.1:37102] [junit4] > at __randomizedtesting.SeedInfo.seed([AA540500A5C769ED:2BB28B18D29809D1]:0) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:333) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:1015) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:793) [junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:736) [junit4] > at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:172) [junit4] > at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:145) [junit4] > at org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:89) [junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869) [junit4] > at java.lang.Thread.run(Thread.java:745) [junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not remove replica : delLiveColl/shard1/core_node2 [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:569) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215) [junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:354) [junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:313) [junit4] > ... 46 more [junit4] 2> 2397071 T7455 oas.SolrTestCaseJ4.deleteCore ###deleteCore [junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-AA540500A5C769ED-001 [junit4] 2> 219500 T7454 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s). [junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=sr_RS_#Latn, timezone=Australia/Adelaide [junit4] 2> NOTE: Linux 3.13.0-37-generic i386/Oracle Corporation 1.9.0-ea (32-bit)/cpus=8,threads=1,free=302794760,total=536870912 [junit4] 2> NOTE: All tests run in this JVM: [TestSystemIdResolver, EchoParamsTest, BlockDirectoryTest, TestClassNameShortening, TestFieldCollectionResource, AddBlockUpdateTest, TestWordDelimiterFilterFactory, NotRequiredUniqueKeyTest, ShardSplitTest, TestSolrJ, DeleteShardTest, TestConfigSets, TestRestManager, HdfsWriteToMultipleCollectionsTest, TestLMJelinekMercerSimilarityFactory, SpellCheckComponentTest, AliasIntegrationTest, TestReplicationHandlerBackup, DocExpirationUpdateProcessorFactoryTest, DistributedQueryComponentOptimizationTest, TestFastWriter, TestFreeTextSuggestions, TestUniqueKeyFieldResource, StatelessScriptUpdateProcessorFactoryTest, SuggestComponentTest, TestCoreDiscovery, ShardRoutingTest, TestDocSet, TestManagedSchemaFieldResource, TestQuerySenderListener, TestFastLRUCache, DateRangeFieldTest, CoreAdminHandlerTest, SolrCmdDistributorTest, JSONWriterTest, TestFoldingMultitermQuery, TestSolrDeletionPolicy1, QueryResultKeyTest, TestNRTOpen, CoreAdminRequestStatusTest, TestStressUserVersions, AddSchemaFieldsUpdateProcessorFactoryTest, XmlUpdateRequestHandlerTest, DirectSolrSpellCheckerTest, TestManagedResourceStorage, BadIndexSchemaTest, TestDistribDocBasedVersion, TestCopyFieldCollectionResource, TestBulkSchemaAPI, TestComponentsName, BJQParserTest, VMParamsZkACLAndCredentialsProvidersTest, TestSchemaNameResource, SolrTestCaseJ4Test, StressHdfsTest, AtomicUpdatesTest, TestLMDirichletSimilarityFactory, TestLuceneMatchVersion, SharedFSAutoReplicaFailoverTest, TestPartialUpdateDeduplication, FileUtilsTest, TestAnalyzedSuggestions, HighlighterConfigTest, TestCloudManagedSchemaConcurrent, TestHighFrequencyDictionaryFactory, HighlighterMaxOffsetTest, TestCollationFieldDocValues, SolrXmlInZkTest, TestCodecSupport, ResponseLogComponentTest, TestFastOutputStream, TestSolr4Spatial, BasicFunctionalityTest, TestRawResponseWriter, RequiredFieldsTest, TestHighlightDedupGrouping, MoreLikeThisHandlerTest, TimeZoneUtilsTest, SuggesterWFSTTest, HdfsLockFactoryTest, ShowFileRequestHandlerTest, TestReplicationHandler, TestManagedSchemaDynamicFieldResource, BadComponentTest, SuggesterTSTTest, ChaosMonkeyNothingIsSafeTest, ExternalFileFieldSortTest, TestSearcherReuse, ZkCLITest, OverseerTest, TestRTGBase, TestMaxScoreQueryParser, BasicDistributedZkTest, OverseerCollectionProcessorTest, DocumentAnalysisRequestHandlerTest, TestDFRSimilarityFactory, AnalyticsMergeStrategyTest, CurrencyFieldOpenExchangeTest, SimpleFacetsTest, SignatureUpdateProcessorFactoryTest, MBeansHandlerTest, TestSolrXml, TestSurroundQueryParser, SyncSliceTest, FieldMutatingUpdateProcessorTest, CoreAdminCreateDiscoverTest, TestFaceting, TestRecovery, TestHashPartitioner, DistributedSpellCheckComponentTest, TestMultiCoreConfBootstrap, TestReload, DistributedTermsComponentTest, TestSort, TestFiltering, SolrIndexSplitterTest, SimplePostToolTest, TestExtendedDismaxParser, SpellCheckCollatorTest, SuggesterFSTTest, SolrRequestParserTest, SuggesterTest, TestStressLucene, TestTrie, PolyFieldTest, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, TestUpdate, TestAtomicUpdateErrorCases, QueryEqualityTest, DirectUpdateHandlerOptimizeTest, SortByFunctionTest, DocValuesMultiTest, XsltUpdateRequestHandlerTest, CacheHeaderTest, PrimitiveFieldTypeTest, TermsComponentTest, PathHierarchyTokenizerFactoryTest, TestArbitraryIndexDir, RegexBoostProcessorTest, TestJmxIntegration, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, PingRequestHandlerTest, TestBinaryResponseWriter, UpdateParamsTest, TestSolrIndexConfig, TestStressRecovery, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestTolerantSearch, AssignTest, AsyncMigrateRouteKeyTest, CollectionsAPIAsyncDistributedZkTest, DeleteLastCustomShardedReplicaTest, DeleteReplicaTest] [junit4] Completed on J0 in 219.80s, 1 test, 1 error <<< FAILURES! [...truncated 260 lines...] BUILD FAILED /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:524: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:472: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:61: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:39: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build.xml:189: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/common-build.xml:496: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:1360: The following error occurred while executing this line: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:962: There were test failures: 437 suites, 1795 tests, 1 error, 44 ignored (21 assumptions) Total time: 110 minutes 14 seconds Build step 'Invoke Ant' marked build as failure [description-setter] Description set: Java: 32bit/jdk1.9.0-ea-b34 -server -XX:+UseG1GC Archiving artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
