Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/2/
4 tests failed. FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrReplicationDistributedZkTest Error Message: ObjectTracker found 1 object(s) that were not released!!! [SolrZkClient] Stack Trace: java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [SolrZkClient] at __randomizedtesting.SeedInfo.seed([4A59DB50A1591C96]:0) at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertNull(Assert.java:551) at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:238) at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:497) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367) at java.lang.Thread.run(Thread.java:745) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrReplicationDistributedZkTest Error Message: 2 threads leaked from SUITE scope at org.apache.solr.cloud.CdcrReplicationDistributedZkTest: 1) Thread[id=74729, name=zkCallback-2197-thread-3-processing-n:127.0.0.1:35902_xgjk%2Fjk-EventThread, state=WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) 2) Thread[id=74727, name=zkCallback-2197-thread-3-processing-n:127.0.0.1:35902_xgjk%2Fjk-SendThread(127.0.0.1:60043), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.CdcrReplicationDistributedZkTest: 1) Thread[id=74729, name=zkCallback-2197-thread-3-processing-n:127.0.0.1:35902_xgjk%2Fjk-EventThread, state=WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) 2) Thread[id=74727, name=zkCallback-2197-thread-3-processing-n:127.0.0.1:35902_xgjk%2Fjk-SendThread(127.0.0.1:60043), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003) at __randomizedtesting.SeedInfo.seed([4A59DB50A1591C96]:0) FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrReplicationDistributedZkTest Error Message: There are still zombie threads that couldn't be terminated: 1) Thread[id=74727, name=zkCallback-2197-thread-3-processing-n:127.0.0.1:35902_xgjk%2Fjk-SendThread(127.0.0.1:60043), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994) Stack Trace: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated: 1) Thread[id=74727, name=zkCallback-2197-thread-3-processing-n:127.0.0.1:35902_xgjk%2Fjk-SendThread(127.0.0.1:60043), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994) at __randomizedtesting.SeedInfo.seed([4A59DB50A1591C96]:0) FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test Error Message: Captured an uncaught exception in thread: Thread[id=24064, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] Stack Trace: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=24064, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest] Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:56905: collection already exists: awholynewstresscollection_collection4_0 at __randomizedtesting.SeedInfo.seed([4A59DB50A1591C96]:0) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:577) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372) at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325) at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100) at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:870) at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:806) at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1593) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1614) at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:973) Build Log: [...truncated 11856 lines...] [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest [junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/init-core-data-001 [junit4] 2> 1527554 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[4A59DB50A1591C96]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) [junit4] 2> 1527554 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[4A59DB50A1591C96]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: / [junit4] 2> 1527559 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER [junit4] 2> 1527560 INFO (Thread-16374) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0 [junit4] 2> 1527560 INFO (Thread-16374) [ ] o.a.s.c.ZkTestServer Starting server [junit4] 2> 1527660 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.ZkTestServer start zk server on port:55930 [junit4] 2> 1527660 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1527660 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1527663 INFO (zkCallback-1707-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1db0a73a name:ZooKeeperConnection Watcher:127.0.0.1:55930 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1527664 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1527664 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1527664 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /solr [junit4] 2> 1527667 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1527667 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1527673 INFO (zkCallback-1708-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1398c91c name:ZooKeeperConnection Watcher:127.0.0.1:55930/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1527673 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1527674 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1527674 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1 [junit4] 2> 1527677 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards [junit4] 2> 1527679 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection [junit4] 2> 1527679 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards [junit4] 2> 1527682 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml [junit4] 2> 1527683 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml [junit4] 2> 1527685 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml [junit4] 2> 1527685 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml [junit4] 2> 1527687 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1527687 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml [junit4] 2> 1527689 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt [junit4] 2> 1527689 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt [junit4] 2> 1527691 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt [junit4] 2> 1527691 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt [junit4] 2> 1527692 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml [junit4] 2> 1527692 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml [junit4] 2> 1527696 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml [junit4] 2> 1527696 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml [junit4] 2> 1527697 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json [junit4] 2> 1527697 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json [junit4] 2> 1527700 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 1527700 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt [junit4] 2> 1527702 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt [junit4] 2> 1527702 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt [junit4] 2> 1527703 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt [junit4] 2> 1527703 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt [junit4] 2> 1527802 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores/collection1 [junit4] 2> 1527804 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106 [junit4] 2> 1527809 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@54dd9c53{/,null,AVAILABLE} [junit4] 2> 1527814 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.e.j.s.ServerConnector Started ServerConnector@bf76de{HTTP/1.1,[http/1.1]}{127.0.0.1:49642} [junit4] 2> 1527814 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.e.j.s.Server Started @1531509ms [junit4] 2> 1527814 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/tempDir-001/control/data, hostContext=/, hostPort=49642, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores} [junit4] 2> 1527814 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a [junit4] 2> 1527815 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001' [junit4] 2> 1527815 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1527815 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 1527815 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1527815 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1527817 INFO (zkCallback-1709-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4853e42d name:ZooKeeperConnection Watcher:127.0.0.1:55930/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1527817 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1527817 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1527819 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 1527819 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/solr.xml [junit4] 2> 1527824 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores [junit4] 2> 1527824 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.CoreContainer New CoreContainer 2088151736 [junit4] 2> 1527824 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001] [junit4] 2> 1527824 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/lib [junit4] 2> 1527825 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 1527827 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 1527827 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1527827 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1527827 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55930/solr [junit4] 2> 1527827 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 1527827 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1527828 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1527832 INFO (zkCallback-1712-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1e89b202 name:ZooKeeperConnection Watcher:127.0.0.1:55930 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1527833 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1527833 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1527838 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1527839 INFO (zkCallback-1713-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4f94f520 name:ZooKeeperConnection Watcher:127.0.0.1:55930/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1527839 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1527840 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue [junit4] 2> 1527842 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work [junit4] 2> 1527845 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running [junit4] 2> 1527847 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed [junit4] 2> 1527849 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure [junit4] 2> 1527851 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes [junit4] 2> 1527856 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /aliases.json [junit4] 2> 1527857 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json [junit4] 2> 1527859 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /security.json [junit4] 2> 1527860 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 1527862 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0) [junit4] 2> 1527863 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect [junit4] 2> 1527865 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election [junit4] 2> 1527868 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1527869 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95497133064192004-127.0.0.1:49642_-n_0000000000 [junit4] 2> 1527870 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:49642_ [junit4] 2> 1527870 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader [junit4] 2> 1527873 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.Overseer Overseer (id=95497133064192004-127.0.0.1:49642_-n_0000000000) starting [junit4] 2> 1527875 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work [junit4] 2> 1527884 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000 [junit4] 2> 1527885 INFO (OverseerCollectionConfigSetProcessor-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations [junit4] 2> 1527886 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.Overseer Starting to work on the main queue [junit4] 2> 1527886 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49642_ [junit4] 2> 1527895 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:49642_ [junit4] 2> 1527895 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0) [junit4] 2> 1527896 INFO (zkCallback-1713-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [0]) [junit4] 2> 1527898 INFO (zkCallback-1713-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1527911 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 1527912 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 1527912 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores [junit4] 2> 1527913 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=control_collection, coreNodeName=, dataDir=data/, shard=} [junit4] 2> 1527913 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores/collection1 [junit4] 2> 1527913 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions [junit4] 2> 1527914 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2 [junit4] 2> 1527914 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:49642_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done [junit4] 2> 1527914 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 1527914 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 1527917 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:49642", [junit4] 2> "node_name":"127.0.0.1:49642_", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} current state version: 0 [junit4] 2> 1527918 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.ZkController look for our core node name [junit4] 2> 1527922 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:49642", [junit4] 2> "node_name":"127.0.0.1:49642_", [junit4] 2> "numShards":"1", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} [junit4] 2> 1527924 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection [junit4] 2> 1527925 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1 [junit4] 2> 1527926 INFO (zkCallback-1713-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1]) [junit4] 2> 1528918 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1 [junit4] 2> 1528918 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection [junit4] 2> 1528919 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.ZkController Collection zkNode exists [junit4] 2> 1528919 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection] [junit4] 2> 1528919 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper [junit4] 2> 1528919 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores/collection1' [junit4] 2> 1528920 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1528920 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 1528923 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 [junit4] 2> 1528928 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1 [junit4] 2> 1528932 WARN (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead. [junit4] 2> 1528933 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.1.0 [junit4] 2> 1528942 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml [junit4] 2> 1528950 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 1529085 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 1529091 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.s.IndexSchema default search field in schema is text [junit4] 2> 1529092 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.s.IndexSchema unique key field: id [junit4] 2> 1529101 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 1529104 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml [junit4] 2> 1529106 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1529106 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json [junit4] 2> 1529108 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2 [junit4] 2> 1529108 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection [junit4] 2> 1529108 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory [junit4] 2> 1529108 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores/collection1/data/] [junit4] 2> 1529108 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@75c70cec [junit4] 2> 1529109 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores/collection1/data [junit4] 2> 1529109 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores/collection1/data/index/ [junit4] 2> 1529109 WARN (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index... [junit4] 2> 1529109 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores/collection1/data/index [junit4] 2> 1529109 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=2, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=0.8173828125, noCFSRatio=0.14670334714566985] [junit4] 2> 1529110 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@37b30bd6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@59ad6bc),segFN=segments_1,generation=1} [junit4] 2> 1529110 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1 [junit4] 2> 1529111 INFO (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores/collection1/data/ [junit4] 2> 1529111 WARN (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories. [junit4] 2> 1529115 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib" [junit4] 2> 1529115 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe" [junit4] 2> 1529115 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" [junit4] 2> 1529115 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig" [junit4] 2> 1529115 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" [junit4] 2> 1529115 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" [junit4] 2> 1529115 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1529116 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" [junit4] 2> 1529116 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default [junit4] 2> 1529116 WARN (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}} [junit4] 2> 1529117 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 1529118 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 1529119 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 1529120 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60 [junit4] 2> 1529123 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/dump,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file [junit4] 2> 1529123 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache [junit4] 2> 1529124 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog [junit4] 2> 1529124 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 [junit4] 2> 1529125 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled [junit4] 2> 1529125 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled [junit4] 2> 1529125 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=47, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6264473349042524] [junit4] 2> 1529125 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1 [junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@37b30bd6 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@59ad6bc),segFN=segments_1,generation=1} [junit4] 2> 1529125 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1 [junit4] 2> 1529125 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3b48bfce[collection1] main] [junit4] 2> 1529125 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection] [junit4] 2> 1529126 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper [junit4] 2> 1529126 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1 [junit4] 2> 1529127 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1 [junit4] 2> 1529127 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {} [junit4] 2> 1529127 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1529128 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json [junit4] 2> 1529128 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1 [junit4] 2> 1529128 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources [junit4] 2> 1529128 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000 [junit4] 2> 1529129 INFO (searcherExecutor-4808-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3b48bfce[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())} [junit4] 2> 1529129 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets [junit4] 2> 1529129 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index [junit4] 2> 1529129 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index [junit4] 2> 1529129 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1527954130671239168 [junit4] 2> 1529131 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1527954130671239168 [junit4] 2> 1529131 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1 [junit4] 2> 1529132 INFO (coreLoadExecutor-4807-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1 [junit4] 2> 1529132 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:49642 collection:control_collection shard:shard1 [junit4] 2> 1529134 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election [junit4] 2> 1529138 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95497133064192004-core_node1-n_0000000000 [junit4] 2> 1529138 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000 [junit4] 2> 1529141 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue. [junit4] 2> 1529141 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync [junit4] 2> 1529141 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:49642/collection1/ [junit4] 2> 1529141 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me [junit4] 2> 1529141 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:49642/collection1/ has no replicas [junit4] 2> 1529142 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection"} current state version: 1 [junit4] 2> 1529143 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1 [junit4] 2> 1529150 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node /collections/control_collection/leaders/shard1/leader after winning as /collections/control_collection/leader_elect/shard1/election/95497133064192004-core_node1-n_0000000000 [junit4] 2> 1529155 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:49642/collection1/ shard1 [junit4] 2> 1529156 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"leader", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "base_url":"http://127.0.0.1:49642", [junit4] 2> "core":"collection1", [junit4] 2> "state":"active"} current state version: 1 [junit4] 2> 1529259 INFO (zkCallback-1713-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1]) [junit4] 2> 1529307 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:49642/collection1/ and leader is http://127.0.0.1:49642/collection1/ [junit4] 2> 1529307 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49642 [junit4] 2> 1529307 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary [junit4] 2> 1529308 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active [junit4] 2> 1529308 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 1529311 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:49642", [junit4] 2> "node_name":"127.0.0.1:49642_", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} current state version: 2 [junit4] 2> 1529311 INFO (coreZkRegister-4801-thread-1-processing-n:127.0.0.1:49642_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:49642_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (1) [junit4] 2> 1529311 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={ [junit4] 2> "core":"collection1", [junit4] 2> "core_node_name":"core_node1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:49642", [junit4] 2> "node_name":"127.0.0.1:49642_", [junit4] 2> "numShards":"1", [junit4] 2> "state":"active", [junit4] 2> "shard":"shard1", [junit4] 2> "collection":"control_collection", [junit4] 2> "operation":"state"} [junit4] 2> 1529414 INFO (zkCallback-1713-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1]) [junit4] 2> 1529416 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1529416 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1529418 INFO (zkCallback-1715-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6aa28d33 name:ZooKeeperConnection Watcher:127.0.0.1:55930/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1529418 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1529418 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1529418 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 1529419 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1529420 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false [junit4] 2> 1529517 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/shard-1-001/cores/collection1 [junit4] 2> 1529518 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/shard-1-001 [junit4] 2> 1529519 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.e.j.s.Server jetty-9.3.6.v20151106 [junit4] 2> 1529520 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@57ea15c6{/,null,AVAILABLE} [junit4] 2> 1529521 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.e.j.s.ServerConnector Started ServerConnector@4d344262{HTTP/1.1,[http/1.1]}{127.0.0.1:56905} [junit4] 2> 1529526 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.e.j.s.Server Started @1533221ms [junit4] 2> 1529527 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=56905, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/shard-1-001/cores} [junit4] 2> 1529527 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a [junit4] 2> 1529527 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/shard-1-001' [junit4] 2> 1529527 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1529527 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 1529527 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1529528 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1529529 INFO (zkCallback-1716-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@e9bfb00 name:ZooKeeperConnection Watcher:127.0.0.1:55930/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1529529 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1529529 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1529531 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) [junit4] 2> 1529531 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/shard-1-001/solr.xml [junit4] 2> 1529535 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/shard-1-001/cores [junit4] 2> 1529535 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.CoreContainer New CoreContainer 1276330168 [junit4] 2> 1529535 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/shard-1-001] [junit4] 2> 1529536 WARN (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/shard-1-001/lib [junit4] 2> 1529536 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false, [junit4] 2> 1529537 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true [junit4] 2> 1529537 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory [junit4] 2> 1529537 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] [junit4] 2> 1529537 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:55930/solr [junit4] 2> 1529538 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.ZkController zkHost includes chroot [junit4] 2> 1529538 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider [junit4] 2> 1529542 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1529542 INFO (zkCallback-1719-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@63ac6ef3 name:ZooKeeperConnection Watcher:127.0.0.1:55930 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1529545 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1529545 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [ ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider [junit4] 2> 1529547 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper [junit4] 2> 1529548 INFO (zkCallback-1720-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@753f921a name:ZooKeeperConnection Watcher:127.0.0.1:55930/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None [junit4] 2> 1529548 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper [junit4] 2> 1529569 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... [junit4] 2> 1529570 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) [junit4] 2> 1529573 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.Overseer Overseer (id=null) closing [junit4] 2> 1529574 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95497133064192008-127.0.0.1:56905_-n_0000000001 [junit4] 2> 1529574 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95497133064192004-127.0.0.1:49642_-n_0000000000 to know if I could be the leader [junit4] 2> 1529575 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.ZkController Publish node=127.0.0.1:56905_ as DOWN [junit4] 2> 1529577 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "operation":"downnode", [junit4] 2> "node_name":"127.0.0.1:56905_"} current state version: 3 [junit4] 2> 1529577 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:56905_ [junit4] 2> 1529680 INFO (zkCallback-1720-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1]) [junit4] 2> 1529680 INFO (zkCallback-1713-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1]) [junit4] 2> 1529680 INFO (zkCallback-1715-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1]) [junit4] 2> 1530580 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56905_ [junit4] 2> 1530581 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:56905_ [junit4] 2> 1530583 INFO (zkCallback-1715-thread-1) [ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1]) [junit4] 2> 1530583 INFO (zkCallback-1720-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1]) [junit4] 2> 1530583 INFO (zkCallback-1713-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1]) [junit4] 2> 1530583 INFO (zkCallback-1715-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1530584 INFO (zkCallback-1720-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1530584 INFO (zkCallback-1713-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2) [junit4] 2> 1530608 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module. [junit4] 2> 1530608 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.CoreContainer No authentication plugin used. [junit4] 2> 1530609 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/shard-1-001/cores [junit4] 2> 1530610 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, collection=collection1, coreNodeName=, dataDir=data/, shard=} [junit4] 2> 1530610 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/shard-1-001/cores/collection1 [junit4] 2> 1530610 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions [junit4] 2> 1530611 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2 [junit4] 2> 1530611 INFO (TEST-CollectionsAPIDistributedZkTest.test-seed#[4A59DB50A1591C96]) [n:127.0.0.1:56905_ ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done [junit4] 2> 1530611 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.ZkController publishing state=down [junit4] 2> 1530611 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property [junit4] 2> 1530613 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.Overseer processMessage: queueSize: 1, message = { [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:56905", [junit4] 2> "node_name":"127.0.0.1:56905_", [junit4] 2> "numShards":"2", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state"} current state version: 4 [junit4] 2> 1530615 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={ [junit4] 2> "core":"collection1", [junit4] 2> "roles":null, [junit4] 2> "base_url":"http://127.0.0.1:56905", [junit4] 2> "node_name":"127.0.0.1:56905_", [junit4] 2> "numShards":"2", [junit4] 2> "state":"down", [junit4] 2> "shard":null, [junit4] 2> "collection":"collection1", [junit4] 2> "operation":"state"} [junit4] 2> 1530615 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1 [junit4] 2> 1530615 INFO (OverseerStateUpdate-95497133064192004-127.0.0.1:49642_-n_0000000000) [n:127.0.0.1:49642_ ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2 [junit4] 2> 1530616 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.ZkController look for our core node name [junit4] 2> 1530718 INFO (zkCallback-1715-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2]) [junit4] 2> 1530718 INFO (zkCallback-1720-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2]) [junit4] 2> 1530718 INFO (zkCallback-1713-thread-1-processing-n:127.0.0.1:49642_) [n:127.0.0.1:49642_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2]) [junit4] 2> 1531617 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1 [junit4] 2> 1531617 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1 [junit4] 2> 1531617 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.ZkController Collection zkNode exists [junit4] 2> 1531617 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/collection1] [junit4] 2> 1531620 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/collection1] [configName]=[conf1] specified config exists in ZooKeeper [junit4] 2> 1531620 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_4A59DB50A1591C96-001/shard-1-001/cores/collection1' [junit4] 2> 1531620 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx) [junit4] 2> 1531621 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI) [junit4] 2> 1531622 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 [junit4] 2> 1531627 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1 [junit4] 2> 1531632 WARN (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.Config Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead. [junit4] 2> 1531633 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.1.0 [junit4] 2> 1531644 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml [junit4] 2> 1531649 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test [junit4] 2> 1531761 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440. [junit4] 2> 1531767 INFO (coreLoadExecutor-4818-thread-1-processing-n:127.0.0.1:56905_) [n:127.0.0.1:56905_ c:collection1 x:collection1] o.a.s.s.IndexSchema default search field in schema is text [junit4] 2> 1531768 INFO [...truncated too long message...] lientCnxn$SendThread.run(ClientCnxn.java:1003) [junit4] 2> 3885942 WARN (zkCallback-2197-thread-3-processing-n:127.0.0.1:35902_xgjk%2Fjk-SendThread(127.0.0.1:60043)) [n:127.0.0.1:35902_xgjk%2Fjk ] o.a.z.ClientCnxn Session 0x1534637a2d1003e for server null, unexpected error, closing socket connection and attempting reconnect [junit4] 2> java.net.ConnectException: Connection refused [junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) [junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) [junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) [junit4] 2> Mar 05, 2016 10:16:07 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll [junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated: [junit4] 2> 1) Thread[id=74727, name=zkCallback-2197-thread-3-processing-n:127.0.0.1:35902_xgjk%2Fjk-SendThread(127.0.0.1:60043), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] [junit4] 2> at java.lang.Thread.sleep(Native Method) [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994) [junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=true,coord=yes): {}, locale=sr-RS, timezone=Pacific/Gambier [junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.8.0_66 (64-bit)/cpus=4,threads=2,free=202607208,total=523763712 [junit4] 2> NOTE: All tests run in this JVM: [AddSchemaFieldsUpdateProcessorFactoryTest, TestComponentsName, TestSolrCLIRunExample, RequiredFieldsTest, TlogReplayBufferedWhileIndexingTest, HdfsDirectoryFactoryTest, TestSchemaManager, TestBadConfig, TestCrossCoreJoin, CloudExitableDirectoryReaderTest, TestDistributedStatsComponentCardinality, TestIBSimilarityFactory, TestAnalyzedSuggestions, AlternateDirectoryTest, DistribCursorPagingTest, TestConfig, DistributedQueryComponentOptimizationTest, HdfsLockFactoryTest, TestCloudInspectUtil, DocValuesMissingTest, TestPerFieldSimilarityWithDefaultOverride, PreAnalyzedUpdateProcessorTest, CdcrVersionReplicationTest, TestPhraseSuggestions, TestFoldingMultitermQuery, TestMergePolicyConfig, TestLazyCores, TestConfigSetsAPI, TestSchemaResource, DistributedQueueTest, TestSha256AuthenticationProvider, TestReloadDeadlock, TestRawTransformer, DistanceUnitsTest, TestLRUStatsCache, PreAnalyzedFieldTest, ReturnFieldsTest, TestExclusionRuleCollectionAccess, OutputWriterTest, CustomCollectionTest, SolrXmlInZkTest, ResponseLogComponentTest, TestMiniSolrCloudCluster, TestUniqueKeyFieldResource, TestRestoreCore, TestRandomDVFaceting, CursorPagingTest, PolyFieldTest, TestManagedResource, SmileWriterTest, SignatureUpdateProcessorFactoryTest, HdfsSyncSliceTest, TestDistributedSearch, CollectionTooManyReplicasTest, QueryElevationComponentTest, LeaderInitiatedRecoveryOnShardRestartTest, BadCopyFieldTest, CoreMergeIndexesAdminHandlerTest, SOLR749Test, TestFunctionQuery, QueryEqualityTest, TestShardHandlerFactory, TestSolrConfigHandlerConcurrent, SystemInfoHandlerTest, RecoveryAfterSoftCommitTest, TestConfigSetImmutable, SolrRequestParserTest, TestSolr4Spatial, BlockDirectoryTest, UUIDFieldTest, TestFieldTypeResource, TestTrackingShardHandlerFactory, TestRangeQuery, DocExpirationUpdateProcessorFactoryTest, OverseerRolesTest, CurrencyFieldOpenExchangeTest, CopyFieldTest, FullHLLTest, TestBulkSchemaConcurrent, TestClusterStateMutator, WrapperMergePolicyFactoryTest, HdfsUnloadDistributedZkTest, TestAnalyzeInfixSuggestions, ConcurrentDeleteAndCreateCollectionTest, TestSmileRequest, BigEndianAscendingWordSerializerTest, TestStressUserVersions, PingRequestHandlerTest, TestExceedMaxTermLength, TestFreeTextSuggestions, EchoParamsTest, RestartWhileUpdatingTest, SpatialHeatmapFacetsTest, PrimUtilsTest, DefaultValueUpdateProcessorTest, SyncSliceTest, LeaderElectionIntegrationTest, ShardRoutingTest, TestRandomFaceting, LeaderElectionTest, TestZkChroot, ZkCLITest, TestFaceting, TestRecovery, TestRealTimeGet, TestJoin, DistributedTermsComponentTest, PeerSyncTest, BadIndexSchemaTest, HighlighterTest, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SuggesterFSTTest, DocValuesTest, TestTrie, SuggesterWFSTTest, NoCacheHeaderTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, DirectUpdateHandlerOptimizeTest, TestRemoteStreaming, DocValuesMultiTest, XsltUpdateRequestHandlerTest, DebugComponentTest, CacheHeaderTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, TestValueSourceCache, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, IndexSchemaTest, UpdateRequestProcessorFactoryTest, MBeansHandlerTest, BinaryUpdateRequestHandlerTest, SearchHandlerTest, DateFieldTest, DOMUtilTest, RAMDirectoryFactoryTest, TestLRUCache, ZkNodePropsTest, SliceStateTest, FileUtilsTest, CircularListTest, DistributedMLTComponentTest, TestRTGBase, TestHighlightDedupGrouping, TestSimpleTrackingShardHandler, ConnectionReuseTest, ActionThrottleTest, AssignTest, AsyncCallRequestStatusResponseTest, AsyncMigrateRouteKeyTest, BaseCdcrDistributedZkTest, CdcrReplicationDistributedZkTest] [junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory. [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=CdcrReplicationDistributedZkTest -Dtests.seed=4A59DB50A1591C96 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=sr-RS -Dtests.timezone=Pacific/Gambier -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [junit4] ERROR 0.00s J0 | CdcrReplicationDistributedZkTest (suite) <<< [junit4] > Throwable #1: java.lang.AssertionError: ObjectTracker found 1 object(s) that were not released!!! [SolrZkClient] [junit4] > at __randomizedtesting.SeedInfo.seed([4A59DB50A1591C96]:0) [junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:238) [junit4] > at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.CdcrReplicationDistributedZkTest: [junit4] > 1) Thread[id=74729, name=zkCallback-2197-thread-3-processing-n:127.0.0.1:35902_xgjk%2Fjk-EventThread, state=WAITING, group=TGRP-CdcrReplicationDistributedZkTest] [junit4] > at sun.misc.Unsafe.park(Native Method) [junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) [junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) [junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) [junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) [junit4] > 2) Thread[id=74727, name=zkCallback-2197-thread-3-processing-n:127.0.0.1:35902_xgjk%2Fjk-SendThread(127.0.0.1:60043), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] [junit4] > at java.lang.Thread.sleep(Native Method) [junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) [junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) [junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003) [junit4] > at __randomizedtesting.SeedInfo.seed([4A59DB50A1591C96]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated: [junit4] > 1) Thread[id=74727, name=zkCallback-2197-thread-3-processing-n:127.0.0.1:35902_xgjk%2Fjk-SendThread(127.0.0.1:60043), state=TIMED_WAITING, group=TGRP-CdcrReplicationDistributedZkTest] [junit4] > at java.lang.Thread.sleep(Native Method) [junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:994) [junit4] > at __randomizedtesting.SeedInfo.seed([4A59DB50A1591C96]:0) [junit4] Completed [454/583 (2!)] on J0 in 1003.02s, 11 tests, 1 failure, 2 errors <<< FAILURES! [...truncated 394 lines...] BUILD FAILED /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:747: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:684: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:59: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build.xml:233: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/common-build.xml:524: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1457: The following error occurred while executing this line: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1014: There were test failures: 583 suites (8 ignored), 2352 tests, 3 suite-level errors, 1 error, 381 ignored (17 assumptions) [seed: 4A59DB50A1591C96] Total time: 216 minutes 13 seconds Build step 'Invoke Ant' marked build as failure Archiving artifacts No prior successful build to compare, so performing full copy of artifacts Recording test results Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org