Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/119/

5 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest:     1) Thread[id=129652, 
name=searcherExecutor-10776-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 
   1) Thread[id=129652, name=searcherExecutor-10776-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([6B5B6BE8129AB0E6]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=129652, name=searcherExecutor-10776-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=129652, name=searcherExecutor-10776-thread-1, state=WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([6B5B6BE8129AB0E6]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.overseer.ZkStateWriterTest

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.overseer.ZkStateWriterTest:     1) Thread[id=10159, 
name=watches-1642-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]  
       at sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.overseer.ZkStateWriterTest: 
   1) Thread[id=10159, name=watches-1642-thread-1, state=TIMED_WAITING, 
group=TGRP-ZkStateWriterTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([6B5B6BE8129AB0E6]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.overseer.ZkStateWriterTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=10159, name=watches-1642-thread-1, state=TIMED_WAITING, 
group=TGRP-ZkStateWriterTest]         at sun.misc.Unsafe.park(Native Method)    
     at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)  
       at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=10159, name=watches-1642-thread-1, state=TIMED_WAITING, 
group=TGRP-ZkStateWriterTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([6B5B6BE8129AB0E6]:0)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Timeout occured while waiting response from server at: 
http://127.0.0.1:33908/t/ho

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting 
response from server at: http://127.0.0.1:33908/t/ho
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:601)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:259)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:399)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:457)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:179)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:170)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:495)
        ... 47 more




Build Log:
[...truncated 11336 lines...]
   [junit4] JVM J2: stdout was not empty, see: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/temp/junit4-J2-20160714_012219_720.sysout
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] Dumping heap to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/heapdumps/java_pid20523.hprof
 ...
   [junit4] Heap dump file created [655224203 bytes in 12.524 secs]
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J2: stderr was not empty, see: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/temp/junit4-J2-20160714_012219_720.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] WARN: Unhandled exception in event serialization. -> 
java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] <<< JVM J2: EOF ----

[...truncated 76 lines...]
   [junit4] Suite: org.apache.solr.cloud.overseer.ZkStateWriterTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateWriterTest_6B5B6BE8129AB0E6-001/init-core-data-001
   [junit4]   2> 1791870 INFO  
(SUITE-ZkStateWriterTest-seed#[6B5B6BE8129AB0E6]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1791872 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalModificationToStateFormat2
   [junit4]   2> 1791872 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1791876 INFO  (Thread-3005) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1791876 INFO  (Thread-3005) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1791976 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.ZkTestServer start zk server on port:58736
   [junit4]   2> 1791976 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1791977 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1791979 INFO  (zkCallback-1639-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@79c14770 
name:ZooKeeperConnection Watcher:127.0.0.1:58736 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1791979 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1791979 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1791980 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1791981 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1791981 INFO  (zkCallback-1640-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@b77f7f5 name:ZooKeeperConnection 
Watcher:127.0.0.1:58736 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1791981 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1791981 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1791981 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1791985 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1791985 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1791985 INFO  (zkCallback-1641-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6dda84a name:ZooKeeperConnection 
Watcher:127.0.0.1:58736/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1791985 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1791986 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1791986 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1791987 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1791988 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1791989 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1791990 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1791992 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1791993 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 1791993 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1791994 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1791995 INFO  (zkCallback-1641-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1791995 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c2
   [junit4]   2> 1791996 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c2/state.json
   [junit4]   2> 1791997 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ZkStateReader Checking legacy cluster state for collection c2
   [junit4]   2> 1791998 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ZkStateReader Adding lazily-loaded reference for collection c2
   [junit4]   2> 1792000 INFO  (zkCallback-1641-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1792003 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.o.ZkStateWriterTest Cluster state: live 
nodes:[]collections:{c1=LazyCollectionRef(c1), c2=LazyCollectionRef(c2)}
   [junit4]   2> 1792004 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ZkStateReader Refreshing lazily-loaded state for collection c2
   [junit4]   2> 1792004 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.o.ZkStateWriter going to update_collection 
/collections/c2/state.json version: 0
   [junit4]   2> 1792006 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:58736 58736
   [junit4]   2> 1792179 INFO  (Thread-3005) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:58736 58736
   [junit4]   2> 1792183 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalModificationToStateFormat2
   [junit4]   2> 1792185 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.SolrTestCaseJ4 ###Starting testZkStateWriterBatching
   [junit4]   2> 1792185 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1792186 INFO  (Thread-3006) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1792186 INFO  (Thread-3006) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1792286 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.ZkTestServer start zk server on port:46357
   [junit4]   2> 1792286 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1792286 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1792288 INFO  (zkCallback-1643-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7bd05b44 
name:ZooKeeperConnection Watcher:127.0.0.1:46357 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1792288 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1792288 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1792289 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1792289 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1792290 INFO  (zkCallback-1644-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@698c735e 
name:ZooKeeperConnection Watcher:127.0.0.1:46357 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1792290 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1792290 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1792290 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1792292 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1792292 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1792293 INFO  (zkCallback-1645-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3e9c96c5 
name:ZooKeeperConnection Watcher:127.0.0.1:46357/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1792293 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1792293 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1792293 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1792294 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1792295 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1792296 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1792297 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1792298 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1792298 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 1792299 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1792300 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1792301 INFO  (zkCallback-1645-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1792301 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.c.SolrZkClient makePath: /collections/c2
   [junit4]   2> 1792302 INFO  (zkCallback-1645-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1792303 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 1792304 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.c.ZkTestServer connecting to 127.0.0.1:46357 46357
   [junit4]   2> 1792532 INFO  (Thread-3006) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:46357 46357
   [junit4]   2> 1792533 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[6B5B6BE8129AB0E6]) [    
] o.a.s.SolrTestCaseJ4 ###Ending testZkStateWriterBatching
   [junit4]   2> 1792535 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.SolrTestCaseJ4 ###Starting testSingleExternalCollection
   [junit4]   2> 1792535 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1792536 INFO  (Thread-3007) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1792536 INFO  (Thread-3007) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1792636 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.ZkTestServer start zk server on port:43589
   [junit4]   2> 1792636 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1792636 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1792638 INFO  (zkCallback-1647-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1cd3dff9 
name:ZooKeeperConnection Watcher:127.0.0.1:43589 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1792638 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1792638 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1792639 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1792639 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1792640 INFO  (zkCallback-1648-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@496eca74 
name:ZooKeeperConnection Watcher:127.0.0.1:43589 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1792640 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1792640 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1792640 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1792642 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1792644 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1792644 INFO  (zkCallback-1649-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@27d1a8b4 
name:ZooKeeperConnection Watcher:127.0.0.1:43589/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1792645 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1792645 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1792645 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1792646 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1792647 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1792648 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1792649 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1792650 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1792650 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 1792651 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1792652 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1792652 INFO  (zkCallback-1649-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1792653 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 1792655 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43589 43589
   [junit4]   2> 1792827 INFO  (Thread-3007) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:43589 43589
   [junit4]   2> 1792828 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[6B5B6BE8129AB0E6]) [ 
   ] o.a.s.SolrTestCaseJ4 ###Ending testSingleExternalCollection
   [junit4]   2> 1792830 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.SolrTestCaseJ4 ###Starting testSingleLegacyCollection
   [junit4]   2> 1792830 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1792830 INFO  (Thread-3008) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1792831 INFO  (Thread-3008) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1792931 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.ZkTestServer start zk server on port:49148
   [junit4]   2> 1792931 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1792931 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1792933 INFO  (zkCallback-1651-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@57eaa524 
name:ZooKeeperConnection Watcher:127.0.0.1:49148 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1792933 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1792933 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1792934 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1792934 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1792935 INFO  (zkCallback-1652-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@8b8601a name:ZooKeeperConnection 
Watcher:127.0.0.1:49148 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1792935 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1792935 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1792935 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1792939 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1792940 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1792940 INFO  (zkCallback-1653-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@16b7e41b 
name:ZooKeeperConnection Watcher:127.0.0.1:49148/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1792940 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1792940 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1792941 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1792942 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1792943 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1792944 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1792945 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1792945 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1792946 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 1792946 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1792947 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1792948 INFO  (zkCallback-1653-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1792949 INFO  (zkCallback-1653-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 1792950 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49148 49148
   [junit4]   2> 1793169 INFO  (Thread-3008) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:49148 49148
   [junit4]   2> 1793170 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[6B5B6BE8129AB0E6]) [   
 ] o.a.s.SolrTestCaseJ4 ###Ending testSingleLegacyCollection
   [junit4]   2> 1793172 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting 
testExternalModificationToSharedClusterState
   [junit4]   2> 1793173 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1793173 INFO  (Thread-3009) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1793173 INFO  (Thread-3009) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1793273 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.ZkTestServer start zk server on port:48899
   [junit4]   2> 1793273 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1793273 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1793275 INFO  (zkCallback-1655-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2b4905f2 
name:ZooKeeperConnection Watcher:127.0.0.1:48899 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1793275 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1793275 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1793276 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1793276 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1793277 INFO  (zkCallback-1656-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1da0d143 
name:ZooKeeperConnection Watcher:127.0.0.1:48899 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1793277 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1793277 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1793277 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1793279 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1793279 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1793280 INFO  (zkCallback-1657-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4a9692ef 
name:ZooKeeperConnection Watcher:127.0.0.1:48899/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1793280 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1793280 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1793280 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1793281 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1793282 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1793283 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1793284 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1793285 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1793285 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 1793286 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1793287 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1793288 INFO  (zkCallback-1657-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1793288 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c2
   [junit4]   2> 1793289 INFO  (zkCallback-1657-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1793290 INFO  (zkCallback-1657-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 1793290 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ZkStateReader Refreshing lazily-loaded state for collection c1
   [junit4]   2> 1793290 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.c.ZkStateReader Refreshing lazily-loaded state for collection c2
   [junit4]   2> 1793292 INFO  (zkCallback-1657-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 1793293 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48899 48899
   [junit4]   2> 1793509 INFO  (Thread-3009) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:48899 48899
   [junit4]   2> 1793510 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[6B5B6BE8129AB0E6])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending 
testExternalModificationToSharedClusterState
   [junit4]   2> 1793511 INFO  
(SUITE-ZkStateWriterTest-seed#[6B5B6BE8129AB0E6]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Jul 14, 2016 1:52:17 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked 
thread(s).
   [junit4]   2> Jul 14, 2016 1:52:37 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.solr.cloud.overseer.ZkStateWriterTest: 
   [junit4]   2>    1) Thread[id=10159, name=watches-1642-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Jul 14, 2016 1:52:37 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=10159, name=watches-1642-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]   2> Jul 14, 2016 1:52:40 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be 
terminated:
   [junit4]   2>    1) Thread[id=10159, name=watches-1642-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62), 
sim=RandomSimilarity(queryNorm=false,coord=no): {}, locale=id, 
timezone=Africa/Johannesburg
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_74 (64-bit)/cpus=4,threads=2,free=209382952,total=526385152
   [junit4]   2> NOTE: All tests run in this JVM: [TestFieldCollectionResource, 
ActionThrottleTest, TestManagedSchemaAPI, DeleteStatusTest, ShardSplitTest, 
AsyncCallRequestStatusResponseTest, TestCloudSchemaless, TestLegacyFieldCache, 
TestReloadAndDeleteDocs, TestUninvertingReader, TestStressLucene, 
SyncSliceTest, TestRealTimeGet, TestConfigOverlay, QueryEqualityTest, 
TestExceedMaxTermLength, TestConfigSets, TestDistribIDF, JSONWriterTest, 
VMParamsZkACLAndCredentialsProvidersTest, BlockJoinFacetRandomTest, 
RollingRestartTest, DocValuesMissingTest, ZkStateWriterTest]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkStateWriterTest 
-Dtests.seed=6B5B6BE8129AB0E6 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=id -Dtests.timezone=Africa/Johannesburg -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | ZkStateWriterTest (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.overseer.ZkStateWriterTest: 
   [junit4]    >    1) Thread[id=10159, name=watches-1642-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([6B5B6BE8129AB0E6]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=10159, name=watches-1642-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([6B5B6BE8129AB0E6]:0)
   [junit4] Completed [77/621 (1!)] on J0 in 24.74s, 5 tests, 2 errors <<< 
FAILURES!

[...truncated 1323 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B5B6BE8129AB0E6-001/init-core-data-001
   [junit4]   2> 3915355 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[6B5B6BE8129AB0E6]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 3915355 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[6B5B6BE8129AB0E6]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /t/ho
   [junit4]   2> 3915356 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 3915357 INFO  (Thread-6376) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3915357 INFO  (Thread-6376) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 3915457 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:40494
   [junit4]   2> 3915457 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 3915458 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3915461 INFO  (zkCallback-33693-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@776e047c 
name:ZooKeeperConnection Watcher:127.0.0.1:40494 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3915461 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3915461 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 3915461 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 3915463 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 3915463 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3915464 INFO  (zkCallback-33694-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3e3dd3ec 
name:ZooKeeperConnection Watcher:127.0.0.1:40494/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3915464 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3915464 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 3915464 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 3915466 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 3915467 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 3915468 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 3915469 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 3915469 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 3915471 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 3915471 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 3915472 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3915473 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3915474 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 3915474 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 3915475 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 3915475 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 3915476 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 3915477 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 3915478 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 3915478 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 3915479 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3915479 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3915480 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3915481 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3915482 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 3915482 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 3915483 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 3915484 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 3915569 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B5B6BE8129AB0E6-001/control-001/cores/collection1
   [junit4]   2> 3915570 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 3915574 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@2ad5dcd2{/t/ho,null,AVAILABLE}
   [junit4]   2> 3915575 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@922df67{HTTP/1.1,[http/1.1]}{127.0.0.1:55984}
   [junit4]   2> 3915575 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.e.j.s.Server Started @3919614ms
   [junit4]   2> 3915575 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B5B6BE8129AB0E6-001/tempDir-001/control/data,
 hostContext=/t/ho, hostPort=55984, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B5B6BE8129AB0E6-001/control-001/cores}
   [junit4]   2> 3915575 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@73d16e93
   [junit4]   2> 3915575 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B5B6BE8129AB0E6-001/control-001'
   [junit4]   2> 3915575 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3915575 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 3915576 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 3915576 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3915577 INFO  (zkCallback-33695-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4ff5ce8f 
name:ZooKeeperConnection Watcher:127.0.0.1:40494/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3915577 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3915578 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 3915578 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 3915578 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B5B6BE8129AB0E6-001/control-001/solr.xml
   [junit4]   2> 3915583 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B5B6BE8129AB0E6-001/control-001/cores
   [junit4]   2> 3915583 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 690163957
   [junit4]   2> 3915583 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B5B6BE8129AB0E6-001/control-001]
   [junit4]   2> 3915583 WARN  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B5B6BE8129AB0E6-001/control-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B5B6BE8129AB0E6-001/control-001/lib
   [junit4]   2> 3915584 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 3915585 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 3915585 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3915585 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3915585 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40494/solr
   [junit4]   2> 3915585 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 3915585 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 3915586 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 3915586 INFO  (zkCallback-33698-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@bfcbdcc name:ZooKeeperConnection 
Watcher:127.0.0.1:40494 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 3915587 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 3915587 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 3915588 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$56/2063007209@466526e9
   [junit4]   2> 3915588 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.ConnectionManager Waiting for client 
to connect to ZooKeeper
   [junit4]   2> 3915589 INFO  
(zkCallback-33699-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@ef5261d name:ZooKeeperConnection 
Watcher:127.0.0.1:40494/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 3915589 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.ConnectionManager Client is connected 
to ZooKeeper
   [junit4]   2> 3915590 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 3915591 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 3915594 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 3915595 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 3915596 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 3915598 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 3915599 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 3915600 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: 
/clusterstate.json
   [junit4]   2> 3915601 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 3915602 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 3915602 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.ZkStateReader Loaded empty cluster 
properties
   [junit4]   2> 3915603 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 3915605 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 3915606 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 3915606 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 3915607 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/96237208153554948-127.0.0.1:55984_t%2Fho-n_0000000000
   [junit4]   2> 3915607 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:55984_t%2Fho
   [junit4]   2> 3915607 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/leader
   [junit4]   2> 3915608 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.Overseer Overseer 
(id=96237208153554948-127.0.0.1:55984_t%2Fho-n_0000000000) starting
   [junit4]   2> 3915609 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/queue-work
   [junit4]   2> 3915614 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.OverseerAutoReplicaFailoverThread 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 3915614 INFO  
(OverseerCollectionConfigSetProcessor-96237208153554948-127.0.0.1:55984_t%2Fho-n_0000000000)
 [n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.OverseerTaskProcessor Process current 
queue of overseer operations
   [junit4]   2> 3915614 INFO  
(OverseerStateUpdate-96237208153554948-127.0.0.1:55984_t%2Fho-n_0000000000) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.Overseer Starting to work on the main 
queue
   [junit4]   2> 3915615 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:55984_t%2Fho
   [junit4]   2> 3915615 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:55984_t%2Fho
   [junit4]   2> 3915617 INFO  
(OverseerStateUpdate-96237208153554948-127.0.0.1:55984_t%2Fho-n_0000000000) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 3915617 INFO  
(zkCallback-33699-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [0])
   [junit4]   2> 3915620 INFO  
(zkCallback-33699-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 3915627 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.CoreContainer Security conf doesn't 
exist. Skipping setup for authorization module.
   [junit4]   2> 3915627 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 3915628 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B5B6BE8129AB0E6-001/control-001/cores
   [junit4]   2> 3915629 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: 
{name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, 
loadOnStartup=true, configSetProperties=configsetprops.json, 
collection=control_collection, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 3915629 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.CorePropertiesLocator Found core 
collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B5B6BE8129AB0E6-001/control-001/cores/collection1
   [junit4]   2> 3915629 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.CorePropertiesLocator Found 1 core 
definitions
   [junit4]   2> 3915637 INFO  
(coreLoadExecutor-9578-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho c:control_collection   x:collection1] 
o.a.s.c.ZkController publishing state=down
   [junit4]   2> 3915637 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1
   [junit4]   2> 3915638 INFO  
(TEST-CollectionsAPIDistributedZkTest.test-seed#[6B5B6BE8129AB0E6]) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 3915637 INFO  
(coreLoadExecutor-9578-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho c:control_collection   x:collection1] 
o.a.s.c.ZkController numShards not found on descriptor - reading it from system 
property
   [junit4]   2> 3915638 INFO  
(coreLoadExecutor-9578-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho c:control_collection   x:collection1] 
o.a.s.c.ZkController Collection control_collection not visible yet, but 
flagging it so a watch is registered when it becomes visible
   [junit4]   2> 3915639 INFO  
(OverseerStateUpdate-96237208153554948-127.0.0.1:55984_t%2Fho-n_0000000000) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:55984/t/ho";,
   [junit4]   2>   "node_name":"127.0.0.1:55984_t%2Fho",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 3915639 INFO  
(OverseerStateUpdate-96237208153554948-127.0.0.1:55984_t%2Fho-n_0000000000) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.o.ReplicaMutator Update state 
numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:55984/t/ho";,
   [junit4]   2>   "node_name":"127.0.0.1:55984_t%2Fho",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 3915639 INFO  
(coreLoadExecutor-9578-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Deleting data for [control_collection]
   [junit4]   2> 3915639 INFO  
(OverseerStateUpdate-96237208153554948-127.0.0.1:55984_t%2Fho-n_0000000000) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.o.ClusterStateMutator building a new 
cName: control_collection
   [junit4]   2> 3915640 INFO  
(OverseerStateUpdate-96237208153554948-127.0.0.1:55984_t%2Fho-n_0000000000) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.o.ReplicaMutator Assigning new node to 
shard shard=shard1
   [junit4]   2> 3915640 INFO  
(coreLoadExecutor-9578-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho c:control_collection   x:collection1] 
o.a.s.c.ZkController look for our core node name
   [junit4]   2> 3915641 INFO  
(zkCallback-33699-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho    ] o.a.s.c.c.ZkStateReader A cluster state change: 
[WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 3916641 INFO  
(coreLoadExecutor-9578-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho c:control_collection   x:collection1] 
o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 3916641 INFO  
(coreLoadExecutor-9578-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho c:control_collection   x:collection1] 
o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 3916641 INFO  
(coreLoadExecutor-9578-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho c:control_collection   x:collection1] 
o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 3916641 INFO  
(coreLoadExecutor-9578-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config from: 
[/collections/control_collection]
   [junit4]   2> 3916642 INFO  
(coreLoadExecutor-9578-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader path=[/collections/control_collection] 
[configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 3916642 INFO  
(coreLoadExecutor-9578-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_6B5B6BE8129AB0E6-001/control-001/cores/collection1'
   [junit4]   2> 3916642 INFO  
(coreLoadExecutor-9578-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3916642 INFO  
(coreLoadExecutor-9578-thread-1-processing-n:127.0.0.1:55984_t%2Fho) 
[n:127.0.0.1:55984_t%2Fho c:

[...truncated too long message...]

htlyTests-6.x/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/hadoop-common-2.7.2-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/hadoop-hdfs-2.7.2-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/hadoop-minikdc-2.7.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/htrace-core-3.2.0-incubating.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/jackson-core-asl-1.9.13.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/jackson-mapper-asl-1.9.13.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/mockito-core-1.9.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/netty-all-4.0.36.Final.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/build/analysis/icu/lucene-analyzers-icu-6.2.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/build/queryparser/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/contrib/analysis-extras/lib/icu4j-56.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.8/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.3.4.jar
 com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/temp/junit4-J2-20160714_012219_720.events
 
@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/temp/junit4-J2-20160714_012219_720.suites
 -stdin
   [junit4] ERROR: JVM J2 ended with an exception: Quit event not received from 
the forked process? This may indicate JVM crash or runner bugs.
   [junit4]     at 
com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1501)
   [junit4]     at 
com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:121)
   [junit4]     at 
com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:955)
   [junit4]     at 
com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:952)
   [junit4]     at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]     at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]     at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]     at java.lang.Thread.run(Thread.java:745)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:770: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:707: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:59: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/common-build.xml:530:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1443:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:984:
 At least one slave process threw an exception, first: Quit event not received 
from the forked process? This may indicate JVM crash or runner bugs.

Total time: 285 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to