Build: https://builds.apache.org/job/Lucene-Solr-Tests-6.x/334/

2 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.overseer.ZkStateWriterTest

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.overseer.ZkStateWriterTest:     1) Thread[id=7161, 
name=watches-1143-thread-1, state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]  
       at sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         
at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.overseer.ZkStateWriterTest: 
   1) Thread[id=7161, name=watches-1143-thread-1, state=TIMED_WAITING, 
group=TGRP-ZkStateWriterTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([473C18A14CFA9A0C]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.overseer.ZkStateWriterTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=7161, name=watches-1143-thread-1, state=TIMED_WAITING, 
group=TGRP-ZkStateWriterTest]         at sun.misc.Unsafe.park(Native Method)    
     at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)  
       at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         
at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=7161, name=watches-1143-thread-1, state=TIMED_WAITING, 
group=TGRP-ZkStateWriterTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([473C18A14CFA9A0C]:0)




Build Log:
[...truncated 11589 lines...]
   [junit4] Suite: org.apache.solr.cloud.overseer.ZkStateWriterTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateWriterTest_473C18A14CFA9A0C-001/init-core-data-001
   [junit4]   2> 1168885 INFO  
(SUITE-ZkStateWriterTest-seed#[473C18A14CFA9A0C]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1168886 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.SolrTestCaseJ4 ###Starting testZkStateWriterBatching
   [junit4]   2> 1168886 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1168887 INFO  (Thread-1600) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1168887 INFO  (Thread-1600) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1168987 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.ZkTestServer start zk server on port:57961
   [junit4]   2> 1168987 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1168988 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1168989 INFO  (zkCallback-1136-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@358833de 
name:ZooKeeperConnection Watcher:127.0.0.1:57961 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1168990 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1168990 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1168991 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1168992 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1168992 INFO  (zkCallback-1137-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2422ed52 
name:ZooKeeperConnection Watcher:127.0.0.1:57961 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1168992 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1168992 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1168992 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1168996 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1169001 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1169001 INFO  (zkCallback-1138-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@58eadb29 
name:ZooKeeperConnection Watcher:127.0.0.1:57961/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1169001 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1169002 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1169002 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1169003 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1169004 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1169005 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1169006 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1169006 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1169007 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 1169007 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1169008 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1169009 INFO  (zkCallback-1138-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1169009 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.c.SolrZkClient makePath: /collections/c2
   [junit4]   2> 1169011 INFO  (zkCallback-1138-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1169011 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.o.ZkStateWriter going to create_collection /collections/c1/state.json
   [junit4]   2> 1169013 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57961 57961
   [junit4]   2> 1169182 INFO  (Thread-1600) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:57961 57961
   [junit4]   2> 1169183 INFO  
(TEST-ZkStateWriterTest.testZkStateWriterBatching-seed#[473C18A14CFA9A0C]) [    
] o.a.s.SolrTestCaseJ4 ###Ending testZkStateWriterBatching
   [junit4]   2> 1169189 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalModificationToStateFormat2
   [junit4]   2> 1169189 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1169198 INFO  (Thread-1601) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1169198 INFO  (Thread-1601) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1169298 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.ZkTestServer start zk server on port:39624
   [junit4]   2> 1169298 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1169312 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1169321 INFO  (zkCallback-1140-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@220b1fc0 
name:ZooKeeperConnection Watcher:127.0.0.1:39624 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1169322 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1169322 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1169324 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1169337 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1169365 INFO  (zkCallback-1141-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1b87157a 
name:ZooKeeperConnection Watcher:127.0.0.1:39624 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1169365 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1169366 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1169366 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1169368 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1169381 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1169394 INFO  (zkCallback-1142-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@17442429 
name:ZooKeeperConnection Watcher:127.0.0.1:39624/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1169394 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1169394 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1169395 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1169396 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1169397 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1169397 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1169398 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1169399 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1169399 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 1169400 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1169401 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1169402 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c2
   [junit4]   2> 1169403 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c2/state.json
   [junit4]   2> 1169404 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ZkStateReader Checking legacy cluster state for collection c2
   [junit4]   2> 1169404 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ZkStateReader Adding lazily-loaded reference for collection c2
   [junit4]   2> 1169405 INFO  (zkCallback-1142-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1169413 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.o.ZkStateWriterTest Cluster state: live 
nodes:[]collections:{c2=LazyCollectionRef(c2)}
   [junit4]   2> 1169425 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ZkStateReader Refreshing lazily-loaded state for collection c2
   [junit4]   2> 1169426 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.o.ZkStateWriter going to update_collection 
/collections/c2/state.json version: 0
   [junit4]   2> 1169427 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39624 39624
   [junit4]   2> 1169646 INFO  (Thread-1601) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:39624 39624
   [junit4]   2> 1169647 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToStateFormat2-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalModificationToStateFormat2
   [junit4]   2> 1169649 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.SolrTestCaseJ4 ###Starting testSingleLegacyCollection
   [junit4]   2> 1169650 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1169654 INFO  (Thread-1602) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1169654 INFO  (Thread-1602) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1169754 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.ZkTestServer start zk server on port:41329
   [junit4]   2> 1169755 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1169761 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1169789 INFO  (zkCallback-1144-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@452bb7c6 
name:ZooKeeperConnection Watcher:127.0.0.1:41329 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1169789 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1169790 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1169810 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1169813 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1169838 INFO  (zkCallback-1145-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@637f0b1 name:ZooKeeperConnection 
Watcher:127.0.0.1:41329 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1169841 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1169841 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1169841 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1169925 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1169933 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1169949 INFO  (zkCallback-1146-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@cb39bb0 name:ZooKeeperConnection 
Watcher:127.0.0.1:41329/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 1169953 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1169953 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1169962 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1169974 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1169975 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1169976 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1169977 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1169981 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1169982 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 1169982 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1169983 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1169984 INFO  (zkCallback-1146-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1170009 INFO  (zkCallback-1146-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 1170022 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41329 41329
   [junit4]   2> 1170193 INFO  (Thread-1602) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:41329 41329
   [junit4]   2> 1170195 INFO  
(TEST-ZkStateWriterTest.testSingleLegacyCollection-seed#[473C18A14CFA9A0C]) [   
 ] o.a.s.SolrTestCaseJ4 ###Ending testSingleLegacyCollection
   [junit4]   2> 1170197 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.SolrTestCaseJ4 ###Starting testSingleExternalCollection
   [junit4]   2> 1170197 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1170203 INFO  (Thread-1603) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1170203 INFO  (Thread-1603) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1170305 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.ZkTestServer start zk server on port:41327
   [junit4]   2> 1170305 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1170316 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1170333 INFO  (zkCallback-1148-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4d74bb96 
name:ZooKeeperConnection Watcher:127.0.0.1:41327 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1170333 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1170334 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1170335 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1170357 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1170369 INFO  (zkCallback-1149-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@52c87ed3 
name:ZooKeeperConnection Watcher:127.0.0.1:41327 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1170373 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1170373 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1170373 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1170382 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1170383 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1170384 INFO  (zkCallback-1150-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1fa94e54 
name:ZooKeeperConnection Watcher:127.0.0.1:41327/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1170384 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1170384 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1170384 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1170385 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1170386 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1170387 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1170388 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1170389 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1170390 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 1170390 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1170392 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1170393 INFO  (zkCallback-1150-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1170393 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 1170395 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41327 41327
   [junit4]   2> 1170524 INFO  (Thread-1603) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:41327 41327
   [junit4]   2> 1170525 INFO  
(TEST-ZkStateWriterTest.testSingleExternalCollection-seed#[473C18A14CFA9A0C]) [ 
   ] o.a.s.SolrTestCaseJ4 ###Ending testSingleExternalCollection
   [junit4]   2> 1170528 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting 
testExternalModificationToSharedClusterState
   [junit4]   2> 1170528 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1170529 INFO  (Thread-1604) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1170529 INFO  (Thread-1604) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1170629 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.ZkTestServer start zk server on port:56884
   [junit4]   2> 1170629 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1170629 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1170631 INFO  (zkCallback-1152-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6190bf24 
name:ZooKeeperConnection Watcher:127.0.0.1:56884 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1170631 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1170631 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1170632 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1170632 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1170637 INFO  (zkCallback-1153-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4eba6486 
name:ZooKeeperConnection Watcher:127.0.0.1:56884 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1170637 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1170637 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1170637 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1170639 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1170645 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1170646 INFO  (zkCallback-1154-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4595abc5 
name:ZooKeeperConnection Watcher:127.0.0.1:56884/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1170646 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1170646 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1170647 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1170648 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1170649 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1170650 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1170651 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1170652 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1170652 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 1170653 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1170654 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1170655 INFO  (zkCallback-1154-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1170655 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c2
   [junit4]   2> 1170656 INFO  (zkCallback-1154-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1170657 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ZkStateReader Refreshing lazily-loaded state for collection c1
   [junit4]   2> 1170657 INFO  (zkCallback-1154-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 1170658 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.c.ZkStateReader Refreshing lazily-loaded state for collection c2
   [junit4]   2> 1170659 INFO  (zkCallback-1154-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 1170665 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:56884 56884
   [junit4]   2> 1170790 INFO  (Thread-1604) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:56884 56884
   [junit4]   2> 1170792 INFO  
(TEST-ZkStateWriterTest.testExternalModificationToSharedClusterState-seed#[473C18A14CFA9A0C])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending 
testExternalModificationToSharedClusterState
   [junit4]   2> 1170793 INFO  
(SUITE-ZkStateWriterTest-seed#[473C18A14CFA9A0C]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Jul 15, 2016 9:11:32 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 4 leaked 
thread(s).
   [junit4]   2> Jul 15, 2016 9:11:53 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.solr.cloud.overseer.ZkStateWriterTest: 
   [junit4]   2>    1) Thread[id=7161, name=watches-1143-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Jul 15, 2016 9:11:53 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=7161, name=watches-1143-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]   2> Jul 15, 2016 9:11:56 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be 
terminated:
   [junit4]   2>    1) Thread[id=7161, name=watches-1143-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]   2>         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): {}, 
docValues:{}, maxPointsInLeafNode=1627, maxMBSortInHeap=5.448402608736425, 
sim=ClassicSimilarity, locale=fi-FI, timezone=Asia/Colombo
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_74 (64-bit)/cpus=4,threads=2,free=140170808,total=527958016
   [junit4]   2> NOTE: All tests run in this JVM: 
[SignatureUpdateProcessorFactoryTest, TestManagedSchemaAPI, 
QueryElevationComponentTest, TestReRankQParserPlugin, 
TestAnalyzeInfixSuggestions, ZkNodePropsTest, TestJoin, 
DistributedFacetPivotWhiteBoxTest, RAMDirectoryFactoryTest, HdfsNNFailoverTest, 
TestCrossCoreJoin, TestSQLHandler, BasicDistributedZkTest, TestBadConfig, 
CreateCollectionCleanupTest, RemoteQueryErrorTest, TestFaceting, SolrCoreTest, 
SolrRequestParserTest, CloudExitableDirectoryReaderTest, DocValuesMissingTest, 
TestCloudSchemaless, IndexSchemaTest, ConnectionReuseTest, 
TestDistributedSearch, TestTolerantUpdateProcessorRandomCloud, 
TestShortCircuitedRequests, ResourceLoaderTest, 
DistributedSuggestComponentTest, TestSha256AuthenticationProvider, 
UUIDFieldTest, DisMaxRequestHandlerTest, TestAnalyzedSuggestions, 
TestBinaryField, AsyncCallRequestStatusResponseTest, SmileWriterTest, 
ShardSplitTest, URLClassifyProcessorTest, CdcrReplicationDistributedZkTest, 
SolrXmlInZkTest, AlternateDirectoryTest, PingRequestHandlerTest, 
DistributedFacetPivotLongTailTest, PrimUtilsTest, TestLockTree, 
TestTestInjection, TestCollectionAPI, IndexSchemaRuntimeFieldTest, 
RequiredFieldsTest, ForceLeaderTest, TestFreeTextSuggestions, 
DefaultValueUpdateProcessorTest, MultiThreadedOCPTest, TestRealTimeGet, 
TestLMDirichletSimilarityFactory, TestInfoStreamLogging, 
SimpleCollectionCreateDeleteTest, TestRangeQuery, TestRemoteStreaming, 
ResponseLogComponentTest, JSONWriterTest, TestBulkSchemaConcurrent, 
SystemInfoHandlerTest, TestManagedStopFilterFactory, OverseerStatusTest, 
TestRandomFaceting, TestComponentsName, DeleteStatusTest, SOLR749Test, 
ZkStateWriterTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkStateWriterTest 
-Dtests.seed=473C18A14CFA9A0C -Dtests.multiplier=2 -Dtests.slow=true 
-Dtests.locale=fi-FI -Dtests.timezone=Asia/Colombo -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J0 | ZkStateWriterTest (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.overseer.ZkStateWriterTest: 
   [junit4]    >    1) Thread[id=7161, name=watches-1143-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([473C18A14CFA9A0C]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=7161, name=watches-1143-thread-1, 
state=TIMED_WAITING, group=TGRP-ZkStateWriterTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at 
java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([473C18A14CFA9A0C]:0)
   [junit4] Completed [296/621 (1!)] on J0 in 25.12s, 5 tests, 2 errors <<< 
FAILURES!

[...truncated 1033 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:763: The 
following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:707: The 
following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/build.xml:59: The 
following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/build.xml:233: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/solr/common-build.xml:536:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/common-build.xml:1443:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-6.x/lucene/common-build.xml:984:
 There were test failures: 621 suites (10 ignored), 2642 tests, 2 suite-level 
errors, 1360 ignored (70 assumptions) [seed: 473C18A14CFA9A0C]

Total time: 58 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to