Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2386/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ZkControllerTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.ZkControllerTest:     
1) Thread[id=10795, 
name=OverseerStateUpdate-93946417128144899-127.0.0.1:8983_solr-n_0000000000, 
state=TIMED_WAITING, group=Overseer state updater.]         at 
java.lang.Object.wait(Native Method)         at 
org.apache.solr.cloud.DistributedQueue$LatchWatcher.await(DistributedQueue.java:276)
         at 
org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:320)   
      at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:594) 
        at 
org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:572)         
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:190)    
     at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.ZkControllerTest: 
   1) Thread[id=10795, 
name=OverseerStateUpdate-93946417128144899-127.0.0.1:8983_solr-n_0000000000, 
state=TIMED_WAITING, group=Overseer state updater.]
        at java.lang.Object.wait(Native Method)
        at 
org.apache.solr.cloud.DistributedQueue$LatchWatcher.await(DistributedQueue.java:276)
        at 
org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:320)
        at 
org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:594)
        at 
org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:572)
        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:190)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([CB8C4132A62525]:0)




Build Log:
[...truncated 10220 lines...]
   [junit4] Suite: org.apache.solr.cloud.ZkControllerTest
   [junit4]   2> Creating dataDir: 
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.ZkControllerTest
 CB8C4132A62525-001/init-core-data-001
   [junit4]   2> 2116074 INFO  
(SUITE-ZkControllerTest-seed#[CB8C4132A62525]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 2116077 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testReadConfigName
   [junit4]   2> 2116077 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2116079 INFO  (Thread-4141) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2116079 INFO  (Thread-4141) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 2116180 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:49876
   [junit4]   2> 2116180 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2116182 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2116196 INFO  (zkCallback-1302-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@e4970ce name:ZooKeeperConnection 
Watcher:127.0.0.1:49876 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 2116197 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2116197 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2116200 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2116202 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2116205 INFO  (zkCallback-1303-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2e210615 
name:ZooKeeperConnection Watcher:127.0.0.1:49876 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2116206 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2116206 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2116206 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2116213 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 2116217 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 2116218 INFO  (zkCallback-1304-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@63ec41e8 
name:ZooKeeperConnection Watcher:127.0.0.1:49876/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2116218 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 2116219 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2116219 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/firstConfig
   [junit4]   2> 2116225 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 2116235 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 157978452
   [junit4]   2> 2116239 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2116241 INFO  
(zkCallback-1305-thread-1-processing-n:127.0.0.1:8983_solr) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@71f79007 
name:ZooKeeperConnection Watcher:127.0.0.1:49876/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2116241 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 2116244 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 2116252 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 2116258 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 2116265 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 2116272 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 2116283 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2116288 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2116293 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2116297 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:8983_solr
   [junit4]   2> 2116298 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:8983_solr
   [junit4]   2> 2116302 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.u.UpdateShardHandler Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 2116311 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 2116316 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 2116320 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2116323 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:8983_solr
   [junit4]   2> 2116323 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/leader
   [junit4]   2> 2116328 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer 
(id=93946417128144899-127.0.0.1:8983_solr-n_0000000000) starting
   [junit4]   2> 2116334 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/queue-work
   [junit4]   2> 2116355 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 2116357 INFO  
(OverseerCollectionProcessor-93946417128144899-127.0.0.1:8983_solr-n_0000000000)
 [n:127.0.0.1:8983_solr    ] o.a.s.c.OverseerCollectionProcessor Process 
current queue of collection creations
   [junit4]   2> 2116358 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from 
ZooKeeper... 
   [junit4]   2> 2116361 INFO  
(OverseerStateUpdate-93946417128144899-127.0.0.1:8983_solr-n_0000000000) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 2116378 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/collection1
   [junit4]   2> 2116381 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ZkStateReader 
path=/collections/collection1 configName=firstConfig specified config exists in 
ZooKeeper
   [junit4]   2> 2116382 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer 
(id=93946417128144899-127.0.0.1:8983_solr-n_0000000000) closing
   [junit4]   2> 2116385 WARN  
(OverseerStateUpdate-93946417128144899-127.0.0.1:8983_solr-n_0000000000) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ZkStateReader Error reading collections 
nodes
   [junit4]   2> java.lang.InterruptedException
   [junit4]   2>        at java.lang.Object.wait(Native Method)
   [junit4]   2>        at java.lang.Object.wait(Object.java:502)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:319)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:316)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:316)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.getIndividualColls(ZkStateReader.java:513)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.constructState(ZkStateReader.java:468)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:540)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:269)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:152)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2116404 WARN  
(zkCallback-1305-thread-1-processing-n:127.0.0.1:8983_solr) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK
   [junit4]   2> 2116405 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.CoreContainer Shutting down CoreContainer 
instance=157978452
   [junit4]   2> 2116407 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49876 
49876
   [junit4]   2> 2116417 INFO  (Thread-4141) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:49876 49876
   [junit4]   2> 2117751 INFO  
(TEST-ZkControllerTest.testReadConfigName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.SolrTestCaseJ4 ###Ending testReadConfigName
   [junit4] IGNOR/A 0.03s J1 | ZkControllerTest.testPublishAndWaitForDownStates
   [junit4]    > Assumption #1: 'awaitsfix' test group is disabled 
(@AwaitsFix(bugUrl=https://issues.apache.org/jira/browse/SOLR-6665))
   [junit4]   2> 2117783 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.SolrTestCaseJ4 ###Starting 
testEnsureReplicaInLeaderInitiatedRecovery
   [junit4]   2> 2117785 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2117786 INFO  (Thread-4142) [n:127.0.0.1:8983_solr    ] 
o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2117786 INFO  (Thread-4142) [n:127.0.0.1:8983_solr    ] 
o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2117886 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer start zk server on port:49881
   [junit4]   2> 2117886 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default 
ZkCredentialsProvider
   [junit4]   2> 2117888 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2117897 INFO  
(zkCallback-1307-thread-1-processing-n:127.0.0.1:8983_solr) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@40ac3d28 
name:ZooKeeperConnection Watcher:127.0.0.1:49881 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2117898 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 2117898 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2117901 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default 
ZkCredentialsProvider
   [junit4]   2> 2117903 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2117905 INFO  
(zkCallback-1308-thread-1-processing-n:127.0.0.1:8983_solr) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2b85d659 
name:ZooKeeperConnection Watcher:127.0.0.1:49881 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2117905 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 2117905 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2117906 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2117913 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.CoreContainer New CoreContainer 1198143763
   [junit4]   2> 2117915 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2117917 INFO  
(zkCallback-1309-thread-1-processing-n:127.0.0.1:8983_solr) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6de80b0e 
name:ZooKeeperConnection Watcher:127.0.0.1:49881/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2117917 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 2117920 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 2117925 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 2117932 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 2117937 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 2117945 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 2117952 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2117956 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 2117960 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2117965 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2117969 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:8983_solr
   [junit4]   2> 2117969 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:8983_solr
   [junit4]   2> 2117975 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.u.UpdateShardHandler Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 2117976 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 2117982 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 2117986 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2117989 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:8983_solr
   [junit4]   2> 2117989 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/leader
   [junit4]   2> 2117995 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer 
(id=93946417240080386-127.0.0.1:8983_solr-n_0000000000) starting
   [junit4]   2> 2118000 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/queue-work
   [junit4]   2> 2118021 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 2118022 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 2118023 INFO  
(OverseerCollectionProcessor-93946417240080386-127.0.0.1:8983_solr-n_0000000000)
 [n:127.0.0.1:8983_solr    ] o.a.s.c.OverseerCollectionProcessor Process 
current queue of collection creations
   [junit4]   2> 2118026 INFO  
(OverseerStateUpdate-93946417240080386-127.0.0.1:8983_solr-n_0000000000) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 2118038 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer 
(id=93946417240080386-127.0.0.1:8983_solr-n_0000000000) closing
   [junit4]   2> 2118039 INFO  
(OverseerStateUpdate-93946417240080386-127.0.0.1:8983_solr-n_0000000000) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:8983_solr
   [junit4]   2> 2118045 WARN  
(zkCallback-1309-thread-1-processing-n:127.0.0.1:8983_solr) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK
   [junit4]   2> 2118046 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.CoreContainer Shutting down CoreContainer 
instance=1198143763
   [junit4]   2> 2118049 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49881 
49881
   [junit4]   2> 2118061 INFO  (Thread-4142) [n:127.0.0.1:8983_solr    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:49881 49881
   [junit4]   2> 2119545 ERROR (OverseerExitThread) [n:127.0.0.1:8983_solr    ] 
o.a.s.c.Overseer could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:298)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:259)
   [junit4]   2> 2119638 INFO  
(TEST-ZkControllerTest.testEnsureReplicaInLeaderInitiatedRecovery-seed#[CB8C4132A62525])
 [n:127.0.0.1:8983_solr    ] o.a.s.SolrTestCaseJ4 ###Ending 
testEnsureReplicaInLeaderInitiatedRecovery
   [junit4]   2> 2119644 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.SolrTestCaseJ4 ###Starting testGetHostName
   [junit4]   2> 2119646 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2119649 INFO  (Thread-4143) [n:127.0.0.1:8983_solr    ] 
o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2119650 INFO  (Thread-4143) [n:127.0.0.1:8983_solr    ] 
o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2119750 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer start zk server on port:49885
   [junit4]   2> 2119751 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default 
ZkCredentialsProvider
   [junit4]   2> 2119753 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2119765 INFO  
(zkCallback-1311-thread-1-processing-n:127.0.0.1:8983_solr) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@965502e name:ZooKeeperConnection 
Watcher:127.0.0.1:49885 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 2119765 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 2119766 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2119769 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default 
ZkCredentialsProvider
   [junit4]   2> 2119771 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2119775 INFO  
(zkCallback-1312-thread-1-processing-n:127.0.0.1:8983_solr) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@457098b7 
name:ZooKeeperConnection Watcher:127.0.0.1:49885 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2119776 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 2119776 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2119776 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2119785 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.CoreContainer New CoreContainer 337270524
   [junit4]   2> 2119786 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2119788 INFO  
(zkCallback-1313-thread-1-processing-n:127.0.0.1:8983_solr) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@590ca3f3 
name:ZooKeeperConnection Watcher:127.0.0.1:49885/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2119789 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 2119791 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 2119798 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 2119805 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 2119813 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 2119820 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 2119827 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 2119831 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 2119836 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 2119840 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 2119845 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:8983_solr
   [junit4]   2> 2119847 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:8983_solr
   [junit4]   2> 2119851 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.u.UpdateShardHandler Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 2119853 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 2119858 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 2119863 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2119868 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:8983_solr
   [junit4]   2> 2119868 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/leader
   [junit4]   2> 2119874 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer 
(id=93946417362108418-127.0.0.1:8983_solr-n_0000000000) starting
   [junit4]   2> 2119881 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/queue-work
   [junit4]   2> 2119903 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 2119906 INFO  
(OverseerCollectionProcessor-93946417362108418-127.0.0.1:8983_solr-n_0000000000)
 [n:127.0.0.1:8983_solr    ] o.a.s.c.OverseerCollectionProcessor Process 
current queue of collection creations
   [junit4]   2> 2119907 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state from 
ZooKeeper... 
   [junit4]   2> 2119907 INFO  
(OverseerStateUpdate-93946417362108418-127.0.0.1:8983_solr-n_0000000000) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 2119918 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer 
(id=93946417362108418-127.0.0.1:8983_solr-n_0000000000) closing
   [junit4]   2> 2119919 INFO  
(OverseerStateUpdate-93946417362108418-127.0.0.1:8983_solr-n_0000000000) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:8983_solr
   [junit4]   2> 2119929 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) 
[n:127.0.0.1:8983_solr    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x14dc3c4d2ca0002, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2121427 ERROR (OverseerExitThread) [n:127.0.0.1:8983_solr    ] 
o.a.s.c.Overseer could not read the data
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:353)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:350)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:298)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater$2.run(Overseer.java:259)
   [junit4]   2> 2121430 WARN  
(zkCallback-1313-thread-1-processing-n:127.0.0.1:8983_solr) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, 
but Solr cannot talk to ZK
   [junit4]   2> 2121430 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.CoreContainer Shutting down CoreContainer 
instance=337270524
   [junit4]   2> 2121431 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49885 
49885
   [junit4]   2> 2121440 INFO  (Thread-4143) [n:127.0.0.1:8983_solr    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:49885 49885
   [junit4]   2> 2123001 INFO  
(TEST-ZkControllerTest.testGetHostName-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.SolrTestCaseJ4 ###Ending testGetHostName
   [junit4]   2> 2123006 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.SolrTestCaseJ4 ###Starting 
testNodeNameUrlConversion
   [junit4]   2> 2123008 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2123009 INFO  (Thread-4144) [n:127.0.0.1:8983_solr    ] 
o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2123009 INFO  (Thread-4144) [n:127.0.0.1:8983_solr    ] 
o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2123110 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer start zk server on port:49889
   [junit4]   2> 2123110 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default 
ZkCredentialsProvider
   [junit4]   2> 2123112 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2123126 INFO  
(zkCallback-1315-thread-1-processing-n:127.0.0.1:8983_solr) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@25b27119 
name:ZooKeeperConnection Watcher:127.0.0.1:49889 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2123126 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 2123127 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2123129 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default 
ZkCredentialsProvider
   [junit4]   2> 2123133 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2123134 INFO  
(zkCallback-1316-thread-1-processing-n:127.0.0.1:8983_solr) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2646be0f 
name:ZooKeeperConnection Watcher:127.0.0.1:49889 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2123135 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 2123135 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2123135 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 2123141 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default 
ZkCredentialsProvider
   [junit4]   2> 2123143 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 2123145 INFO  
(zkCallback-1317-thread-1-processing-n:127.0.0.1:8983_solr) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@1e9bd8b2 
name:ZooKeeperConnection Watcher:127.0.0.1:49889/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2123145 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 2123146 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 2123167 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49889 
49889
   [junit4]   2> 2123196 INFO  (Thread-4144) [n:127.0.0.1:8983_solr    ] 
o.a.s.c.ZkTestServer connecting to 127.0.0.1:49889 49889
   [junit4]   2> 2124441 INFO  
(TEST-ZkControllerTest.testNodeNameUrlConversion-seed#[CB8C4132A62525]) 
[n:127.0.0.1:8983_solr    ] o.a.s.SolrTestCaseJ4 ###Ending 
testNodeNameUrlConversion
   [junit4]   2> 2124443 INFO  
(SUITE-ZkControllerTest-seed#[CB8C4132A62525]-worker) [n:127.0.0.1:8983_solr    
] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Jun 05, 2015 12:49:30 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> Jun 05, 2015 12:49:50 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.solr.cloud.ZkControllerTest: 
   [junit4]   2>    1) Thread[id=10795, 
name=OverseerStateUpdate-93946417128144899-127.0.0.1:8983_solr-n_0000000000, 
state=TIMED_WAITING, group=Overseer state updater.]
   [junit4]   2>         at java.lang.Object.wait(Native Method)
   [junit4]   2>         at 
org.apache.solr.cloud.DistributedQueue$LatchWatcher.await(DistributedQueue.java:276)
   [junit4]   2>         at 
org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:320)
   [junit4]   2>         at 
org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:594)
   [junit4]   2>         at 
org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:572)
   [junit4]   2>         at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:190)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Jun 05, 2015 12:49:50 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=10795, 
name=OverseerStateUpdate-93946417128144899-127.0.0.1:8983_solr-n_0000000000, 
state=TIMED_WAITING, group=Overseer state updater.]
   [junit4]   2> 2144687 INFO  
(OverseerStateUpdate-93946417128144899-127.0.0.1:8983_solr-n_0000000000) 
[n:127.0.0.1:8983_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:8983_solr
   [junit4]   2> Jun 05, 2015 12:49:50 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {}, 
docValues:{}, sim=DefaultSimilarity, locale=de_CH, 
timezone=America/Port-au-Prince
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_45 
(64-bit)/cpus=3,threads=1,free=127768976,total=421527552
   [junit4]   2> NOTE: All tests run in this JVM: [HighlighterMaxOffsetTest, 
TestBulkSchemaAPI, XsltUpdateRequestHandlerTest, TestMaxScoreQueryParser, 
TestZkChroot, CollectionsAPIAsyncDistributedZkTest, ChangedSchemaMergeTest, 
BasicDistributedZk2Test, TestDocSet, TestJoin, TestSchemaNameResource, 
TestCollectionAPI, SpellingQueryConverterTest, DistribJoinFromCollectionTest, 
DirectUpdateHandlerOptimizeTest, SolrTestCaseJ4Test, 
HdfsBasicDistributedZk2Test, DateMathParserTest, TestRemoteStreaming, 
ParsingFieldUpdateProcessorsTest, TestManagedResourceStorage, TestRestoreCore, 
TestUtils, TestReplicationHandlerBackup, TestJsonRequest, 
VMParamsZkACLAndCredentialsProvidersTest, SpellCheckCollatorTest, 
LoggingHandlerTest, TestClusterStateMutator, HdfsUnloadDistributedZkTest, 
PluginInfoTest, TestTrie, TestSearchPerf, TestManagedSynonymFilterFactory, 
TestDefaultStatsCache, AnalyticsMergeStrategyTest, SolrCmdDistributorTest, 
BasicFunctionalityTest, TestCodecSupport, ConnectionManagerTest, 
OpenExchangeRatesOrgProviderTest, ResourceLoaderTest, FacetPivotSmallTest, 
TestSolrQueryParserResource, TestLMDirichletSimilarityFactory, 
ConvertedLegacyTest, TestRealTimeGet, TestMiniSolrCloudClusterSSL, 
DocExpirationUpdateProcessorFactoryTest, TestReplicaProperties, 
TestConfigOverlay, BlockDirectoryTest, MinimalSchemaTest, 
OverseerCollectionProcessorTest, FastVectorHighlighterTest, DateFieldTest, 
TestCustomSort, BadIndexSchemaTest, TestFastOutputStream, TestBadConfig, 
TestSolrJ, OpenCloseCoreStressTest, TestValueSourceCache, HdfsLockFactoryTest, 
NotRequiredUniqueKeyTest, FieldMutatingUpdateProcessorTest, 
HdfsWriteToMultipleCollectionsTest, StatelessScriptUpdateProcessorFactoryTest, 
CdcrVersionReplicationTest, DistributedTermsComponentTest, 
IndexBasedSpellCheckerTest, EnumFieldTest, TestManagedSchemaFieldResource, 
CloudMLTQParserTest, CurrencyFieldOpenExchangeTest, TestFieldResource, 
TestNoOpRegenerator, TestSolr4Spatial, TestManagedSchema, 
TestPHPSerializedResponseWriter, SuggestComponentTest, AliasIntegrationTest, 
BasicZkTest, TestOverriddenPrefixQueryForCustomFieldType, DistanceUnitsTest, 
TestDistributedGrouping, HighlighterConfigTest, RAMDirectoryFactoryTest, 
CollectionReloadTest, TestStressUserVersions, SolrIndexConfigTest, 
HdfsNNFailoverTest, ShardSplitTest, CurrencyFieldXmlFileTest, 
DistribDocExpirationUpdateProcessorTest, StatsComponentTest, TestFastWriter, 
TestRTGBase, SignatureUpdateProcessorFactoryTest, TestDistribDocBasedVersion, 
DistributedDebugComponentTest, DistribCursorPagingTest, MultiThreadedOCPTest, 
TestBlendedInfixSuggestions, ReturnFieldsTest, TestQuerySenderListener, 
TestMiniSolrCloudCluster, TestFieldCollectionResource, TestSimpleQParserPlugin, 
DirectSolrSpellCheckerTest, TestFreeTextSuggestions, TestSortingResponseWriter, 
SharedFSAutoReplicaFailoverUtilsTest, TestLMJelinekMercerSimilarityFactory, 
TestSuggestSpellingConverter, DistributedFacetPivotSmallAdvancedTest, 
AnalyticsQueryTest, TestClassNameShortening, TestImplicitCoreProperties, 
TestRecovery, TestSystemIdResolver, TestLeaderElectionZkExpiry, 
BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, 
CollectionsAPIDistributedZkTest, OverseerTest, LeaderElectionIntegrationTest, 
ShardRoutingTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, 
ClusterStateUpdateTest, TestRandomFaceting, LeaderElectionTest, 
TestRandomDVFaceting, ShardRoutingCustomTest, AutoCommitTest, TestFaceting, 
DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, 
ZkControllerTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkControllerTest 
-Dtests.seed=CB8C4132A62525 -Dtests.slow=true -Dtests.locale=de_CH 
-Dtests.timezone=America/Port-au-Prince -Dtests.asserts=true 
-Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | ZkControllerTest (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.ZkControllerTest: 
   [junit4]    >    1) Thread[id=10795, 
name=OverseerStateUpdate-93946417128144899-127.0.0.1:8983_solr-n_0000000000, 
state=TIMED_WAITING, group=Overseer state updater.]
   [junit4]    >         at java.lang.Object.wait(Native Method)
   [junit4]    >         at 
org.apache.solr.cloud.DistributedQueue$LatchWatcher.await(DistributedQueue.java:276)
   [junit4]    >         at 
org.apache.solr.cloud.DistributedQueue.getChildren(DistributedQueue.java:320)
   [junit4]    >         at 
org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:594)
   [junit4]    >         at 
org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:572)
   [junit4]    >         at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:190)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at __randomizedtesting.SeedInfo.seed([CB8C4132A62525]:0)
   [junit4] Completed [272/505] on J1 in 28.67s, 5 tests, 1 error, 1 skipped 
<<< FAILURES!

[...truncated 706 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:526: The following 
error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:474: The following 
error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The following 
error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39: The 
following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:230: The 
following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:512: 
The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1418: 
The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:973: 
There were test failures: 505 suites, 1989 tests, 1 suite-level error, 63 
ignored (24 assumptions)

Total time: 75 minutes 55 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to