Build: http://jenkins.thetaphi.de/job/Lucene-Solr-6.x-Solaris/315/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC

2 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.DistribJoinFromCollectionTest

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.DistribJoinFromCollectionTest:     1) Thread[id=3576, 
name=OverseerHdfsCoreFailoverThread-96382409877094415-127.0.0.1:40895_solr-n_0000000001,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.DistribJoinFromCollectionTest: 
   1) Thread[id=3576, 
name=OverseerHdfsCoreFailoverThread-96382409877094415-127.0.0.1:40895_solr-n_0000000001,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([6C36651FED4DBACE]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.DistribJoinFromCollectionTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=3576, 
name=OverseerHdfsCoreFailoverThread-96382409877094415-127.0.0.1:40895_solr-n_0000000001,
 state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]         at 
java.lang.Thread.interrupt0(Native Method)         at 
java.lang.Thread.interrupt(Thread.java:923)         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=3576, 
name=OverseerHdfsCoreFailoverThread-96382409877094415-127.0.0.1:40895_solr-n_0000000001,
 state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
        at java.lang.Thread.interrupt0(Native Method)
        at java.lang.Thread.interrupt(Thread.java:923)
        at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([6C36651FED4DBACE]:0)




Build Log:
[...truncated 11096 lines...]
   [junit4] Suite: org.apache.solr.cloud.DistribJoinFromCollectionTest
   [junit4]   2> Creating dataDir: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/init-core-data-001
   [junit4]   2> 980109 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: 
@org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 980110 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 980110 INFO  (Thread-874) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 980110 INFO  (Thread-874) [    ] o.a.s.c.ZkTestServer Starting 
server
   [junit4]   2> 980210 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.ZkTestServer start zk server on port:48735
   [junit4]   2> 980210 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980211 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980213 INFO  (zkCallback-553-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@60ad5581 
name:ZooKeeperConnection Watcher:127.0.0.1:48735 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980213 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980213 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980213 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr/solr.xml
   [junit4]   2> 980218 INFO  (jetty-launcher-552-thread-1) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 980219 INFO  (jetty-launcher-552-thread-3) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 980220 INFO  (jetty-launcher-552-thread-1) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@68dc2fa7{/solr,null,AVAILABLE}
   [junit4]   2> 980221 INFO  (jetty-launcher-552-thread-1) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@236e65b{HTTP/1.1,[http/1.1]}{127.0.0.1:61478}
   [junit4]   2> 980221 INFO  (jetty-launcher-552-thread-1) [    ] 
o.e.j.s.Server Started @983485ms
   [junit4]   2> 980221 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=61478}
   [junit4]   2> 980221 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@6d06d69c
   [junit4]   2> 980222 INFO  (jetty-launcher-552-thread-4) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 980222 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node1'
   [junit4]   2> 980222 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 980222 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 980223 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980224 INFO  (jetty-launcher-552-thread-5) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 980226 INFO  (jetty-launcher-552-thread-3) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@2e8f3eed{/solr,null,AVAILABLE}
   [junit4]   2> 980226 INFO  (jetty-launcher-552-thread-3) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@6913f830{HTTP/1.1,[http/1.1]}{127.0.0.1:35567}
   [junit4]   2> 980226 INFO  (jetty-launcher-552-thread-3) [    ] 
o.e.j.s.Server Started @983490ms
   [junit4]   2> 980226 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=35567}
   [junit4]   2> 980226 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@6d06d69c
   [junit4]   2> 980226 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node2'
   [junit4]   2> 980226 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 980226 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 980226 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980227 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980227 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980230 INFO  (jetty-launcher-552-thread-5) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@175aebbb{/solr,null,AVAILABLE}
   [junit4]   2> 980230 INFO  (jetty-launcher-552-thread-5) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@64abc29b{HTTP/1.1,[http/1.1]}{127.0.0.1:40895}
   [junit4]   2> 980230 INFO  (jetty-launcher-552-thread-5) [    ] 
o.e.j.s.Server Started @983495ms
   [junit4]   2> 980230 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=40895}
   [junit4]   2> 980231 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@6d06d69c
   [junit4]   2> 980231 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node5'
   [junit4]   2> 980231 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 980231 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 980231 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980231 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980233 INFO  (jetty-launcher-552-thread-2) [    ] 
o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 980234 INFO  (jetty-launcher-552-thread-4) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@6a2d29a5{/solr,null,AVAILABLE}
   [junit4]   2> 980234 INFO  (jetty-launcher-552-thread-4) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@1d171480{HTTP/1.1,[http/1.1]}{127.0.0.1:60428}
   [junit4]   2> 980234 INFO  (jetty-launcher-552-thread-4) [    ] 
o.e.j.s.Server Started @983499ms
   [junit4]   2> 980234 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=60428}
   [junit4]   2> 980234 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@6d06d69c
   [junit4]   2> 980234 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node4'
   [junit4]   2> 980235 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 980235 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 980235 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980236 INFO  (jetty-launcher-552-thread-2) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@77bbc038{/solr,null,AVAILABLE}
   [junit4]   2> 980236 INFO  (jetty-launcher-552-thread-2) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@305aa15e{HTTP/1.1,[http/1.1]}{127.0.0.1:36705}
   [junit4]   2> 980236 INFO  (jetty-launcher-552-thread-2) [    ] 
o.e.j.s.Server Started @983500ms
   [junit4]   2> 980236 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, 
hostPort=36705}
   [junit4]   2> 980236 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980236 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@6d06d69c
   [junit4]   2> 980236 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node3'
   [junit4]   2> 980236 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 980236 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 980237 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980238 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980239 INFO  (zkCallback-555-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@17bf3367 
name:ZooKeeperConnection Watcher:127.0.0.1:48735/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980240 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980240 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980241 INFO  (zkCallback-554-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@709b1699 
name:ZooKeeperConnection Watcher:127.0.0.1:48735/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980241 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980241 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980242 INFO  (zkCallback-556-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@75eb6097 
name:ZooKeeperConnection Watcher:127.0.0.1:48735/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980242 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980242 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980242 INFO  (zkCallback-558-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3b755ef6 
name:ZooKeeperConnection Watcher:127.0.0.1:48735/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980243 INFO  (zkCallback-557-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@22453af3 
name:ZooKeeperConnection Watcher:127.0.0.1:48735/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980243 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980243 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980243 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980243 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980244 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 980244 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 980244 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 980244 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 980244 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 980262 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node4/.
   [junit4]   2> 980262 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.CoreContainer New CoreContainer 674623412
   [junit4]   2> 980262 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node4]
   [junit4]   2> 980263 WARN  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node4/lib
 to classpath: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node4/lib
   [junit4]   2> 980265 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node3/.
   [junit4]   2> 980265 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node5/.
   [junit4]   2> 980265 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.CoreContainer New CoreContainer 1006147376
   [junit4]   2> 980264 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node1/.
   [junit4]   2> 980265 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node5]
   [junit4]   2> 980265 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.CoreContainer New CoreContainer 1874561849
   [junit4]   2> 980263 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.CorePropertiesLocator Config-defined core root directory: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node2/.
   [junit4]   2> 980265 WARN  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node5/lib
 to classpath: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node5/lib
   [junit4]   2> 980265 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.CoreContainer New CoreContainer 613006323
   [junit4]   2> 980265 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node2]
   [junit4]   2> 980265 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : 
false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
   [junit4]   2> 980265 WARN  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node2/lib
 to classpath: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node2/lib
   [junit4]   2> 980265 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : 
false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
   [junit4]   2> 980266 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : 
false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
   [junit4]   2> 980265 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.CoreContainer New CoreContainer 65130232
   [junit4]   2> 980266 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node3]
   [junit4]   2> 980266 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node1]
   [junit4]   2> 980267 WARN  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node3/lib
 to classpath: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node3/lib
   [junit4]   2> 980267 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : 
false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
   [junit4]   2> 980267 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 980267 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 980267 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 980268 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 980268 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 980268 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 980268 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 980268 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48735/solr
   [junit4]   2> 980268 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 980270 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 980267 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 980270 WARN  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node1/lib
 to classpath: 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node1/lib
   [junit4]   2> 980270 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : 
false,connectionsEvictorSleepDelay : 5000,maxConnectionIdleTime : 40000,
   [junit4]   2> 980270 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 980271 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 980268 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 980271 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980272 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980268 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48735/solr
   [junit4]   2> 980272 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 980272 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48735/solr
   [junit4]   2> 980273 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 980273 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980273 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980270 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 980274 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 980274 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 980274 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48735/solr
   [junit4]   2> 980274 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 980274 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980275 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980270 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48735/solr
   [junit4]   2> 980277 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 980277 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980277 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980272 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980279 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980279 INFO  (zkCallback-572-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@484250cc 
name:ZooKeeperConnection Watcher:127.0.0.1:48735 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980279 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980280 INFO  (jetty-launcher-552-thread-1) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980281 INFO  (zkCallback-569-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@65a10469 
name:ZooKeeperConnection Watcher:127.0.0.1:48735 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980281 INFO  (zkCallback-571-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@588f6e21 
name:ZooKeeperConnection Watcher:127.0.0.1:48735 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980282 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980282 INFO  (jetty-launcher-552-thread-4) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980282 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980282 INFO  (jetty-launcher-552-thread-3) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980285 INFO  (zkCallback-570-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@194c8d3b 
name:ZooKeeperConnection Watcher:127.0.0.1:48735 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980286 INFO  (zkCallback-573-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4468e239 
name:ZooKeeperConnection Watcher:127.0.0.1:48735 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980287 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x1566b4a87520008, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 980290 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x1566b4a87520007, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 980289 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$71/1376028285@75200c7
   [junit4]   2> 980290 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 980287 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980291 INFO  (jetty-launcher-552-thread-5) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980287 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980291 INFO  (jetty-launcher-552-thread-2) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980287 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$71/1376028285@694ab84a
   [junit4]   2> 980291 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 980287 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$71/1376028285@134ff42b
   [junit4]   2> 980291 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 980294 INFO  
(zkCallback-574-thread-1-processing-n:127.0.0.1:60428_solr) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6ca880b6 
name:ZooKeeperConnection Watcher:127.0.0.1:48735/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980294 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 980294 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x1566b4a8752000a, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 980294 INFO  
(zkCallback-575-thread-1-processing-n:127.0.0.1:35567_solr) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3fdfcd5c 
name:ZooKeeperConnection Watcher:127.0.0.1:48735/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980297 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 980297 INFO  
(zkCallback-576-thread-1-processing-n:127.0.0.1:61478_solr) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@351c5da name:ZooKeeperConnection 
Watcher:127.0.0.1:48735/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 980298 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$71/1376028285@7116dc23
   [junit4]   2> 980299 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 980299 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 980300 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.ZkController Added new OnReconnect 
listener org.apache.solr.cloud.ZkController$$Lambda$71/1376028285@4494bbac
   [junit4]   2> 980301 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ConnectionManager Waiting for client to 
connect to ZooKeeper
   [junit4]   2> 980301 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 980301 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 980302 INFO  
(zkCallback-577-thread-1-processing-n:127.0.0.1:36705_solr) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7e50aeb5 
name:ZooKeeperConnection Watcher:127.0.0.1:48735/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980303 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 980306 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 980308 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 980309 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 980311 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 980312 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 980313 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 980314 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 980316 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 980316 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 980317 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ZkStateReader Loaded empty cluster 
properties
   [junit4]   2> 980317 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (0)
   [junit4]   2> 980320 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 980321 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 980322 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 980323 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/96382409877094412-127.0.0.1:35567_solr-n_0000000000
   [junit4]   2> 980323 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.OverseerElectionContext I am going to be 
the leader 127.0.0.1:35567_solr
   [junit4]   2> 980323 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/leader
   [junit4]   2> 980324 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.Overseer Overseer 
(id=96382409877094412-127.0.0.1:35567_solr-n_0000000000) starting
   [junit4]   2> 980326 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/queue-work
   [junit4]   2> 980331 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting 
OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 980332 INFO  
(OverseerCollectionConfigSetProcessor-96382409877094412-127.0.0.1:35567_solr-n_0000000000)
 [n:127.0.0.1:35567_solr    ] o.a.s.c.OverseerTaskProcessor Process current 
queue of overseer operations
   [junit4]   2> 980332 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:35567_solr
   [junit4]   2> 980332 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:35567_solr
   [junit4]   2> 980333 INFO  
(OverseerStateUpdate-96382409877094412-127.0.0.1:35567_solr-n_0000000000) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 980334 INFO  
(zkCallback-575-thread-1-processing-n:127.0.0.1:35567_solr) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [0])
   [junit4]   2> 980339 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 980343 INFO  
(zkCallback-578-thread-1-processing-n:127.0.0.1:40895_solr) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@71c08880 
name:ZooKeeperConnection Watcher:127.0.0.1:48735/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980343 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ConnectionManager Client is connected to 
ZooKeeper
   [junit4]   2> 980354 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 980354 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ZkStateReader Loaded empty cluster 
properties
   [junit4]   2> 980355 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 980357 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 980358 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/96382409877094415-127.0.0.1:40895_solr-n_0000000001
   [junit4]   2> 980358 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/96382409877094412-127.0.0.1:35567_solr-n_0000000000 to 
know if I could be the leader
   [junit4]   2> 980359 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:40895_solr as DOWN
   [junit4]   2> 980360 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:40895_solr
   [junit4]   2> 980360 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:40895_solr
   [junit4]   2> 980369 INFO  
(zkCallback-578-thread-1-processing-n:127.0.0.1:40895_solr) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [1])
   [junit4]   2> 980370 INFO  
(OverseerStateUpdate-96382409877094412-127.0.0.1:35567_solr-n_0000000000) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 980371 INFO  
(zkCallback-575-thread-2-processing-n:127.0.0.1:35567_solr) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [2])
   [junit4]   2> 980371 INFO  
(OverseerStateUpdate-96382409877094412-127.0.0.1:35567_solr-n_0000000000) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:40895_solr"} current state version: 0
   [junit4]   2> 980371 INFO  
(OverseerStateUpdate-96382409877094412-127.0.0.1:35567_solr-n_0000000000) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for 
node: 127.0.0.1:40895_solr
   [junit4]   2> 980372 INFO  
(zkCallback-575-thread-2-processing-n:127.0.0.1:35567_solr) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (2)
   [junit4]   2> 980379 INFO  
(zkCallback-578-thread-1-processing-n:127.0.0.1:40895_solr) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (1) -> (2)
   [junit4]   2> 980384 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 980385 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.c.ZkStateReader Loaded empty cluster 
properties
   [junit4]   2> 980385 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 980386 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 980387 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.c.ZkStateReader Loaded empty cluster 
properties
   [junit4]   2> 980387 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 980389 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 980390 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/96382409877094411-127.0.0.1:60428_solr-n_0000000002
   [junit4]   2> 980390 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/96382409877094415-127.0.0.1:40895_solr-n_0000000001 to 
know if I could be the leader
   [junit4]   2> 980391 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:60428_solr as DOWN
   [junit4]   2> 980392 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:60428_solr
   [junit4]   2> 980392 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:60428_solr
   [junit4]   2> 980393 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 980393 INFO  
(zkCallback-575-thread-2-processing-n:127.0.0.1:35567_solr) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [2])
   [junit4]   2> 980393 INFO  
(zkCallback-574-thread-1-processing-n:127.0.0.1:60428_solr) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [2])
   [junit4]   2> 980395 INFO  
(OverseerStateUpdate-96382409877094412-127.0.0.1:35567_solr-n_0000000000) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:60428_solr"} current state version: 0
   [junit4]   2> 980395 INFO  
(OverseerStateUpdate-96382409877094412-127.0.0.1:35567_solr-n_0000000000) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for 
node: 127.0.0.1:60428_solr
   [junit4]   2> 980396 INFO  
(zkCallback-578-thread-1-processing-n:127.0.0.1:40895_solr) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [2])
   [junit4]   2> 980396 INFO  
(zkCallback-578-thread-1-processing-n:127.0.0.1:40895_solr) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 980397 INFO  
(zkCallback-575-thread-2-processing-n:127.0.0.1:35567_solr) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 980397 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/96382409877094413-127.0.0.1:61478_solr-n_0000000003
   [junit4]   2> 980397 INFO  
(zkCallback-576-thread-1-processing-n:127.0.0.1:61478_solr) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [2])
   [junit4]   2> 980405 INFO  
(zkCallback-574-thread-1-processing-n:127.0.0.1:60428_solr) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 980406 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/96382409877094411-127.0.0.1:60428_solr-n_0000000002 to 
know if I could be the leader
   [junit4]   2> 980409 INFO  
(zkCallback-576-thread-1-processing-n:127.0.0.1:61478_solr) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (2) -> (3)
   [junit4]   2> 980409 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:61478_solr as DOWN
   [junit4]   2> 980414 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.c.ZkStateReader Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 980415 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.c.ZkStateReader Loaded empty cluster 
properties
   [junit4]   2> 980415 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (3)
   [junit4]   2> 980418 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 980418 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.LeaderElector Joined leadership election 
with path: 
/overseer_elect/election/96382409877094414-127.0.0.1:36705_solr-n_0000000004
   [junit4]   2> 980419 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.LeaderElector Watching path 
/overseer_elect/election/96382409877094413-127.0.0.1:61478_solr-n_0000000003 to 
know if I could be the leader
   [junit4]   2> 980419 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.ZkController Publish 
node=127.0.0.1:36705_solr as DOWN
   [junit4]   2> 980421 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:61478_solr
   [junit4]   2> 980421 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:61478_solr
   [junit4]   2> 980421 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:36705_solr
   [junit4]   2> 980421 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:36705_solr
   [junit4]   2> 980422 INFO  
(OverseerStateUpdate-96382409877094412-127.0.0.1:35567_solr-n_0000000000) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.Overseer processMessage: queueSize: 2, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:61478_solr"} current state version: 0
   [junit4]   2> 980422 INFO  
(OverseerStateUpdate-96382409877094412-127.0.0.1:35567_solr-n_0000000000) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for 
node: 127.0.0.1:61478_solr
   [junit4]   2> 980423 INFO  
(zkCallback-577-thread-1-processing-n:127.0.0.1:36705_solr) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [3])
   [junit4]   2> 980424 INFO  
(zkCallback-578-thread-1-processing-n:127.0.0.1:40895_solr) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [3])
   [junit4]   2> 980424 INFO  
(zkCallback-575-thread-2-processing-n:127.0.0.1:35567_solr) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [3])
   [junit4]   2> 980425 INFO  
(zkCallback-576-thread-1-processing-n:127.0.0.1:61478_solr) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [3])
   [junit4]   2> 980425 INFO  
(zkCallback-574-thread-1-processing-n:127.0.0.1:60428_solr) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [3])
   [junit4]   2> 980433 INFO  
(zkCallback-578-thread-1-processing-n:127.0.0.1:40895_solr) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (4)
   [junit4]   2> 980439 INFO  
(zkCallback-578-thread-1-processing-n:127.0.0.1:40895_solr) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ZkStateReader A live node change: 
[WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], 
has occurred - updating... (live nodes size: [4])
   [junit4]   2> 980439 INFO  
(zkCallback-574-thread-1-processing-n:127.0.0.1:60428_solr) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (5)
   [junit4]   2> 980440 INFO  
(zkCallback-578-thread-1-processing-n:127.0.0.1:40895_solr) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (4) -> (5)
   [junit4]   2> 980441 INFO  
(zkCallback-577-thread-1-processing-n:127.0.0.1:36705_solr) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (5)
   [junit4]   2> 980441 INFO  
(zkCallback-576-thread-1-processing-n:127.0.0.1:61478_solr) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (5)
   [junit4]   2> 980441 INFO  
(zkCallback-575-thread-2-processing-n:127.0.0.1:35567_solr) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (3) -> (5)
   [junit4]   2> 980442 INFO  
(OverseerStateUpdate-96382409877094412-127.0.0.1:35567_solr-n_0000000000) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.Overseer processMessage: queueSize: 1, 
message = {
   [junit4]   2>   "operation":"downnode",
   [junit4]   2>   "node_name":"127.0.0.1:36705_solr"} current state version: 0
   [junit4]   2> 980442 INFO  
(OverseerStateUpdate-96382409877094412-127.0.0.1:35567_solr-n_0000000000) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.o.NodeMutator DownNode state invoked for 
node: 127.0.0.1:36705_solr
   [junit4]   2> 980461 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 980461 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 980462 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node4/.
   [junit4]   2> 980462 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions
   [junit4]   2> 980466 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 980466 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 980467 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node1/.
   [junit4]   2> 980467 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions
   [junit4]   2> 980501 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 980501 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 980502 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node3/.
   [junit4]   2> 980502 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions
   [junit4]   2> 980503 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.s.SolrDispatchFilter 
user.dir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1
   [junit4]   2> 980503 INFO  (jetty-launcher-552-thread-1) 
[n:127.0.0.1:61478_solr    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 980503 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.s.SolrDispatchFilter 
user.dir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1
   [junit4]   2> 980503 INFO  (jetty-launcher-552-thread-4) 
[n:127.0.0.1:60428_solr    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 980503 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.s.SolrDispatchFilter 
user.dir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1
   [junit4]   2> 980503 INFO  (jetty-launcher-552-thread-2) 
[n:127.0.0.1:36705_solr    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 980504 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 980504 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 980504 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node2/.
   [junit4]   2> 980504 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions
   [junit4]   2> 980509 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.s.SolrDispatchFilter 
user.dir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1
   [junit4]   2> 980509 INFO  (jetty-launcher-552-thread-3) 
[n:127.0.0.1:35567_solr    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 980510 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.CoreContainer Security conf doesn't exist. 
Skipping setup for authorization module.
   [junit4]   2> 980510 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.CoreContainer No authentication plugin 
used.
   [junit4]   2> 980511 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.CorePropertiesLocator Looking for core 
definitions underneath 
/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1/temp/solr.cloud.DistribJoinFromCollectionTest_6C36651FED4DBACE-001/tempDir-001/node5/.
   [junit4]   2> 980511 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core 
definitions
   [junit4]   2> 980513 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.s.SolrDispatchFilter 
user.dir=/export/home/jenkins/workspace/Lucene-Solr-6.x-Solaris/solr/build/solr-core/test/J1
   [junit4]   2> 980513 INFO  (jetty-launcher-552-thread-5) 
[n:127.0.0.1:40895_solr    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 980513 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980513 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980518 INFO  (zkCallback-584-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@8ed8f9c name:ZooKeeperConnection 
Watcher:127.0.0.1:48735 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 980518 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980518 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980520 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 980521 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 980521 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x1566b4a87520010, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 980535 INFO  (zkCallback-587-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3e70ae71 
name:ZooKeeperConnection Watcher:127.0.0.1:48735/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 980535 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 980536 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 980536 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 980537 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.ZkStateReader Loaded empty cluster properties
   [junit4]   2> 980537 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 980539 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-null-charfilters-analyzer.xml
   [junit4]   2> 980544 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-components-name.xml
   [junit4]   2> 980549 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-one-field-no-dynamic-field-unique-key.xml
   [junit4]   2> 980552 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/wdftypes.txt
   [junit4]   2> 980554 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-solrconfig-bogus-scriptengine-name.xml
   [junit4]   2> 980556 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-not-indexed-but-tf.xml
   [junit4]   2> 980558 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-spellchecker.xml
   [junit4]   2> 980560 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-altdirectory.xml
   [junit4]   2> 980562 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-delpolicy2.xml
   [junit4]   2> 980564 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-testxmlparser.xml
   [junit4]   2> 980567 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-luceneMatchVersion.xml
   [junit4]   2> 980569 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-master1.xml
   [junit4]   2> 980571 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/trivial.updateprocessor1.js
   [junit4]   2> 980573 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-noopregen.xml
   [junit4]   2> 980575 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-rest-lucene-match-version.xml
   [junit4]   2> 980578 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-add-schema-fields-update-processor-chains.xml
   [junit4]   2> 980580 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/trivial.updateprocessor0.js
   [junit4]   2> 980582 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-simpleqpplugin.xml
   [junit4]   2> 980584 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-implicitproperties.xml
   [junit4]   2> 980586 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-sim-default-has-no-explicit-sim.xml
   [junit4]   2> 980588 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/addfields.updateprocessor.js
   [junit4]   2> 980590 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/da_compoundDictionary.txt
   [junit4]   2> 980592 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-slave.xml
   [junit4]   2> 980594 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-minimal.xml
   [junit4]   2> 980596 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-minimal.xml
   [junit4]   2> 980598 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-warmer-randommergepolicyfactory.xml
   [junit4]   2> 980600 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/frenchArticles.txt
   [junit4]   2> 980602 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/protwords.txt
   [junit4]   2> 980604 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/throw.error.on.add.updateprocessor.js
   [junit4]   2> 980605 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-cdcr.xml
   [junit4]   2> 980606 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/stop-2.txt
   [junit4]   2> 980608 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-solrconfig-multiple-indexconfigs.xml
   [junit4]   2> 980609 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-master.xml
   [junit4]   2> 980611 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-lazywriter.xml
   [junit4]   2> 980612 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-currency.xml
   [junit4]   2> 980614 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-infostream-logging.xml
   [junit4]   2> 980615 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-warmer.xml
   [junit4]   2> 980617 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-mergepolicy-defaults.xml
   [junit4]   2> 980618 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema11.xml
   [junit4]   2> 980620 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-analyzer-class-and-nested.xml
   [junit4]   2> 980624 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig.xml
   [junit4]   2> 980626 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/blendedInfixSuggest.txt
   [junit4]   2> 980694 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-solrconfig-managed-schema-named-schema.xml.xml
   [junit4]   2> 980696 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-suggestercomponent.xml
   [junit4]   2> 980702 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/elevate.xml
   [junit4]   2> 980704 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-tolerant-update-minimal.xml
   [junit4]   2> 980706 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/phrasesuggest.txt
   [junit4]   2> 980711 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-solrconfig-unexpected-schema-attribute.xml
   [junit4]   2> 980713 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-snippet-type.xml
   [junit4]   2> 980715 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-sortingmergepolicyfactory.xml
   [junit4]   2> 980718 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-docValuesJoin.xml
   [junit4]   2> 980721 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-nontext-analyzer.xml
   [junit4]   2> 980723 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/stopwithbom.txt
   [junit4]   2> 980725 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-distrib-update-processor-chains.xml
   [junit4]   2> 980728 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-script-updateprocessor.xml
   [junit4]   2> 980729 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-basic.xml
   [junit4]   2> 980731 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/xslt/dummy.xsl
   [junit4]   2> 980734 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/xslt/xsl-update-handler-test.xsl
   [junit4]   2> 980736 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/xslt/dummy-using-include.xsl
   [junit4]   2> 980738 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-master1-keepOneBackup.xml
   [junit4]   2> 980739 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-parsing-update-processor-chains.xml
   [junit4]   2> 980741 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-required-fields.xml
   [junit4]   2> 980742 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-uniquekey-multivalued.xml
   [junit4]   2> 980744 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-mpf-solrconfig.xml
   [junit4]   2> 980745 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-distrib-interval-faceting.xml
   [junit4]   2> 980747 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-spellchecker.xml
   [junit4]   2> 980749 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-class-name-shortening-on-serialization.xml
   [junit4]   2> 980750 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-hash.xml
   [junit4]   2> 980752 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-enums.xml
   [junit4]   2> 980753 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-sweetspot-partial-norms.xml
   [junit4]   2> 980755 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-schemaless.xml
   [junit4]   2> 980756 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-dynamicfield-required.xml
   [junit4]   2> 980758 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/stoptypes-2.txt
   [junit4]   2> 980759 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-lmjelinekmercer.xml
   [junit4]   2> 980760 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-tiny.xml
   [junit4]   2> 980762 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-collapseqparser.xml
   [junit4]   2> 980763 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/hyphenation.dtd
   [junit4]   2> 980765 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-docValuesFaceting.xml
   [junit4]   2> 980766 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/keep-1.txt
   [junit4]   2> 980767 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-sweetspot-partial-baseline.xml
   [junit4]   2> 980769 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-SOLR-749.xml
   [junit4]   2> 980770 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-currency-ft-bogus-default-code.xml
   [junit4]   2> 980771 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-managed-schema-test.xml
   [junit4]   2> 980775 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-mergepolicy-nocfs.xml
   [junit4]   2> 980776 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-classification.xml
   [junit4]   2> 980778 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-bogus-field-parameters.xml
   [junit4]   2> 980779 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-defaults.xml
   [junit4]   2> 980781 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-not-required-unique-key.xml
   [junit4]   2> 980782 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-currency-ft-oer-norates.xml
   [junit4]   2> 980783 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-spatial.xml
   [junit4]   2> 980785 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-misplaced-asterisk-copyfield-dest-should-fail-test.xml
   [junit4]   2> 980786 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/compoundDictionary.txt
   [junit4]   2> 980788 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-spatial.xml
   [junit4]   2> 980790 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-caching.xml
   [junit4]   2> 980791 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-replication1.xml
   [junit4]   2> 980792 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-add-schema-fields-update-processor.xml
   [junit4]   2> 980794 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-folding.xml
   [junit4]   2> 980795 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-codec-global-vs-ft-mismatch.xml
   [junit4]   2> 980797 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-numeric.xml
   [junit4]   2> 980802 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-snippet-types.incl
   [junit4]   2> 980804 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig_codec.xml
   [junit4]   2> 980806 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-tieredmergepolicy.xml
   [junit4]   2> 980807 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-single-dynamic-copy-field.xml
   [junit4]   2> 980809 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-deeppaging.xml
   [junit4]   2> 980832 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-delaying-component.xml
   [junit4]   2> 980834 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-xinclude.xml
   [junit4]   2> 980835 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-dup-fieldType.xml
   [junit4]   2> 980836 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-sortingresponse.xml
   [junit4]   2> 980838 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-minimal-atomic-stress.xml
   [junit4]   2> 980841 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-misplaced-asterisk-copyfield-source-should-fail-test.xml
   [junit4]   2> 980843 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema_latest.xml
   [junit4]   2> 980845 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-docValuesMissing.xml
   [junit4]   2> 980847 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/solrCloudCollectionConfig/schema.xml
   [junit4]   2> 980849 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-collate.xml
   [junit4]   2> 980851 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/solrconfig-managed-schema.xml
   [junit4]   2> 980853 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/bad-schema-dup-dynamicField.xml
   [junit4]   2> 980855 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-ib.xml
   [junit4]   2> 980858 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/solrCloudCollectionConfig/schema-bm25.xml
   [junit4]   2> 980861 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-wor

[...truncated too long message...]

n.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:348)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:413)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:133)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1009361 INFO  
(OverseerStateUpdate-96382409877094415-127.0.0.1:40895_solr-n_0000000001) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.Overseer According to ZK I 
(id=96382409877094415-127.0.0.1:40895_solr-n_0000000001) am no longer a leader.
   [junit4]   2> 1009361 INFO  
(OverseerStateUpdate-96382409877094415-127.0.0.1:40895_solr-n_0000000001) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1009361 INFO  
(OverseerStateUpdate-96382409877094415-127.0.0.1:40895_solr-n_0000000001) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.Overseer 
   [junit4]   2> org.apache.zookeeper.KeeperException$SessionExpiredException: 
KeeperErrorCode = Session expired for /overseer_elect/leader
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2>        at 
org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2>        at 
org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:348)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:345)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:413)
   [junit4]   2>        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:145)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1009361 INFO  
(OverseerStateUpdate-96382409877094415-127.0.0.1:40895_solr-n_0000000001) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.Overseer According to ZK I 
(id=96382409877094415-127.0.0.1:40895_solr-n_0000000001) am no longer a leader.
   [junit4]   2> 1009361 INFO  
(OverseerStateUpdate-96382409877094415-127.0.0.1:40895_solr-n_0000000001) 
[n:127.0.0.1:40895_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 
127.0.0.1:40895_solr
   [junit4]   2> 1009384 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxnFactory Ignoring unexpected runtime exception
   [junit4]   2> java.nio.channels.CancelledKeyException
   [junit4]   2>        at 
sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
   [junit4]   2>        at 
sun.nio.ch.SelectionKeyImpl.readyOps(SelectionKeyImpl.java:87)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:187)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1009385 INFO  (Thread-874) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:48735 48735
   [junit4]   2> 1009387 WARN  (Thread-874) [    ] o.a.s.c.ZkTestServer Watch 
limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2>        6       /solr/aliases.json
   [junit4]   2>        6       /solr/clusterprops.json
   [junit4]   2>        5       /solr/security.json
   [junit4]   2>        4       /solr/configs/solrCloudCollectionConfig
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        6       /solr/clusterstate.json
   [junit4]   2>        4       /solr/collections/from_1x4/state.json
   [junit4]   2>        4       /solr/collections/to_2x2/state.json
   [junit4]   2>        2       
/solr/collections/from_1x4/leader_elect/shard1/election/96382409877094413-core_node4-n_0000000001
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        35      /solr/overseer/queue
   [junit4]   2>        19      /solr/overseer/collection-queue-work
   [junit4]   2>        6       /solr/live_nodes
   [junit4]   2>        6       /solr/collections
   [junit4]   2>        6       /solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 1009387 INFO  
(SUITE-DistribJoinFromCollectionTest-seed#[6C36651FED4DBACE]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> Aug 08, 2016 5:54:50 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked 
thread(s).
   [junit4]   2> Aug 08, 2016 5:55:11 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.solr.cloud.DistribJoinFromCollectionTest: 
   [junit4]   2>    1) Thread[id=3576, 
name=OverseerHdfsCoreFailoverThread-96382409877094415-127.0.0.1:40895_solr-n_0000000001,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Aug 08, 2016 5:55:11 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=3576, 
name=OverseerHdfsCoreFailoverThread-96382409877094415-127.0.0.1:40895_solr-n_0000000001,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]   2> Aug 08, 2016 5:55:14 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be 
terminated:
   [junit4]   2>    1) Thread[id=3576, 
name=OverseerHdfsCoreFailoverThread-96382409877094415-127.0.0.1:40895_solr-n_0000000001,
 state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]   2>         at java.lang.Thread.interrupt0(Native Method)
   [junit4]   2>         at java.lang.Thread.interrupt(Thread.java:923)
   [junit4]   2>         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=Lucene62, sim=ClassicSimilarity, 
locale=es-GT, timezone=Europe/Zaporozhye
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_102 
(64-bit)/cpus=3,threads=2,free=93511064,total=415236096
   [junit4]   2> NOTE: All tests run in this JVM: [CoreAdminRequestStatusTest, 
SuggesterTest, TestFreeTextSuggestions, PKIAuthenticationIntegrationTest, 
PluginInfoTest, RestartWhileUpdatingTest, EnumFieldTest, TestFieldResource, 
CollectionsAPIAsyncDistributedZkTest, TestUninvertingReader, BJQParserTest, 
HdfsRecoverLeaseTest, QueryResultKeyTest, TestTrie, DateFieldTest, 
HLLSerializationTest, TestSimpleTrackingShardHandler, OverseerTaskQueueTest, 
TriLevelCompositeIdRoutingTest, TestRandomFaceting, TestQueryUtils, 
LeaderInitiatedRecoveryOnCommitTest, TestSolrQueryParser, 
SharedFSAutoReplicaFailoverUtilsTest, TestJettySolrRunner, 
DistributedFacetPivotLongTailTest, TestConfigOverlay, SynonymTokenizerTest, 
MigrateRouteKeyTest, SSLMigrationTest, TestBinaryField, 
CollectionStateFormat2Test, ConnectionManagerTest, MultiTermTest, 
TestFastWriter, SpellCheckComponentTest, BufferStoreTest, TestRTimerTree, 
TestStressRecovery, AnalyticsMergeStrategyTest, TestFoldingMultitermQuery, 
TestExceedMaxTermLength, CollectionsAPIDistributedZkTest, CacheHeaderTest, 
TestLeaderInitiatedRecoveryThread, TestCollationField, 
DistributedQueryComponentCustomSortTest, TestCollationFieldDocValues, 
DistribJoinFromCollectionTest]
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=DistribJoinFromCollectionTest -Dtests.seed=6C36651FED4DBACE 
-Dtests.slow=true -Dtests.locale=es-GT -Dtests.timezone=Europe/Zaporozhye 
-Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J1 | DistribJoinFromCollectionTest (suite) <<<
   [junit4]    > Throwable #1: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.DistribJoinFromCollectionTest: 
   [junit4]    >    1) Thread[id=3576, 
name=OverseerHdfsCoreFailoverThread-96382409877094415-127.0.0.1:40895_solr-n_0000000001,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([6C36651FED4DBACE]:0)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=3576, 
name=OverseerHdfsCoreFailoverThread-96382409877094415-127.0.0.1:40895_solr-n_0000000001,
 state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]    >         at java.lang.Thread.interrupt0(Native Method)
   [junit4]    >         at java.lang.Thread.interrupt(Thread.java:923)
   [junit4]    >         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([6C36651FED4DBACE]:0)
   [junit4] Completed [169/627 (1!)] on J1 in 52.45s, 2 tests, 2 errors <<< 
FAILURES!

[...truncated 61567 lines...]

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to