Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/47/

5 tests failed.
FAILED:  
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh

Error Message:
Could not find collection : c1

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : c1
        at 
__randomizedtesting.SeedInfo.seed([9C052EE83361E556:83BF5F1FE3012393]:0)
        at 
org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
        at 
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:136)
        at 
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh(ZkStateReaderTest.java:42)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
ObjectTracker found 4 object(s) that were not released!!! 
[MDCAwareThreadPoolExecutor, MockDirectoryWrapper, SolrCore, 
RawDirectoryWrapper]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 4 object(s) that were not 
released!!! [MDCAwareThreadPoolExecutor, MockDirectoryWrapper, SolrCore, 
RawDirectoryWrapper]
        at __randomizedtesting.SeedInfo.seed([9C052EE83361E556]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNull(Assert.java:551)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:256)
        at sun.reflect.GeneratedMethodAccessor89.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores:     1) 
Thread[id=113140, name=searcherExecutor-11457-thread-1, state=WAITING, 
group=TGRP-TestLazyCores]         at sun.misc.Unsafe.park(Native Method)        
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.core.TestLazyCores: 
   1) Thread[id=113140, name=searcherExecutor-11457-thread-1, state=WAITING, 
group=TGRP-TestLazyCores]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([9C052EE83361E556]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=113140, name=searcherExecutor-11457-thread-1, state=WAITING, 
group=TGRP-TestLazyCores]         at sun.misc.Unsafe.park(Native Method)        
 at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=113140, name=searcherExecutor-11457-thread-1, state=WAITING, 
group=TGRP-TestLazyCores]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([9C052EE83361E556]:0)


FAILED:  
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy

Error Message:
Could not find collection : c1

Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : c1
        at 
__randomizedtesting.SeedInfo.seed([9C052EE83361E556:F74A8E954A6E386C]:0)
        at 
org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
        at 
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:136)
        at 
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy(ZkStateReaderTest.java:47)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11721 lines...]
   [junit4] Suite: org.apache.solr.cloud.overseer.ZkStateReaderTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateReaderTest_9C052EE83361E556-001/init-core-data-001
   [junit4]   2> 1733002 INFO  
(SUITE-ZkStateReaderTest-seed#[9C052EE83361E556]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1733012 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting 
testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> 1733012 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1733012 INFO  (Thread-39852) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1733012 INFO  (Thread-39852) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1733113 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer start zk server on port:44707
   [junit4]   2> 1733113 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1733127 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1733144 INFO  (zkCallback-755-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@85779a8 name:ZooKeeperConnection 
Watcher:127.0.0.1:44707 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1733144 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1733145 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1733155 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1733175 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1733183 INFO  (zkCallback-756-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@72f1d101 
name:ZooKeeperConnection Watcher:127.0.0.1:44707 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1733184 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1733184 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1733184 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1733197 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1733208 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1733209 INFO  (zkCallback-757-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2882a6df 
name:ZooKeeperConnection Watcher:127.0.0.1:44707/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1733209 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1733209 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1733211 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1733211 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1733212 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1733212 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1733213 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1733213 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1733214 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1733214 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 1733215 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 1733215 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1733217 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 1733220 ERROR 
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556]-EventThread)
 [    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$8/1116527757@5fe63837
 rejected from 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@5bd9a713[Shutting
 down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 1733220 ERROR 
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556]-EventThread)
 [    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$8/1116527757@41c6b760
 rejected from 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@5bd9a713[Shutting
 down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 1733220 ERROR 
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556]-EventThread)
 [    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$8/1116527757@39f8d322
 rejected from 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@5bd9a713[Shutting
 down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 1]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 1733224 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44707 44707
   [junit4]   2> 1733494 INFO  (Thread-39852) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:44707 44707
   [junit4]   2> 1733500 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh-seed#[9C052EE83361E556])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithExplicitRefresh
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkStateReaderTest 
-Dtests.method=testStateFormatUpdateWithExplicitRefresh 
-Dtests.seed=9C052EE83361E556 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=hu-HU -Dtests.timezone=SystemV/EST5 -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.50s J0 | 
ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not 
find collection : c1
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([9C052EE83361E556:83BF5F1FE3012393]:0)
   [junit4]    >        at 
org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
   [junit4]    >        at 
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:136)
   [junit4]    >        at 
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefresh(ZkStateReaderTest.java:42)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1733514 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.SolrTestCaseJ4 ###Starting testWatchedCollectionCreation
   [junit4]   2> 1733514 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1733514 INFO  (Thread-39853) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1733514 INFO  (Thread-39853) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1733667 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.ZkTestServer start zk server on port:51132
   [junit4]   2> 1733668 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1733687 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1733696 INFO  (zkCallback-758-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@5d88a032 
name:ZooKeeperConnection Watcher:127.0.0.1:51132 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1733696 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1733696 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1733705 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1733708 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1733710 INFO  (zkCallback-759-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@55ff81ca 
name:ZooKeeperConnection Watcher:127.0.0.1:51132 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1733710 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1733710 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1733710 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1733713 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1733719 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1733727 INFO  (zkCallback-760-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@762f49a1 
name:ZooKeeperConnection Watcher:127.0.0.1:51132/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1733728 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1733728 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1733728 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1733729 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1733729 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1733730 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1733732 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1733732 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1733733 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1733733 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 1733733 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 1733733 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1733735 INFO  (zkCallback-760-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1733741 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 1733741 INFO  (zkCallback-760-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeCreated path:/collections/c1/state.json] for 
collection [c1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1733741 INFO  (zkCallback-760-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 1733800 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:51132 51132
   [junit4]   2> 1734296 INFO  (Thread-39853) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:51132 51132
   [junit4]   2> 1734297 INFO  
(TEST-ZkStateReaderTest.testWatchedCollectionCreation-seed#[9C052EE83361E556]) 
[    ] o.a.s.SolrTestCaseJ4 ###Ending testWatchedCollectionCreation
   [junit4]   2> 1734299 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelay
   [junit4]   2> 1734300 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1734307 INFO  (Thread-39854) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1734307 INFO  (Thread-39854) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1734543 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer start zk server on port:40859
   [junit4]   2> 1734544 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1734563 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1734579 INFO  (zkCallback-761-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@31f31447 
name:ZooKeeperConnection Watcher:127.0.0.1:40859 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1734580 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1734580 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1734589 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1734596 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1734596 INFO  (zkCallback-762-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6393a418 
name:ZooKeeperConnection Watcher:127.0.0.1:40859 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1734596 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1734597 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1734597 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1734619 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1734621 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1734621 INFO  (zkCallback-763-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@52768869 
name:ZooKeeperConnection Watcher:127.0.0.1:40859/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1734621 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1734621 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1734621 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1734622 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1734622 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1734623 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1734623 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1734624 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1734624 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1734624 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 1734625 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Deleting data for [c1]
   [junit4]   2> 1734625 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1734626 INFO  (zkCallback-763-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1734628 INFO  (zkCallback-763-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 1734676 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 1734677 INFO  (zkCallback-763-thread-3) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeCreated path:/collections/c1/state.json] for 
collection [c1] has occurred - updating... (live nodes size: [0])
   [junit4]   2> 1734677 INFO  (zkCallback-763-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 1734677 INFO  (zkCallback-763-thread-3) [    ] 
o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 1734684 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40859 40859
   [junit4]   2> 1734799 INFO  (Thread-39854) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:40859 40859
   [junit4]   2> 1734800 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelay-seed#[9C052EE83361E556])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelay
   [junit4]   2> 1734802 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting 
testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> 1734803 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1734812 INFO  (Thread-39855) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1734812 INFO  (Thread-39855) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1734912 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer start zk server on port:54791
   [junit4]   2> 1734912 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1734932 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1734934 INFO  (zkCallback-764-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@491aeab name:ZooKeeperConnection 
Watcher:127.0.0.1:54791 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 1734934 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1734934 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1734935 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1734936 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1734936 INFO  (zkCallback-765-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@55cf2980 
name:ZooKeeperConnection Watcher:127.0.0.1:54791 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1734936 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1734937 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1734937 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1734939 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1734939 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1734953 INFO  (zkCallback-766-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@645b867e 
name:ZooKeeperConnection Watcher:127.0.0.1:54791/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1734953 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1734954 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1734954 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1734954 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1734955 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1734955 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1734956 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1734956 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1734956 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1734964 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1734965 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 1734976 ERROR 
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556]-EventThread)
 [    ] o.a.z.ClientCnxn Error while calling watcher 
   [junit4]   2> java.util.concurrent.RejectedExecutionException: Task 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$8/1116527757@572bb8ff
 rejected from 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@12293c7e[Shutting
 down, pool size = 1, active threads = 1, queued tasks = 0, completed tasks = 1]
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2>        at 
java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2>        at 
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:214)
   [junit4]   2>        at 
java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2>        at 
org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:266)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2>        at 
org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 1734976 INFO  (zkCallback-766-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1734980 WARN  (zkCallback-766-thread-2) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /collections]
   [junit4]   2> 1734989 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:54791 54791
   [junit4]   2> 1735176 INFO  (Thread-39855) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:54791 54791
   [junit4]   2> 1735183 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending 
testStateFormatUpdateWithExplicitRefreshLazy
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ZkStateReaderTest 
-Dtests.method=testStateFormatUpdateWithExplicitRefreshLazy 
-Dtests.seed=9C052EE83361E556 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=hu-HU -Dtests.timezone=SystemV/EST5 -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.38s J0 | 
ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy <<<
   [junit4]    > Throwable #1: org.apache.solr.common.SolrException: Could not 
find collection : c1
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([9C052EE83361E556:F74A8E954A6E386C]:0)
   [junit4]    >        at 
org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:170)
   [junit4]    >        at 
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdate(ZkStateReaderTest.java:136)
   [junit4]    >        at 
org.apache.solr.cloud.overseer.ZkStateReaderTest.testStateFormatUpdateWithExplicitRefreshLazy(ZkStateReaderTest.java:47)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1735196 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 1735196 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1735208 INFO  (Thread-39856) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1735208 INFO  (Thread-39856) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1735304 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer start zk server on port:35405
   [junit4]   2> 1735304 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1735305 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1735313 INFO  (zkCallback-767-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@67aa110f 
name:ZooKeeperConnection Watcher:127.0.0.1:35405 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1735313 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1735313 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1735317 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1735317 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1735318 INFO  (zkCallback-768-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3e5f555c 
name:ZooKeeperConnection Watcher:127.0.0.1:35405 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1735318 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1735318 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1735318 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1735320 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1735320 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1735321 INFO  (zkCallback-769-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@5dd110b1 
name:ZooKeeperConnection Watcher:127.0.0.1:35405/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1735321 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1735322 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1735322 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1735322 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1735323 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1735323 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1735324 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1735324 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1735325 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1735325 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1735326 INFO  (zkCallback-769-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1735326 INFO  (zkCallback-769-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 1735327 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 1735327 INFO  (zkCallback-769-thread-1) [    ] 
o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred 
- updating... (live nodes size: [0])
   [junit4]   2> 1735329 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35405 35405
   [junit4]   2> 1735675 INFO  (Thread-39856) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:35405 35405
   [junit4]   2> 1735684 INFO  
(TEST-ZkStateReaderTest.testStateFormatUpdateWithTimeDelayLazy-seed#[9C052EE83361E556])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testStateFormatUpdateWithTimeDelayLazy
   [junit4]   2> 1735686 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.SolrTestCaseJ4 ###Starting testExternalCollectionWatchedNotWatched
   [junit4]   2> 1735686 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1735688 INFO  (Thread-39857) [    ] o.a.s.c.ZkTestServer 
client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1735688 INFO  (Thread-39857) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 1735789 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer start zk server on port:35435
   [junit4]   2> 1735789 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1735793 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1735815 INFO  (zkCallback-770-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@74872986 
name:ZooKeeperConnection Watcher:127.0.0.1:35435 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1735815 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1735815 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1735824 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1735827 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] 
o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from 
client sessionid 0x1544c20fc850000, likely client has closed socket
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2>        at 
org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2>        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1735828 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1735859 INFO  (zkCallback-771-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@4ceab78c 
name:ZooKeeperConnection Watcher:127.0.0.1:35435 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1735860 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1735860 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1735860 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1735907 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1735909 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1735910 INFO  (zkCallback-772-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3698c7b8 
name:ZooKeeperConnection Watcher:127.0.0.1:35435/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1735910 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1735910 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1735910 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1735910 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections
   [junit4]   2> 1735911 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1735911 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1735912 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1735912 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1735912 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (0)
   [junit4]   2> 1735913 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.SolrZkClient makePath: /collections/c1
   [junit4]   2> 1735913 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.o.ZkStateWriter going to create_collection 
/collections/c1/state.json
   [junit4]   2> 1735914 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader addZkWatch [c1]
   [junit4]   2> 1735914 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Add data for [c1] ver [0]
   [junit4]   2> 1735914 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.c.ZkStateReader Removing watch for uninteresting collection [c1]
   [junit4]   2> 1735914 INFO  (zkCallback-772-thread-2) [    ] 
o.a.s.c.c.ZkStateReader A collections change: [WatchedEvent state:SyncConnected 
type:NodeChildrenChanged path:/collections], has occurred - updating...
   [junit4]   2> 1735915 WARN  (zkCallback-772-thread-2) [    ] 
o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 
[KeeperErrorCode = Session expired for /collections]
   [junit4]   2> 1735918 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35435 35435
   [junit4]   2> 1736192 INFO  (Thread-39857) [    ] o.a.s.c.ZkTestServer 
connecting to 127.0.0.1:35435 35435
   [junit4]   2> 1736193 INFO  
(TEST-ZkStateReaderTest.testExternalCollectionWatchedNotWatched-seed#[9C052EE83361E556])
 [    ] o.a.s.SolrTestCaseJ4 ###Ending testExternalCollectionWatchedNotWatched
   [junit4]   2> 1736194 INFO  
(SUITE-ZkStateReaderTest-seed#[9C052EE83361E556]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J0/temp/solr.cloud.overseer.ZkStateReaderTest_9C052EE83361E556-001
   [junit4]   2> Apr 25, 2016 6:35:11 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene60): {}, 
docValues:{}, maxPointsInLeafNode=131, maxMBSortInHeap=5.360787588278357, 
sim=RandomSimilarity(queryNorm=false,coord=no): {}, locale=hu-HU, 
timezone=SystemV/EST5
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_74 (64-bit)/cpus=4,threads=1,free=196202728,total=534773760
   [junit4]   2> NOTE: All tests run in this JVM: [QueryEqualityTest, 
BlockDirectoryTest, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, 
PeerSyncTest, StandardRequestHandlerTest, CollectionTooManyReplicasTest, 
TestSizeLimitedDistributedMap, TestAnalyzedSuggestions, 
LeaderInitiatedRecoveryOnCommitTest, TriLevelCompositeIdRoutingTest, 
TestRandomRequestDistribution, TestMacros, TestLRUStatsCache, 
HdfsBasicDistributedZkTest, TestManagedSynonymFilterFactory, 
SynonymTokenizerTest, BitVectorTest, AddSchemaFieldsUpdateProcessorFactoryTest, 
DateFieldTest, TestDistribIDF, TestTolerantUpdateProcessorCloud, 
BlockJoinFacetRandomTest, EchoParamsTest, TestConfigSets, TestRemoteStreaming, 
CloneFieldUpdateProcessorFactoryTest, TestFastOutputStream, 
URLClassifyProcessorTest, TestSchemaNameResource, PreAnalyzedFieldTest, 
TestRequestForwarding, DateRangeFieldTest, HdfsRecoveryZkTest, 
SpatialRPTFieldTypeTest, BasicDistributedZkTest, TestAuthorizationFramework, 
TestSolr4Spatial, TestDocSet, FacetPivotSmallTest, TestStressLucene, 
PingRequestHandlerTest, DeleteLastCustomShardedReplicaTest, ActionThrottleTest, 
UUIDFieldTest, DistributedExpandComponentTest, RankQueryTest, 
SolrRequestParserTest, TestRealTimeGet, TestFoldingMultitermQuery, 
ZkStateReaderTest]
   [junit4] Completed [141/591 (1!)] on J0 in 4.03s, 6 tests, 2 errors <<< 
FAILURES!

[...truncated 712 lines...]
   [junit4] Suite: org.apache.solr.core.TestLazyCores
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/init-core-data-001
   [junit4]   2> 4373684 INFO  
(SUITE-TestLazyCores-seed#[9C052EE83361E556]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 4373692 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testMidUseUnload
   [junit4]   2> 4373705 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001'
   [junit4]   2> 4373705 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4373705 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 4373705 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 712820093
   [junit4]   2> 4373705 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001]
   [junit4]   2> 4373706 WARN  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreContainer Couldn't add files from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/lib
 to classpath: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/lib
   [junit4]   2> 4373706 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 
600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 4373707 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=600000&connTimeout=60000&retry=true
   [junit4]   2> 4373707 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.SolrCores Allocating transient cache for 4 transient cores
   [junit4]   2> 4373710 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4373710 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4373710 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for 
authorization module.
   [junit4]   2> 4373710 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 4373711 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, 
config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 4373711 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection2, 
config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 4373711 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection3, 
config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=on, dataDir=data/}
   [junit4]   2> 4373713 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection4, 
config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 4373713 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection5, 
config=solrconfig.xml, loadOnStartup=true, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=false, dataDir=data/}
   [junit4]   2> 4373713 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection6, 
config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 4373713 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection7, 
config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 4373714 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection8, 
config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 4373714 INFO  
(TEST-TestLazyCores.testMidUseUnload-seed#[9C052EE83361E556]) [    ] 
o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection9, 
config=solrconfig.xml, loadOnStartup=false, schema=schema.xml, 
configSetProperties=configsetprops.json, transient=true, dataDir=data/}
   [junit4]   2> 4373714 INFO  (coreLoadExecutor-11259-thread-1) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection1'
   [junit4]   2> 4373716 INFO  (coreLoadExecutor-11259-thread-1) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4373716 INFO  (coreLoadExecutor-11259-thread-1) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 4373718 INFO  (coreLoadExecutor-11259-thread-3) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection5'
   [junit4]   2> 4373718 INFO  (coreLoadExecutor-11259-thread-3) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4373718 INFO  (coreLoadExecutor-11259-thread-3) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 4373719 INFO  (coreLoadExecutor-11259-thread-2) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2'
   [junit4]   2> 4373720 INFO  (coreLoadExecutor-11259-thread-2) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4373720 INFO  (coreLoadExecutor-11259-thread-2) [    ] 
o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find 
system property or JNDI)
   [junit4]   2> 4373724 INFO  (coreLoadExecutor-11259-thread-1) [    ] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 4373724 INFO  (coreLoadExecutor-11259-thread-3) [    ] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 4373730 INFO  (coreLoadExecutor-11259-thread-3) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.1.0
   [junit4]   2> 4373730 INFO  (coreLoadExecutor-11259-thread-2) [    ] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 4373735 INFO  (coreLoadExecutor-11259-thread-2) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.1.0
   [junit4]   2> 4373735 INFO  (coreLoadExecutor-11259-thread-1) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.1.0
   [junit4]   2> 4373739 INFO  (coreLoadExecutor-11259-thread-2) [    ] 
o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 4373741 INFO  (coreLoadExecutor-11259-thread-2) [    ] 
o.a.s.s.IndexSchema [collection2] Schema name=tiny
   [junit4]   2> 4373747 INFO  (coreLoadExecutor-11259-thread-2) [    ] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 4373748 INFO  (coreLoadExecutor-11259-thread-3) [    ] 
o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 4373749 INFO  (coreLoadExecutor-11259-thread-2) [    ] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2'
   [junit4]   2> 4373749 INFO  (coreLoadExecutor-11259-thread-2) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection2' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2
   [junit4]   2> 4373749 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 4373749 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.SolrCore [[collection2] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2/data/]
   [junit4]   2> 4373749 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.SolrCore JMX monitoring not detected for core: 
collection2
   [junit4]   2> 4373750 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2/data
   [junit4]   2> 4373750 INFO  (coreLoadExecutor-11259-thread-3) [    ] 
o.a.s.s.IndexSchema [collection5] Schema name=tiny
   [junit4]   2> 4373750 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.SolrCore New index directory detected: old=null 
new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2/data/index/
   [junit4]   2> 4373750 WARN  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.SolrCore [collection2] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 4373751 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2/data/index
   [junit4]   2> 4373751 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.MockRandomMergePolicy: 
org.apache.lucene.index.MockRandomMergePolicy@73246925
   [junit4]   2> 4373817 INFO  (coreLoadExecutor-11259-thread-1) [    ] 
o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 4373819 INFO  (coreLoadExecutor-11259-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] Schema name=tiny
   [junit4]   2> 4373823 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: 
num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@6e006005 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@763d086b),segFN=segments_1,generation=1}
   [junit4]   2> 4373824 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 4373826 INFO  (coreLoadExecutor-11259-thread-1) [    ] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 4373827 INFO  (coreLoadExecutor-11259-thread-1) [    ] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection1'
   [junit4]   2> 4373827 INFO  (coreLoadExecutor-11259-thread-1) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection1
   [junit4]   2> 4373827 INFO  (coreLoadExecutor-11259-thread-1) [    
x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 4373827 INFO  (coreLoadExecutor-11259-thread-1) [    
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection1],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection1/data/]
   [junit4]   2> 4373827 INFO  (coreLoadExecutor-11259-thread-1) [    
x:collection1] o.a.s.c.SolrCore JMX monitoring not detected for core: 
collection1
   [junit4]   2> 4373828 INFO  (coreLoadExecutor-11259-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection1/data
   [junit4]   2> 4373828 INFO  (coreLoadExecutor-11259-thread-1) [    
x:collection1] o.a.s.c.SolrCore New index directory detected: old=null 
new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection1/data/index/
   [junit4]   2> 4373828 WARN  (coreLoadExecutor-11259-thread-1) [    
x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection1/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 4373831 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.SolrCore no updateRequestProcessorChain defined as 
default, creating implicit default
   [junit4]   2> 4373841 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4373842 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4373842 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4373843 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4373844 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,/update/csv,/sql,/update/json/docs,/admin/luke,/export,/select,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/stream,/schema,/admin/plugins,/admin/logging,/update/json,/admin/ping,/admin/threads,/update,/admin/file
   [junit4]   2> 4373844 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 4373844 INFO  (coreLoadExecutor-11259-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection1/data/index
   [junit4]   2> 4373845 INFO  (coreLoadExecutor-11259-thread-1) [    
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.MockRandomMergePolicy: 
org.apache.lucene.index.MockRandomMergePolicy@3d3b900f
   [junit4]   2> 4373845 INFO  (coreLoadExecutor-11259-thread-1) [    
x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: 
num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@3e79605f 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5c293f82),segFN=segments_1,generation=1}
   [junit4]   2> 4373845 INFO  (coreLoadExecutor-11259-thread-1) [    
x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 4373847 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 4373848 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 4373848 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.MockRandomMergePolicy: 
org.apache.lucene.index.MockRandomMergePolicy@4cbd3ad1
   [junit4]   2> 4373848 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection2) [    x:collection2] 
o.a.s.c.SolrCore Looking for old index directories to cleanup for core 
collection2 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2/data/
   [junit4]   2> 4373848 WARN  
(OldIndexDirectoryCleanupThreadForCore-collection2) [    x:collection2] 
o.a.s.c.DirectoryFactory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2/data/
 does not point to a valid data directory; skipping clean-up of old index 
directories.
   [junit4]   2> 4373848 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: 
num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@6e006005 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@763d086b),segFN=segments_1,generation=1}
   [junit4]   2> 4373848 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 4373848 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.s.SolrIndexSearcher Opening 
[Searcher@2cb503f1[collection2] main]
   [junit4]   2> 4373848 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.r.ManagedResourceStorage File-based storage initialized to 
use dir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2/conf
   [junit4]   2> 4373849 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.r.RestManager Initializing RestManager with initArgs: 
{storageDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2/conf}
   [junit4]   2> 4373849 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
file:dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build/solr-core/test/J2/temp/solr.core.TestLazyCores_9C052EE83361E556-001/tempDir-001/collection2/conf
   [junit4]   2> 4373849 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 4373849 INFO  (coreLoadExecutor-11259-thread-2) [    
x:collection2] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 4373855 INFO  (coreLoadExecutor-11259-thread-1) [    
x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as 
default, creating implicit default
   [junit4]   2> 4373855 INFO  (coreLoadExecutor-11259-thread-1) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 4373856 INFO  (coreLoadExecutor-11259-thread-1) [    
x:collection1] o.a.

[...truncated too long message...]

039)
   [junit4]   2>         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Apr 25, 2016 7:21:36 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=113140, name=searcherExecutor-11457-thread-1, 
state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2> Apr 25, 2016 7:21:39 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be 
terminated:
   [junit4]   2>    1) Thread[id=113140, name=searcherExecutor-11457-thread-1, 
state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2>         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2>         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2>         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: 
codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY,
 chunkSize=2, maxDocsPerChunk=9, blockSize=7), 
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, 
chunkSize=2, blockSize=7)), sim=RandomSimilarity(queryNorm=false,coord=yes): 
{}, locale=en, timezone=America/Thunder_Bay
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_74 (64-bit)/cpus=4,threads=2,free=166956272,total=533200896
   [junit4]   2> NOTE: All tests run in this JVM: [TestMaxScoreQueryParser, 
TestIndexingPerformance, SuggesterTSTTest, TestSuggestSpellingConverter, 
ClassificationUpdateProcessorFactoryTest, CoreAdminHandlerTest, 
FullSolrCloudDistribCmdsTest, UnloadDistributedZkTest, DirectUpdateHandlerTest, 
RemoteQueryErrorTest, HdfsChaosMonkeySafeLeaderTest, TestZkChroot, 
TestPHPSerializedResponseWriter, TestFileDictionaryLookup, HdfsSyncSliceTest, 
MergeStrategyTest, FullHLLTest, RegexBoostProcessorTest, TestRecovery, 
CurrencyFieldXmlFileTest, SuggesterWFSTTest, TestStressLiveNodes, 
HdfsBasicDistributedZk2Test, TestRuleBasedAuthorizationPlugin, 
TestGroupingSearch, TestSolrIndexConfig, TestIntervalFaceting, 
TestCustomDocTransformer, ScriptEngineTest, TestSolrCLIRunExample, 
DistanceUnitsTest, TestSchemaSimilarityResource, TestCollationFieldDocValues, 
TlogReplayBufferedWhileIndexingTest, DocValuesMultiTest, 
TestClusterStateMutator, AnalyticsMergeStrategyTest, ConnectionManagerTest, 
TestFuzzyAnalyzedSuggestions, TestJsonRequest, TestSearchPerf, 
JavabinLoaderTest, TestPerFieldSimilarity, CoreAdminCreateDiscoverTest, 
MigrateRouteKeyTest, CollectionStateFormat2Test, TestFilteredDocIdSet, 
SearchHandlerTest, TestOverriddenPrefixQueryForCustomFieldType, 
AnalysisErrorHandlingTest, BlockJoinFacetDistribTest, TestSmileRequest, 
DirectoryFactoryTest, ClusterStateTest, SimpleCollectionCreateDeleteTest, 
TestOnReconnectListenerSupport, LeaderFailoverAfterPartitionTest, 
BaseCdcrDistributedZkTest, TestElisionMultitermQuery, 
DistributedDebugComponentTest, TestNRTOpen, TestManagedResource, 
FieldAnalysisRequestHandlerTest, TestDefaultSearchFieldResource, 
TestSolrDeletionPolicy1, TestWriterPerf, HdfsRecoverLeaseTest, TestCharFilters, 
TestBulkSchemaAPI, SolrCoreCheckLockOnStartupTest, DebugComponentTest, 
XmlUpdateRequestHandlerTest, TestRawTransformer, RollingRestartTest, 
DateMathParserTest, TestFieldTypeResource, InfoHandlerTest, 
BigEndianAscendingWordSerializerTest, TestJettySolrRunner, 
HdfsUnloadDistributedZkTest, TestJmxMonitoredMap, BadComponentTest, 
TestCloudManagedSchema, OverseerStatusTest, TestStressRecovery, 
TestDefaultStatsCache, TestFieldCollectionResource, TestIndexSearcher, 
PKIAuthenticationIntegrationTest, DistributedFacetPivotWhiteBoxTest, 
TestAuthenticationFramework, OverriddenZkACLAndCredentialsProvidersTest, 
TestExpandComponent, TestPerFieldSimilarityClassic, 
DistribDocExpirationUpdateProcessorTest, SparseHLLTest, CheckHdfsIndexTest, 
AutoCommitTest, TestDistributedGrouping, TestFaceting, 
TermVectorComponentDistributedTest, TestStressReorder, TestJoin, TestReload, 
TestStressVersions, HardAutoCommitTest, TestRangeQuery, TestCoreContainer, 
SimpleFacetsTest, SolrCoreTest, StatsComponentTest, SpellCheckComponentTest, 
QueryElevationComponentTest, BadIndexSchemaTest, ConvertedLegacyTest, TestSort, 
TestFunctionQuery, BasicFunctionalityTest, TestLazyCores]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLazyCores 
-Dtests.seed=9C052EE83361E556 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=en -Dtests.timezone=America/Thunder_Bay -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J2 | TestLazyCores (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: ObjectTracker found 4 
object(s) that were not released!!! [MDCAwareThreadPoolExecutor, 
MockDirectoryWrapper, SolrCore, RawDirectoryWrapper]
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([9C052EE83361E556]:0)
   [junit4]    >        at 
org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:256)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)Throwable #2: 
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.core.TestLazyCores: 
   [junit4]    >    1) Thread[id=113140, name=searcherExecutor-11457-thread-1, 
state=WAITING, group=TGRP-TestLazyCores]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([9C052EE83361E556]:0)Throwable #3: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=113140, name=searcherExecutor-11457-thread-1, 
state=WAITING, group=TGRP-TestLazyCores]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([9C052EE83361E556]:0)
   [junit4] Completed [344/591 (2!)] on J2 in 150.08s, 8 tests, 1 failure, 2 
errors <<< FAILURES!

[...truncated 745 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:747: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:684: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/build.xml:59: 
The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/solr/common-build.xml:529:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1457:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/lucene/common-build.xml:1014:
 There were test failures: 591 suites (10 ignored), 2381 tests, 3 suite-level 
errors, 2 errors, 804 ignored (16 assumptions) [seed: 9C052EE83361E556]

Total time: 347 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to