Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/764/

3 tests failed.
FAILED:  org.apache.solr.search.TestReloadDeadlock.testReloadDeadlock

Error Message:
Captured an uncaught exception in thread: Thread[id=6076, name=WRITER1, 
state=RUNNABLE, group=TGRP-TestReloadDeadlock]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=6076, name=WRITER1, state=RUNNABLE, 
group=TGRP-TestReloadDeadlock]
        at 
__randomizedtesting.SeedInfo.seed([15071779CE0F1820:2886B3D89A44FB62]:0)
Caused by: java.lang.RuntimeException: org.apache.solr.common.SolrException: 
Error opening new searcher
        at __randomizedtesting.SeedInfo.seed([15071779CE0F1820]:0)
        at 
org.apache.solr.search.TestReloadDeadlock$1.run(TestReloadDeadlock.java:166)
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
        at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1673)
        at org.apache.solr.core.SolrCore.getRealtimeSearcher(SolrCore.java:1530)
        at 
org.apache.solr.update.VersionInfo.getVersionFromIndex(VersionInfo.java:202)
        at org.apache.solr.update.UpdateLog.lookupVersion(UpdateLog.java:783)
        at 
org.apache.solr.update.VersionInfo.lookupVersion(VersionInfo.java:195)
        at 
org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:1088)
        at 
org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:705)
        at 
org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:104)
        at 
org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.handleAdds(JsonLoader.java:470)
        at 
org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.processUpdate(JsonLoader.java:134)
        at 
org.apache.solr.handler.loader.JsonLoader$SingleThreadedJsonLoader.load(JsonLoader.java:113)
        at org.apache.solr.handler.loader.JsonLoader.load(JsonLoader.java:76)
        at 
org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:98)
        at 
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:2079)
        at 
org.apache.solr.servlet.DirectSolrConnection.request(DirectSolrConnection.java:131)
        at org.apache.solr.SolrTestCaseJ4.updateJ(SolrTestCaseJ4.java:1104)
        at 
org.apache.solr.SolrTestCaseJ4.addAndGetVersion(SolrTestCaseJ4.java:1250)
        at 
org.apache.solr.search.TestReloadDeadlock.addDoc(TestReloadDeadlock.java:200)
        at 
org.apache.solr.search.TestReloadDeadlock.access$100(TestReloadDeadlock.java:46)
        at 
org.apache.solr.search.TestReloadDeadlock$1.run(TestReloadDeadlock.java:156)
Caused by: java.lang.NullPointerException
        at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1642)
        ... 21 more


FAILED:  org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests

Error Message:
There are still nodes recoverying - waited for 330 seconds

Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 
seconds
        at 
__randomizedtesting.SeedInfo.seed([15071779CE0F1820:1D676255C101302B]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:133)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:128)
        at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForRecoveriesToFinish(BaseCdcrDistributedZkTest.java:465)
        at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.clearTargetCollection(BaseCdcrDistributedZkTest.java:343)
        at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestDeleteCreateSourceCollection(CdcrReplicationDistributedZkTest.java:101)
        at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:47)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=6259, name=collection0, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=6259, name=collection0, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:40941: Could not find collection : 
awholynewstresscollection_collection0_0
        at __randomizedtesting.SeedInfo.seed([15071779CE0F1820]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 10578 lines...]
   [junit4] Suite: org.apache.solr.search.TestReloadDeadlock
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestReloadDeadlock_15071779CE0F1820-001/init-core-data-001
   [junit4]   2> 1174646 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1174646 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 1174646 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1174647 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 1174647 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/classes/'
 to classloader
   [junit4]   2> 1174647 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/README'
 to classloader
   [junit4]   2> 1174803 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1174807 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1174819 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] o.a.s.c.Config 
Loaded SolrConfig: solrconfig-tlog.xml
   [junit4]   2> 1174820 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.s.IndexSchema Reading Solr Schema from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml
   [junit4]   2> 1174829 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.s.IndexSchema [null] Schema name=test
   [junit4]   2> 1174976 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1174980 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1174981 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1174983 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1175003 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1175004 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.SolrResourceLoader using system property solr.solr.home: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr
   [junit4]   2> 1175004 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/'
   [junit4]   2> 1175027 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.CoreContainer New CoreContainer 601940886
   [junit4]   2> 1175027 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/]
   [junit4]   2> 1175027 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.CoreContainer loading shared library: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/lib
   [junit4]   2> 1175027 WARN  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to 
classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/lib).
   [junit4]   2> 1175037 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 
600000,connTimeout : 60000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1175041 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=30000&connTimeout=30000&retry=true
   [junit4]   2> 1175041 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1175042 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1175042 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for 
authorization module.
   [junit4]   2> 1175042 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1175044 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, 
config=solrconfig-tlog.xml, transient=false, schema=schema15.xml, 
loadOnStartup=true, configSetProperties=configsetprops.json, 
instanceDir=collection1, collection=collection1, 
absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/,
 
dataDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestReloadDeadlock_15071779CE0F1820-001/init-core-data-001,
 shard=shard1}
   [junit4]   2> 1175046 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1175047 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 1175047 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/classes/'
 to classloader
   [junit4]   2> 1175047 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/README'
 to classloader
   [junit4]   2> 1175089 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1175100 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1175116 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.c.Config Loaded SolrConfig: solrconfig-tlog.xml
   [junit4]   2> 1175116 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.s.IndexSchema Reading Solr Schema from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml
   [junit4]   2> 1175120 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1175218 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1175219 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1175220 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1175222 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1175228 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf'
   [junit4]   2> 1175228 INFO  (coreLoadExecutor-2559-thread-1) [    ] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 1175228 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1175228 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/],
 dataDir=[null]
   [junit4]   2> 1175229 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr 
mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44184b15
   [junit4]   2> 1175229 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestReloadDeadlock_15071779CE0F1820-001/init-core-data-001
   [junit4]   2> 1175229 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.SolrCore New index directory detected: old=null 
new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestReloadDeadlock_15071779CE0F1820-001/init-core-data-001/index/
   [junit4]   2> 1175229 WARN  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestReloadDeadlock_15071779CE0F1820-001/init-core-data-001/index'
 doesn't exist. Creating new index...
   [junit4]   2> 1175230 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestReloadDeadlock_15071779CE0F1820-001/init-core-data-001/index
   [junit4]   2> 1175230 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=28, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=15.3486328125, 
floorSegmentMB=1.1376953125, forceMergeDeletesPctAllowed=7.854713834136389, 
segmentsPerTier=41.0, maxCFSSegmentSizeMB=1.3173828125, 
noCFSRatio=0.12261490711999522
   [junit4]   2> 1175232 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_1,generation=1}
   [junit4]   2> 1175233 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1175236 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1175236 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 1175236 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1175236 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1175236 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1175236 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1175237 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1175237 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 1175237 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as 
default, creating implicit default
   [junit4]   2> 1175241 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1175242 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1175243 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1175244 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1175246 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] 
o.a.s.c.SolrCore Looking for old index directories to cleanup for core 
collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestReloadDeadlock_15071779CE0F1820-001/init-core-data-001/
   [junit4]   2> 1175248 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1175249 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1175250 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.UpdateLog
   [junit4]   2> 1175250 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= 
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 
numVersionBuckets=65536
   [junit4]   2> 1175251 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1175251 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1175251 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=26, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.0]
   [junit4]   2> 1175251 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_1,generation=1}
   [junit4]   2> 1175252 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1175252 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@4338e806[collection1] 
main
   [junit4]   2> 1175252 WARN  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf;
 switching to use InMemory storage instead.
   [junit4]   2> 1175252 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1175252 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
InMemoryStorage
   [junit4]   2> 1175253 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1175253 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1175253 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed 
version buckets
   [junit4]   2> 1175253 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 
65536 version buckets from index
   [junit4]   2> 1175253 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed 
version bucket highest value from index
   [junit4]   2> 1175253 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent 
updates, using new clock 1509452091898200064
   [junit4]   2> 1175255 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with 
highest version 1509452091898200064
   [junit4]   2> 1175256 INFO  (coreLoadExecutor-2559-thread-1) [    
x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1175257 INFO  
(searcherExecutor-2560-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@4338e806[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1175257 INFO  
(SUITE-TestReloadDeadlock-seed#[15071779CE0F1820]-worker) [    ] 
o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 1175259 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.SolrTestCaseJ4 ###Starting testReloadDeadlock
   [junit4]   2> 1175259 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.c.SolrCore [collection1] REMOVING ALL DOCUMENTS FROM INDEX
   [junit4]   2> 1175260 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.s.SolrIndexSearcher Opening Searcher@2d29a2e0[collection1] realtime
   [junit4]   2> 1175260 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null 
params={_version_=-9223372036854775807&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=*:* (-9223372036854775807)} 0 1
   [junit4]   2> 1175260 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.u.UpdateHandler start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1175260 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_1,generation=1}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_2,generation=2}
   [junit4]   2> 1175334 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.c.SolrCore newest commit generation = 2
   [junit4]   2> 1175335 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.s.SolrIndexSearcher Opening Searcher@14c8cd47[collection1] main
   [junit4]   2> 1175335 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.u.UpdateHandler end_commit_flush
   [junit4]   2> 1175336 INFO  (searcherExecutor-2560-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@14c8cd47[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1175336 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.u.p.LogUpdateProcessor [collection1] webapp=null path=null params={} 
{commit=} 0 76
   [junit4]   2> 1175341 INFO  (WRITER2) [    ] o.a.s.u.UpdateHandler start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1175343 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[0 
(1)]} 0 2
   [junit4]   2> 1175347 INFO  (WRITER2) [    ] o.a.s.c.SolrCore 
SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_2,generation=2}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_3,generation=3}
   [junit4]   2> 1175347 INFO  (WRITER2) [    ] o.a.s.c.SolrCore newest commit 
generation = 3
   [junit4]   2> 1175348 INFO  (WRITER2) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@61d1417c[collection1] main
   [junit4]   2> 1175348 INFO  (WRITER2) [    ] o.a.s.u.UpdateHandler 
end_commit_flush
   [junit4]   2> 1175349 INFO  (searcherExecutor-2560-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@61d1417c[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C1)))}
   [junit4]   2> 1175351 INFO  (WRITER4) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@492ec2cf[collection1] realtime
   [junit4]   2> 1175356 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-2&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:0 (-2)} 0 15
   [junit4]   2> 1175359 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null params={} {commit=} 0 17
   [junit4]   2> 1175359 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[5 
(3)]} 0 17
   [junit4]   2> 1175360 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[5 
(4)]} 0 18
   [junit4]   2> 1175372 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[5 
(5)]} 0 30
   [junit4]   2> 1175386 INFO  (WRITER6) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@1d56ea96[collection1] realtime
   [junit4]   2> 1175386 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[20 
(8)]} 0 42
   [junit4]   2> 1175387 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[20 
(9)]} 0 29
   [junit4]   2> 1175387 INFO  (WRITER7) [    ] o.a.s.u.UpdateHandler Reordered 
DBQs detected.  Update=add{_version_=6,id=5} DBQs=[DBQ{version=7,q=id:3}]
   [junit4]   2> 1175392 INFO  (WRITER7) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@189e6b62[collection1] realtime
   [junit4]   2> 1175393 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[5 
(6)]} 0 49
   [junit4]   2> 1175393 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-7&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:3 (-7)} 0 50
   [junit4]   2> 1175394 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[26 
(10)]} 0 34
   [junit4]   2> 1175396 INFO  (WRITER3) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@70b106ea[collection1] realtime
   [junit4]   2> 1175396 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-11&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:0 (-11)} 0 36
   [junit4]   2> 1175399 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-12&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:18 (-12)} 0 33
   [junit4]   2> 1175418 INFO  (WRITER0) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@27fa6131[collection1] realtime
   [junit4]   2> 1175418 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-14&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:5 (-14)} 0 31
   [junit4]   2> 1175418 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-15&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:9 (-15)} 0 31
   [junit4]   2> 1175424 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[9 
(16)]} 0 31
   [junit4]   2> 1175432 INFO  (WRITER6) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@27d34ef8[collection1] realtime
   [junit4]   2> 1175432 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-17&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:9 (-17)} 0 39
   [junit4]   2> 1175434 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[9 
(18)]} 0 39
   [junit4]   2> 1175434 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[13 
(13)]} 0 61
   [junit4]   2> 1175434 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[11 
(19)]} 0 35
   [junit4]   2> 1175434 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[11 
(20)]} 0 34
   [junit4]   2> 1175438 INFO  (WRITER0) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@70301984[collection1] realtime
   [junit4]   2> 1175438 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[21 
(22)]} 0 19
   [junit4]   2> 1175438 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[21 
(23)]} 0 14
   [junit4]   2> 1175439 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-21&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:22 (-21)} 0 20
   [junit4]   2> 1175439 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[10 
(24)]} 0 6
   [junit4]   2> 1175449 INFO  (WRITER5) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@641e5549[collection1] realtime
   [junit4]   2> 1175449 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-25&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:18 (-25)} 0 15
   [junit4]   2> 1175454 INFO  (WRITER1) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@7e310c8f[collection1] realtime
   [junit4]   2> 1175454 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-26&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:13 (-26)} 0 19
   [junit4]   2> 1175454 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-28&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:13 (-28)} 0 19
   [junit4]   2> 1175455 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-27&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:33 (-27)} 0 20
   [junit4]   2> 1175457 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[7 
(29)]} 0 18
   [junit4]   2> 1175458 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[18 
(32)]} 0 18
   [junit4]   2> 1175458 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[20 
(30)]} 0 19
   [junit4]   2> 1175467 INFO  (WRITER0) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@5d9e1d83[collection1] realtime
   [junit4]   2> 1175468 INFO  (WRITER5) [    ] o.a.s.u.UpdateHandler start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1175469 INFO  (WRITER5) [    ] o.a.s.c.SolrCore 
SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_3,generation=3}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_4,generation=4}
   [junit4]   2> 1175469 INFO  (WRITER5) [    ] o.a.s.c.SolrCore newest commit 
generation = 4
   [junit4]   2> 1175469 INFO  (WRITER5) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@8c94fee[collection1] main
   [junit4]   2> 1175470 INFO  (WRITER5) [    ] o.a.s.u.UpdateHandler 
end_commit_flush
   [junit4]   2> 1175470 INFO  (searcherExecutor-2560-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@8c94fee[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_3(6.0.0):C1)
 Uninverting(_6(6.0.0):C1) Uninverting(_7(6.0.0):C2/1:delGen=1) 
Uninverting(_8(6.0.0):C3/1:delGen=1) Uninverting(_a(6.0.0):C1) 
Uninverting(_9(6.0.0):C1) Uninverting(_b(6.0.0):C1)))}
   [junit4]   2> 1175471 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null params={} {commit=} 0 18
   [junit4]   2> 1175474 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-33&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:17 (-33)} 0 19
   [junit4]   2> 1175474 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-31&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:19 (-31)} 0 34
   [junit4]   2> 1175478 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/'
   [junit4]   2> 1175479 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 1175479 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/classes/'
 to classloader
   [junit4]   2> 1175479 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.c.SolrResourceLoader Adding 
'file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/lib/README'
 to classloader
   [junit4]   2> 1175481 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[10 
(37)]} 0 23
   [junit4]   2> 1175481 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[10 
(38)]} 0 23
   [junit4]   2> 1175482 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[18 
(34)]} 0 27
   [junit4]   2> 1175482 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[33 
(35)]} 0 25
   [junit4]   2> 1175485 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[10 
(39)]} 0 11
   [junit4]   2> 1175487 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[33 
(36)]} 0 29
   [junit4]   2> 1175505 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1175509 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1175517 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.c.Config Loaded SolrConfig: solrconfig-tlog.xml
   [junit4]   2> 1175517 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.s.IndexSchema Reading Solr Schema from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml
   [junit4]   2> 1175518 INFO  (WRITER1) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@a500eab[collection1] realtime
   [junit4]   2> 1175519 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-40&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:10 (-40)} 0 44
   [junit4]   2> 1175519 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[18 
(42)]} 0 37
   [junit4]   2> 1175531 INFO  (WRITER7) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@5f553cf7[collection1] realtime
   [junit4]   2> 1175531 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-43&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:11 (-43)} 0 49
   [junit4]   2> 1175532 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[30 
(45)]} 0 46
   [junit4]   2> 1175532 INFO  (WRITER0) [    ] o.a.s.u.UpdateHandler Reordered 
DBQs detected.  Update=add{_version_=41,id=19} DBQs=[DBQ{version=43,q=id:11}]
   [junit4]   2> 1175537 INFO  (WRITER0) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@3947ab55[collection1] realtime
   [junit4]   2> 1175538 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[30 
(46)]} 0 47
   [junit4]   2> 1175538 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[11 
(44)]} 0 55
   [junit4]   2> 1175538 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[11 
(47)]} 0 50
   [junit4]   2> 1175538 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[19 
(41)]} 0 52
   [junit4]   2> 1175541 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1175545 INFO  (WRITER1) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@195efc08[collection1] realtime
   [junit4]   2> 1175548 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-48&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:10 (-48)} 0 28
   [junit4]   2> 1175549 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[16 
(51)]} 0 15
   [junit4]   2> 1175549 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[11 
(49)]} 0 29
   [junit4]   2> 1175554 INFO  (WRITER7) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@280d4b93[collection1] realtime
   [junit4]   2> 1175555 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[11 
(53)]} 0 16
   [junit4]   2> 1175562 INFO  (WRITER4) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@6b5d5f05[collection1] realtime
   [junit4]   2> 1175563 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-54&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:16 (-54)} 0 24
   [junit4]   2> 1175563 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-50&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:11 (-50)} 0 30
   [junit4]   2> 1175564 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[19 
(55)]} 0 25
   [junit4]   2> 1175567 INFO  (WRITER5) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@2d1d48c2[collection1] realtime
   [junit4]   2> 1175567 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-52&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:16 (-52)} 0 28
   [junit4]   2> 1175568 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-57&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:2 (-57)} 0 19
   [junit4]   2> 1175568 INFO  (WRITER1) [    ] o.a.s.u.UpdateHandler Reordered 
DBQs detected.  Update=add{_version_=56,id=10} DBQs=[DBQ{version=57,q=id:2}]
   [junit4]   2> 1175573 INFO  (WRITER1) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@1b0b8b45[collection1] realtime
   [junit4]   2> 1175574 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[11 
(58)]} 0 24
   [junit4]   2> 1175574 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[11 
(59)]} 0 19
   [junit4]   2> 1175574 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[10 
(56)]} 0 26
   [junit4]   2> 1175577 INFO  (WRITER4) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@5d164de7[collection1] realtime
   [junit4]   2> 1175581 INFO  (WRITER7) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@26a1daff[collection1] realtime
   [junit4]   2> 1175583 INFO  (WRITER0) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@39657c91[collection1] realtime
   [junit4]   2> 1175583 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-62&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:33 (-62)} 0 19
   [junit4]   2> 1175584 INFO  (WRITER5) [    ] o.a.s.u.UpdateHandler start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1175584 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-60&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:16 (-60)} 0 21
   [junit4]   2> 1175585 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-61&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:11 (-61)} 0 20
   [junit4]   2> 1175637 INFO  (WRITER5) [    ] o.a.s.c.SolrCore 
SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_4,generation=4}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_5,generation=5}
   [junit4]   2> 1175638 INFO  (WRITER5) [    ] o.a.s.c.SolrCore newest commit 
generation = 5
   [junit4]   2> 1175640 INFO  (WRITER5) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@7c2c25f5[collection1] main
   [junit4]   2> 1175650 INFO  (searcherExecutor-2560-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@7c2c25f5[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_3(6.0.0):C1)
 Uninverting(_6(6.0.0):C1) Uninverting(_8(6.0.0):C3/2:delGen=2) 
Uninverting(_a(6.0.0):C1) Uninverting(_9(6.0.0):C1) Uninverting(_f(6.0.0):C1) 
Uninverting(_i(6.0.0):C2/1:delGen=1) Uninverting(_m(6.0.0):C1) 
Uninverting(_n(6.0.0):C1) Uninverting(_q(6.0.0):C1)))}
   [junit4]   2> 1175652 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[5 
(63)]} 0 82
   [junit4]   2> 1175652 INFO  (WRITER5) [    ] o.a.s.u.UpdateHandler 
end_commit_flush
   [junit4]   2> 1175660 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null params={} {commit=} 0 92
   [junit4]   2> 1175662 INFO  (WRITER6) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@7d481ee0[collection1] realtime
   [junit4]   2> 1175679 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-64&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:21 (-64)} 0 104
   [junit4]   2> 1175686 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[24 
(65)]} 0 111
   [junit4]   2> 1175686 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[11 
(66)]} 0 111
   [junit4]   2> 1175690 INFO  (WRITER0) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@55666213[collection1] realtime
   [junit4]   2> 1175691 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-68&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:32 (-68)} 0 106
   [junit4]   2> 1175692 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-69&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:17 (-69)} 0 107
   [junit4]   2> 1175693 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-70&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:14 (-70)} 0 41
   [junit4]   2> 1175696 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-67&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:11 (-67)} 0 111
   [junit4]   2> 1175696 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[12 
(71)]} 0 35
   [junit4]   2> 1175697 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[26 
(77)]} 0 1
   [junit4]   2> 1175697 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[17 
(76)]} 0 3
   [junit4]   2> 1175698 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[3 
(74)]} 0 11
   [junit4]   2> 1175698 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[24 
(73)]} 0 11
   [junit4]   2> 1175698 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[21 
(72)]} 0 19
   [junit4]   2> 1175698 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[23 
(75)]} 0 6
   [junit4]   2> 1175736 INFO  (WRITER5) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@11457c37[collection1] realtime
   [junit4]   2> 1175741 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-81&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:36 (-81)} 0 43
   [junit4]   2> 1175741 INFO  (WRITER3) [    ] o.a.s.u.UpdateHandler Reordered 
DBQs detected.  Update=add{_version_=80,id=23} DBQs=[DBQ{version=81,q=id:36}]
   [junit4]   2> 1175745 INFO  (WRITER3) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@6fb6f935[collection1] realtime
   [junit4]   2> 1175746 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-82&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:36 (-82)} 0 48
   [junit4]   2> 1175747 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[24 
(84)]} 0 48
   [junit4]   2> 1175751 INFO  (WRITER4) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@4beb4c54[collection1] realtime
   [junit4]   2> 1175752 INFO  (WRITER2) [    ] o.a.s.u.UpdateHandler Reordered 
DBQs detected.  Update=add{_version_=83,id=24} DBQs=[DBQ{version=85,q=id:24}]
   [junit4]   2> 1175752 INFO  (WRITER0) [    ] o.a.s.u.UpdateHandler Reordered 
DBQs detected.  Update=add{_version_=78,id=3} DBQs=[DBQ{version=85,q=id:24}, 
DBQ{version=82,q=id:36}, DBQ{version=81,q=id:36}, DBQ{version=79,q=id:15}]
   [junit4]   2> 1175758 INFO  (WRITER2) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@71bdaae4[collection1] realtime
   [junit4]   2> 1175759 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[23 
(80)]} 0 61
   [junit4]   2> 1175759 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-85&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:24 (-85)} 0 59
   [junit4]   2> 1175764 INFO  (WRITER0) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@61522aff[collection1] realtime
   [junit4]   2> 1175851 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[3 
(78)]} 0 152
   [junit4]   2> 1175852 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[17 
(86)]} 0 109
   [junit4]   2> 1175852 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-79&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:15 (-79)} 0 155
   [junit4]   2> 1175861 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-87&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:36 (-87)} 0 114
   [junit4]   2> 1175861 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[24 
(83)]} 0 161
   [junit4]   2> 1175865 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[24 
(88)]} 0 117
   [junit4]   2> 1175865 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[36 
(94)]} 0 3
   [junit4]   2> 1175865 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[24 
(95)]} 0 3
   [junit4]   2> 1175865 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[11 
(89)]} 0 106
   [junit4]   2> 1175866 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[11 
(93)]} 0 13
   [junit4]   2> 1175865 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[10 
(91)]} 0 13
   [junit4]   2> 1175866 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[23 
(90)]} 0 106
   [junit4]   2> 1175866 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[37 
(96)]} 0 0
   [junit4]   2> 1175866 INFO  (WRITER3) [    ] o.a.s.u.UpdateHandler start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1175867 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[24 
(97)]} 0 1
   [junit4]   2> 1175876 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[3 
(92)]} 0 24
   [junit4]   2> 1175904 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[24 
(98)]} 0 37
   [junit4]   2> 1175928 INFO  (WRITER3) [    ] o.a.s.c.SolrCore 
SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_5,generation=5}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_6,generation=6}
   [junit4]   2> 1175928 INFO  (WRITER3) [    ] o.a.s.c.SolrCore newest commit 
generation = 6
   [junit4]   2> 1175948 INFO  (WRITER3) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@3c8f71f8[collection1] main
   [junit4]   2> 1175951 INFO  (WRITER3) [    ] o.a.s.u.UpdateHandler 
end_commit_flush
   [junit4]   2> 1175951 INFO  (searcherExecutor-2560-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@3c8f71f8[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_6(6.0.0):C1)
 Uninverting(_a(6.0.0):C1) Uninverting(_9(6.0.0):C1) Uninverting(_f(6.0.0):C1) 
Uninverting(_i(6.0.0):C2/1:delGen=1) Uninverting(_m(6.0.0):C1) 
Uninverting(_q(6.0.0):C1) Uninverting(_u(6.0.0):C1) Uninverting(_t(6.0.0):C1) 
Uninverting(_z(6.0.0):C1) Uninverting(_13(6.0.0):C1) 
Uninverting(_15(6.0.0):C3/2:delGen=1) Uninverting(_17(6.0.0):C3/1) 
Uninverting(_18(6.0.0):C1) Uninverting(_16(6.0.0):C2/1:delGen=1) 
Uninverting(_19(6.0.0):C1) Uninverting(_1a(6.0.0):C1)))}
   [junit4]   2> 1175955 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null params={} {commit=} 0 89
   [junit4]   2> 1175955 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1175957 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1175958 INFO  (WRITER5) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@77650cd7[collection1] realtime
   [junit4]   2> 1175958 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-99&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:11 (-99)} 0 91
   [junit4]   2> 1175962 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1175963 INFO  (WRITER0) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@471127f8[collection1] realtime
   [junit4]   2> 1175964 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-100&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:10 (-100)} 0 97
   [junit4]   2> 1175970 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1175972 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[4 
(101)]} 0 105
   [junit4]   2> 1175977 INFO  (WRITER6) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@36a4103a[collection1] realtime
   [junit4]   2> 1175978 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-102&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:37 (-102)} 0 110
   [junit4]   2> 1175978 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[34 
(104)]} 0 101
   [junit4]   2> 1175979 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[24 
(103)]} 0 111
   [junit4]   2> 1175984 INFO  (WRITER2) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@719b04ca[collection1] realtime
   [junit4]   2> 1175985 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[7 
(107)]} 0 27
   [junit4]   2> 1175986 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[24 
(106)]} 0 28
   [junit4]   2> 1175994 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf'
   [junit4]   2> 1175995 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    ] 
o.a.s.c.CoreContainer Reloading SolrCore 'collection1' using configuration from 
instancedir 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/
   [junit4]   2> 1175997 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/],
 
dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestReloadDeadlock_15071779CE0F1820-001/init-core-data-001/]
   [junit4]   2> 1175997 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr 
mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@44184b15
   [junit4]   2> 1176000 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.SolrCore New index directory detected: old=null 
new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestReloadDeadlock_15071779CE0F1820-001/init-core-data-001/index/
   [junit4]   2> 1176015 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1176016 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 1176016 INFO  (WRITER0) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@4cf47d84[collection1] realtime
   [junit4]   2> 1176019 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1176020 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1176019 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-105&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:24 (-105)} 0 115
   [junit4]   2> 1176020 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[5 
(109)]} 0 48
   [junit4]   2> 1176020 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1176026 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1176028 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1176028 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 1176028 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as 
default, creating implicit default
   [junit4]   2> 1176030 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1176031 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1176025 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) [    x:collection1] 
o.a.s.c.SolrCore Looking for old index directories to cleanup for core 
collection1 in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.search.TestReloadDeadlock_15071779CE0F1820-001/init-core-data-001/
   [junit4]   2> 1176040 INFO  (WRITER6) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@41c4714e[collection1] realtime
   [junit4]   2> 1176041 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-108&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:10 (-108)} 0 74
   [junit4]   2> 1176042 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-110&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:5 (-110)} 0 64
   [junit4]   2> 1176042 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[24 
(115)]} 0 20
   [junit4]   2> 1176042 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[24 
(116)]} 0 21
   [junit4]   2> 1176043 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[5 
(119)]} 0 0
   [junit4]   2> 1176043 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[18 
(121)]} 0 0
   [junit4]   2> 1176044 INFO  (WRITER2) [    ] o.a.s.u.UpdateHandler start 
commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1176042 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[24 
(114)]} 0 55
   [junit4]   2> 1176042 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[7 
(113)]} 0 56
   [junit4]   2> 1176042 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[7 
(112)]} 0 62
   [junit4]   2> 1176041 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[13 
(111)]} 0 62
   [junit4]   2> 1176032 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1176043 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[18 
(120)]} 0 0
   [junit4]   2> 1176052 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1176108 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1176109 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1176110 INFO  (WRITER2) [    ] o.a.s.c.SolrCore 
SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_6,generation=6}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_7,generation=7}
   [junit4]   2> 1176110 INFO  (WRITER2) [    ] o.a.s.c.SolrCore newest commit 
generation = 7
   [junit4]   2> 1176110 INFO  (WRITER2) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@745b14eb[collection1] main
   [junit4]   2> 1176111 INFO  (WRITER2) [    ] o.a.s.u.UpdateHandler 
end_commit_flush
   [junit4]   2> 1176111 INFO  (searcherExecutor-2560-thread-1) [    ] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@745b14eb[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_6(6.0.0):C1)
 Uninverting(_a(6.0.0):C1) Uninverting(_i(6.0.0):C2/1:delGen=1) 
Uninverting(_m(6.0.0):C1) Uninverting(_u(6.0.0):C1) Uninverting(_t(6.0.0):C1) 
Uninverting(_z(6.0.0):C1) Uninverting(_13(6.0.0):C1) 
Uninverting(_15(6.0.0):C3/2:delGen=1) Uninverting(_17(6.0.0):C3/2:delGen=1) 
Uninverting(_19(6.0.0):C1) Uninverting(_1b(6.0.0):C1) 
Uninverting(_1c(6.0.0):C1) Uninverting(_1h(6.0.0):C8/3:delGen=1)))}
   [junit4]   2> 1176113 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null params={} {commit=} 0 69
   [junit4]   2> 1176116 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-118&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:5 (-118)} 0 72
   [junit4]   2> 1176116 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1176116 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1176117 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@12f9808a[collection1] 
main
   [junit4]   2> 1176118 WARN  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf;
 switching to use InMemory storage instead.
   [junit4]   2> 1176118 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1176118 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using 
InMemoryStorage
   [junit4]   2> 1176118 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1176118 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1176119 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed 
version buckets
   [junit4]   2> 1176121 INFO  
(searcherExecutor-2565-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@12f9808a[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_6(6.0.0):C1)
 Uninverting(_a(6.0.0):C1) Uninverting(_i(6.0.0):C2/1:delGen=1) 
Uninverting(_m(6.0.0):C1) Uninverting(_u(6.0.0):C1) Uninverting(_t(6.0.0):C1) 
Uninverting(_z(6.0.0):C1) Uninverting(_13(6.0.0):C1) 
Uninverting(_15(6.0.0):C3/2:delGen=1) Uninverting(_17(6.0.0):C3/2:delGen=1) 
Uninverting(_19(6.0.0):C1) Uninverting(_1b(6.0.0):C1) 
Uninverting(_1c(6.0.0):C1) Uninverting(_1h(6.0.0):C8/3:delGen=1)))}
   [junit4]   2> 1176128 INFO  (WRITER5) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@5cb754a1[collection1] realtime
   [junit4]   2> 1176129 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-123&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:7 (-123)} 0 84
   [junit4]   2> 1176129 INFO  (WRITER3) [    ] o.a.s.u.UpdateHandler Reordered 
DBQs detected.  Update=add{_version_=122,id=17} DBQs=[DBQ{version=123,q=id:7}]
   [junit4]   2> 1176139 INFO  (WRITER3) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@760811c7[collection1] realtime
   [junit4]   2> 1176139 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[17 
(122)]} 0 94
   [junit4]   2> 1176141 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-125&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:0 (-125)} 0 96
   [junit4]   2> 1176142 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-124&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:7 (-124)} 0 97
   [junit4]   2> 1176145 INFO  (WRITER0) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@75102978[collection1] realtime
   [junit4]   2> 1176146 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-117&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:24 (-117)} 0 100
   [junit4]   2> 1176148 INFO  (WRITER4) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[25 
(126)]} 0 96
   [junit4]   2> 1176149 INFO  (WRITER2) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[34 
(127)]} 0 35
   [junit4]   2> 1176153 INFO  (WRITER6) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@1185b136[collection1] realtime
   [junit4]   2> 1176154 INFO  (WRITER6) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-128&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:34 (-128)} 0 37
   [junit4]   2> 1176154 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 
65536 version buckets from index
   [junit4]   2> 1176158 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.VersionInfo Found MAX value 121 from Terms for _version_ 
in index
   [junit4]   2> 1176161 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.UpdateLog Took 6.0ms to seed version buckets with 
highest version 128
   [junit4]   2> 1176162 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.DefaultSolrCoreState Creating new IndexWriter...
   [junit4]   2> 1176162 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.DefaultSolrCoreState Waiting until IndexWriter is 
unused... core=collection1
   [junit4]   2> 1176162 INFO  (WRITER3) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[19 
(130)]} 0 22
   [junit4]   2> 1176163 INFO  (WRITER5) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[2 
(129)]} 0 33
   [junit4]   2> 1176163 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.DefaultSolrCoreState Closing old IndexWriter... 
core=collection1
   [junit4]   2> 1176182 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_7,generation=7}
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_8,generation=8}
   [junit4]   2> 1176183 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.SolrCore newest commit generation = 8
   [junit4]   2> 1176185 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: 
minMergeSize=1677721, mergeFactor=3, maxMergeSize=2147483648, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.8544634365437863]
   [junit4]   2> 1176213 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        commit{dir=MockDirectoryWrapper(RAMDirectory@2c90c4b5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fe9cc05),segFN=segments_8,generation=8}
   [junit4]   2> 1176214 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.SolrCore newest commit generation = 8
   [junit4]   2> 1176221 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 1176240 INFO  (WRITER7) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@25292f2e[collection1] realtime
   [junit4]   2> 1176240 INFO  (WRITER7) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={_version_=-131&update.distrib=FROMLEADER&versions=true&wt=json&indent=true}
 {deleteByQuery=id:35 (-131)} 0 99
   [junit4]   2> 1176249 INFO  (WRITER0) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[7 
(133)]} 0 102
   [junit4]   2> 1176250 INFO  (WRITER1) [    ] o.a.s.u.p.LogUpdateProcessor 
[collection1] webapp=null path=null 
params={update.distrib=FROMLEADER&versions=true&wt=json&indent=true} {add=[34 
(132)]} 0 107
   [junit4]   2> 1176360 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@556a347e[collection1] 
main
   [junit4]   2> 1176363 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.CoreContainer replacing core: collection1
   [junit4]   2> 1176363 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore 
org.apache.solr.core.SolrCore@f04f2f7
   [junit4]   2> 1176363 INFO  (WRITER4) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@1078b121[collection1] realtime
   [junit4]   2> 1176363 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.u.UpdateHandler closing 
DirectUpdateHandler2{commits=6,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=7,adds=7,deletesById=0,deletesByQuery=8,errors=1,cumulative_adds=85,cumulative_deletesById=0,cumulative_deletesByQuery=49,cumulative_errors=1,transaction_logs_total_size=3393,transaction_logs_total_number=4}
   [junit4]   2> 1176364 INFO  
(searcherExecutor-2565-thread-1-processing-x:collection1) [    x:collection1] 
o.a.s.c.SolrCore [collection1] Registered new searcher 
Searcher@556a347e[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_6(6.0.0):C1)
 Uninverting(_a(6.0.0):C1) Uninverting(_i(6.0.0):C2/1:delGen=1) 
Uninverting(_u(6.0.0):C1) Uninverting(_t(6.0.0):C1) Uninverting(_z(6.0.0):C1) 
Uninverting(_15(6.0.0):C3/2:delGen=1) Uninverting(_17(6.0.0):C3/2:delGen=1) 
Uninverting(_19(6.0.0):C1) Uninverting(_1b(6.0.0):C1) 
Uninverting(_1h(6.0.0):C8/5:delGen=2) Uninverting(_1i(6.0.0):C1) 
Uninverting(_1j(6.0.0):C1) Uninverting(_1l(6.0.0):C1) 
Uninverting(_1m(6.0.0):C1) Uninverting(_1n(6.0.0):C1) 
Uninverting(_1o(6.0.0):C1)))}
   [junit4]   2> 1176365 INFO  
(TEST-TestReloadDeadlock.testReloadDeadlock-seed#[15071779CE0F1820]) [    
x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 1176371 INFO  (WRITER2) [    ] o.a.s.s.SolrIndexSearcher 
Opening Searcher@128f5b96

[...truncated too long message...]

s/target_collection/leaders/shard2
   [junit4]   2>        2       
/solr/collections/source_collection/leaders/shard1
   [junit4]   2>        2       
/solr/collections/source_collection/leaders/shard2
   [junit4]   2>        2       /solr/collections/tmp_collection/leaders/shard1
   [junit4]   2>        2       /solr/collections/tmp_collection/leaders/shard2
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2>        82      /solr/clusterstate.json
   [junit4]   2>        13      
/solr/collections/source_collection/cdcr/state/buffer
   [junit4]   2>        13      
/solr/collections/source_collection/cdcr/state/process
   [junit4]   2>        12      
/solr/collections/target_collection/cdcr/state/buffer
   [junit4]   2>        12      
/solr/collections/target_collection/cdcr/state/process
   [junit4]   2>        8       
/solr/collections/tmp_collection/cdcr/state/process
   [junit4]   2>        8       
/solr/collections/tmp_collection/cdcr/state/buffer
   [junit4]   2>        5       /solr/collections/source_collection/state.json
   [junit4]   2>        5       /solr/collections/target_collection/state.json
   [junit4]   2>        2       
/solr/overseer_elect/election/94340834565357599-127.0.0.1:55775__w%2Ftn-n_0000000007
   [junit4]   2>        2       
/solr/collections/source_collection/leader_elect/shard1/election/94340834565357581-core_node3-n_0000000000
   [junit4]   2>        2       
/solr/overseer_elect/election/94340834565357581-127.0.0.1:47166__w%2Ftn-n_0000000003
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2>        57      /solr/live_nodes
   [junit4]   2>        6       /solr/overseer/collection-queue-work
   [junit4]   2>        5       /solr/overseer/queue
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=CdcrReplicationDistributedZkTest -Dtests.method=doTests 
-Dtests.seed=15071779CE0F1820 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt 
-Dtests.locale=ar_AE -Dtests.timezone=Asia/Krasnoyarsk -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] FAILURE  600s J1 | CdcrReplicationDistributedZkTest.doTests <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes 
recoverying - waited for 330 seconds
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([15071779CE0F1820:1D676255C101302B]:0)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:133)
   [junit4]    >        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:128)
   [junit4]    >        at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForRecoveriesToFinish(BaseCdcrDistributedZkTest.java:465)
   [junit4]    >        at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.clearTargetCollection(BaseCdcrDistributedZkTest.java:343)
   [junit4]    >        at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTestDeleteCreateSourceCollection(CdcrReplicationDistributedZkTest.java:101)
   [junit4]    >        at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.doTests(CdcrReplicationDistributedZkTest.java:47)
   [junit4]    >        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
   [junit4]    >        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
   [junit4]    >        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2978353 INFO  
(SUITE-CdcrReplicationDistributedZkTest-seed#[15071779CE0F1820]-worker) 
[n:127.0.0.1:56345__w%2Ftn c:target_collection s:shard2 r:core_node1 
x:target_collection_shard2_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrReplicationDistributedZkTest_15071779CE0F1820-001
   [junit4]   2> Aug 14, 2015 12:44:54 AM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): 
{_version_=Lucene50(blocksize=128), id=Lucene50(blocksize=128)}, docValues:{}, 
sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ar_AE, 
timezone=Asia/Krasnoyarsk
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_45 (64-bit)/cpus=4,threads=1,free=192730472,total=532676608
   [junit4]   2> NOTE: All tests run in this JVM: [TestDistributedGrouping, 
CollectionsAPIAsyncDistributedZkTest, TestDownShardTolerantSearch, 
DeleteShardTest, DistribDocExpirationUpdateProcessorTest, BitVectorTest, 
FileUtilsTest, SecurityConfHandlerTest, TestComponentsName, SolrTestCaseJ4Test, 
DataDrivenBlockJoinTest, ResourceLoaderTest, TestExceedMaxTermLength, 
TestHighlightDedupGrouping, TestSolrCoreProperties, SpellingQueryConverterTest, 
TestCharFilters, DistributedFacetPivotWhiteBoxTest, TestStressUserVersions, 
TestReRankQParserPlugin, SliceStateTest, DistributedMLTComponentTest, 
TestFiltering, TestIntervalFaceting, TestSolrCloudWithKerberosAlt, 
AsyncMigrateRouteKeyTest, TestRestManager, BadComponentTest, 
TestHashPartitioner, DistributedFacetPivotSmallTest, CopyFieldTest, 
DocumentAnalysisRequestHandlerTest, TestLMDirichletSimilarityFactory, 
TestSolrConfigHandler, ReplicationFactorTest, TestCoreDiscovery, 
TestWriterPerf, SystemInfoHandlerTest, TestRTGBase, ShowFileRequestHandlerTest, 
LukeRequestHandlerTest, TestBlendedInfixSuggestions, 
WordBreakSolrSpellCheckerTest, TestMissingGroups, CoreAdminHandlerTest, 
EchoParamsTest, TestFuzzyAnalyzedSuggestions, ZkSolrClientTest, 
DirectSolrConnectionTest, SolrPluginUtilsTest, DistanceUnitsTest, 
MigrateRouteKeyTest, ShardSplitTest, ScriptEngineTest, 
TestDistributedMissingSort, TestManagedSynonymFilterFactory, 
TestAddFieldRealTimeGet, TestManagedSchema, TestSolrDeletionPolicy2, 
TestCollapseQParserPlugin, SpatialFilterTest, 
TestManagedSchemaDynamicFieldResource, TestFastLRUCache, CacheHeaderTest, 
RankQueryTest, AsyncCallRequestStatusResponseTest, TestSimpleQParserPlugin, 
TestFieldCollectionResource, TestCloudInspectUtil, 
OutOfBoxZkACLAndCredentialsProvidersTest, TestLFUCache, 
TestLMJelinekMercerSimilarityFactory, TestDefaultStatsCache, 
TestCopyFieldCollectionResource, TestSolr4Spatial2, SolrCloudExampleTest, 
SolrCmdDistributorTest, SpellPossibilityIteratorTest, ClusterStateUpdateTest, 
TestSolrXml, AtomicUpdatesTest, TestRestoreCore, ZkControllerTest, 
FieldAnalysisRequestHandlerTest, TestIndexSearcher, HLLUtilTest, 
ZkStateWriterTest, TestReloadDeadlock, BasicDistributedZkTest, 
ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, 
CollectionsAPIDistributedZkTest, OverseerTest, LeaderElectionIntegrationTest, 
ShardRoutingTest, TestRandomFaceting, LeaderElectionTest, TestZkChroot, 
TestRandomDVFaceting, ZkCLITest, ShardRoutingCustomTest, AutoCommitTest, 
TestRecovery, DistributedSpellCheckComponentTest, TestJoin, TestStressVersions, 
TestRangeQuery, TestCoreContainer, StatsComponentTest, DirectUpdateHandlerTest, 
TestBadConfig, DistributedQueryElevationComponentTest, SpellCheckCollatorTest, 
SolrRequestParserTest, SuggesterTSTTest, TestTrie, NoCacheHeaderTest, 
TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, QueryEqualityTest, 
SortByFunctionTest, TestRemoteStreaming, DocValuesMultiTest, 
DistanceFunctionTest, TestSolrDeletionPolicy1, DisMaxRequestHandlerTest, 
DirectSolrSpellCheckerTest, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, 
RequestHandlersTest, TestValueSourceCache, RequiredFieldsTest, 
IndexSchemaRuntimeFieldTest, IndexSchemaTest, JSONWriterTest, QueryParsingTest, 
UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, 
TestPHPSerializedResponseWriter, HighlighterConfigTest, AlternateDirectoryTest, 
TestMergePolicyConfig, TestBinaryField, NumericFieldsTest, 
TestElisionMultitermQuery, TestLuceneMatchVersion, SynonymTokenizerTest, 
TestSweetSpotSimilarityFactory, TestPerFieldSimilarity, TestFastWriter, 
TestFastOutputStream, OpenExchangeRatesOrgProviderTest, PreAnalyzedFieldTest, 
RAMDirectoryFactoryTest, TestLRUCache, CircularListTest, TestTolerantSearch, 
TestEmbeddedSolrServerConstructors, AliasIntegrationTest, AssignTest, 
CdcrReplicationDistributedZkTest]
   [junit4] Completed [395/540] on J1 in 600.67s, 1 test, 1 failure <<< 
FAILURES!

[...truncated 493 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1429:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:984:
 There were test failures: 540 suites, 2131 tests, 2 errors, 1 failure, 25 
ignored (14 assumptions)

Total time: 182 minutes 28 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to