Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/771/

5 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest

Error Message:
ERROR: SolrIndexSearcher opens=28 closes=27

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=28 closes=27
        at __randomizedtesting.SeedInfo.seed([BE7EDFB2FA45B731]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:467)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:233)
        at sun.reflect.GeneratedMethodAccessor119.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest

Error Message:
2 threads leaked from SUITE scope at 
org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest:     1) Thread[id=68655, 
name=searcherExecutor-5305-thread-1, state=WAITING, 
group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native 
Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    2) Thread[id=68637, 
name=qtp1084610935-68637, state=WAITING, 
group=TGRP-ChaosMonkeyNothingIsSafeTest]         at 
java.lang.Object.wait(Native Method)         at 
java.lang.Object.wait(Object.java:502)         at 
org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient.blockUntilFinished(ConcurrentUpdateSolrClient.java:404)
         at 
org.apache.solr.update.StreamingSolrClients.blockUntilFinished(StreamingSolrClients.java:103)
         at 
org.apache.solr.update.SolrCmdDistributor.blockAndDoRetries(SolrCmdDistributor.java:231)
         at 
org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:89)    
     at 
org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:781)
         at 
org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1655)
         at 
org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:183)
         at 
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)
         at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151)
         at org.apache.solr.core.SolrCore.execute(SolrCore.java:2079)         
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:667)         
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:460)         at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:210)
         at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:179)
         at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
         at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106)
         at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
         at 
org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)    
     at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300)     
    at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
         at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)      
   at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
         at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
         at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)       
  at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
         at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
         at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)   
      at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)  
       at org.eclipse.jetty.server.Server.handle(Server.java:499)         at 
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)         at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)     
    at 
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)      
   at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE 
scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest: 
   1) Thread[id=68655, name=searcherExecutor-5305-thread-1, state=WAITING, 
group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=68637, name=qtp1084610935-68637, state=WAITING, 
group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at 
org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient.blockUntilFinished(ConcurrentUpdateSolrClient.java:404)
        at 
org.apache.solr.update.StreamingSolrClients.blockUntilFinished(StreamingSolrClients.java:103)
        at 
org.apache.solr.update.SolrCmdDistributor.blockAndDoRetries(SolrCmdDistributor.java:231)
        at 
org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:89)
        at 
org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:781)
        at 
org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1655)
        at 
org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:183)
        at 
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)
        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:2079)
        at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:667)
        at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:460)
        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:210)
        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:179)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
        at 
org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
        at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:499)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
        at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
        at 
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([BE7EDFB2FA45B731]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=68655, name=searcherExecutor-5305-thread-1, state=WAITING, 
group=TGRP-ChaosMonkeyNothingIsSafeTest]         at sun.misc.Unsafe.park(Native 
Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) 
        at java.lang.Thread.run(Thread.java:745)    2) Thread[id=68637, 
name=qtp1084610935-68637, state=WAITING, 
group=TGRP-ChaosMonkeyNothingIsSafeTest]         at 
java.lang.Object.wait(Native Method)         at 
java.lang.Object.wait(Object.java:502)         at 
org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient.blockUntilFinished(ConcurrentUpdateSolrClient.java:404)
         at 
org.apache.solr.update.StreamingSolrClients.blockUntilFinished(StreamingSolrClients.java:103)
         at 
org.apache.solr.update.SolrCmdDistributor.blockAndDoRetries(SolrCmdDistributor.java:231)
         at 
org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:89)    
     at 
org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:781)
         at 
org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1655)
         at 
org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:183)
         at 
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)
         at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151)
         at org.apache.solr.core.SolrCore.execute(SolrCore.java:2079)         
at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:667)         
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:460)         at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:210)
         at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:179)
         at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
         at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106)
         at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
         at 
org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)    
     at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300)     
    at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
         at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)      
   at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
         at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
         at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)       
  at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
         at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
         at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)   
      at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)  
       at org.eclipse.jetty.server.Server.handle(Server.java:499)         at 
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)         at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)     
    at 
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)      
   at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=68655, name=searcherExecutor-5305-thread-1, state=WAITING, 
group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=68637, name=qtp1084610935-68637, state=WAITING, 
group=TGRP-ChaosMonkeyNothingIsSafeTest]
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:502)
        at 
org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient.blockUntilFinished(ConcurrentUpdateSolrClient.java:404)
        at 
org.apache.solr.update.StreamingSolrClients.blockUntilFinished(StreamingSolrClients.java:103)
        at 
org.apache.solr.update.SolrCmdDistributor.blockAndDoRetries(SolrCmdDistributor.java:231)
        at 
org.apache.solr.update.SolrCmdDistributor.finish(SolrCmdDistributor.java:89)
        at 
org.apache.solr.update.processor.DistributedUpdateProcessor.doFinish(DistributedUpdateProcessor.java:781)
        at 
org.apache.solr.update.processor.DistributedUpdateProcessor.finish(DistributedUpdateProcessor.java:1655)
        at 
org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:183)
        at 
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:83)
        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:151)
        at org.apache.solr.core.SolrCore.execute(SolrCore.java:2079)
        at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:667)
        at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:460)
        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:210)
        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:179)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:106)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
        at 
org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
        at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
        at org.eclipse.jetty.server.Server.handle(Server.java:499)
        at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
        at 
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
        at 
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([BE7EDFB2FA45B731]:0)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Error from server at https://127.0.0.1:47865: Error CREATEing SolrCore 
'halfcollection_shard1_replica1': Error reading cluster properties Caused by: 
KeeperErrorCode = Session expired for /clusterprops.json

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at https://127.0.0.1:47865: Error CREATEing SolrCore 
'halfcollection_shard1_replica1': Error reading cluster properties Caused by: 
KeeperErrorCode = Session expired for /clusterprops.json
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:302)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testErrorHandling(CollectionsAPIDistributedZkTest.java:419)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:169)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:497)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=3995, name=collection0, 
state=RUNNABLE, group=TGRP-HdfsCollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=3995, name=collection0, state=RUNNABLE, 
group=TGRP-HdfsCollectionsAPIDistributedZkTest]
Caused by: 
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error 
from server at http://127.0.0.1:48519/m_jer/zx: Could not find collection : 
awholynewstresscollection_collection0_0
        at __randomizedtesting.SeedInfo.seed([BE7EDFB2FA45B731]:0)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)




Build Log:
[...truncated 9671 lines...]
   [junit4] Suite: 
org.apache.solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/init-core-data-001
   [junit4]   2> 306126 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 306126 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: 
/m_jer/zx
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 306171 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 306187 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 306189 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.m.log jetty-6.1.26
   [junit4]   2> 306211 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_56981_hdfs____da09qz/webapp
   [junit4]   2> 306317 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.m.log NO JSP Support for /, did not find 
org.apache.jasper.servlet.JspServlet
   [junit4]   2> 306901 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:56981
   [junit4]   2> 307164 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 307166 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.m.log jetty-6.1.26
   [junit4]   2> 307178 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_37094_datanode____.kxw5ki/webapp
   [junit4]   2> 307310 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.m.log NO JSP Support for /, did not find 
org.apache.jasper.servlet.JspServlet
   [junit4]   2> 308114 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37094
   [junit4]   2> 308201 WARN  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 308202 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.m.log jetty-6.1.26
   [junit4]   2> 308225 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_38067_datanode____.iuwzal/webapp
   [junit4]   2> 308366 INFO  (IPC Server handler 8 on 39986) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-719275b0-1d0f-4951-a9fe-f5ab80500c2d node DatanodeRegistration(127.0.0.1, 
datanodeUuid=1fc66af3-c2de-4e39-acc8-fed464d98bb9, infoPort=37094, 
ipcPort=44728, storageInfo=lv=-56;cid=testClusterID;nsid=460249821;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 308367 INFO  (IPC Server handler 8 on 39986) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-a032e4f9-0d78-4e31-8ffb-850d6e6661f0 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=1fc66af3-c2de-4e39-acc8-fed464d98bb9, infoPort=37094, 
ipcPort=44728, storageInfo=lv=-56;cid=testClusterID;nsid=460249821;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 308432 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.m.log NO JSP Support for /, did not find 
org.apache.jasper.servlet.JspServlet
   [junit4]   2> 310600 INFO  
(SUITE-HdfsCollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) [    
] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38067
   [junit4]   2> 310695 INFO  (IPC Server handler 6 on 39986) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-36eb8c13-13b7-490f-9228-ee138b9a9130 node DatanodeRegistration(127.0.0.1, 
datanodeUuid=bb31a96a-f79a-4dbd-85b8-6eafc2ed33d6, infoPort=38067, 
ipcPort=37960, storageInfo=lv=-56;cid=testClusterID;nsid=460249821;c=0), 
blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 310696 INFO  (IPC Server handler 6 on 39986) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-e5fd328d-6d42-46bb-aee0-78f1167bc04e node DatanodeRegistration(127.0.0.1, 
datanodeUuid=bb31a96a-f79a-4dbd-85b8-6eafc2ed33d6, infoPort=38067, 
ipcPort=37960, storageInfo=lv=-56;cid=testClusterID;nsid=460249821;c=0), 
blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 310767 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 310767 INFO  (Thread-2079) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 310768 INFO  (Thread-2079) [    ] o.a.s.c.ZkTestServer 
Starting server
   [junit4]   2> 310867 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.ZkTestServer start zk server on port:48499
   [junit4]   2> 310868 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 310868 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 310871 INFO  (zkCallback-133-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7d517afc 
name:ZooKeeperConnection Watcher:127.0.0.1:48499 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 310871 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 310872 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 310872 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 310875 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 310878 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 310887 INFO  (zkCallback-134-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@3c7bcc57 
name:ZooKeeperConnection Watcher:127.0.0.1:48499/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 310888 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 310888 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 310888 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 310890 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 310891 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 310893 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 310894 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 310894 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 310897 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 310897 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 310899 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 310899 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 310900 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 310900 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 310902 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 310902 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 310903 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 310903 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 310905 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 310905 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 310906 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 310906 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 310907 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 310908 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 310909 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 310909 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 310910 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 310911 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 310916 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 310917 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 310920 INFO  (zkCallback-135-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@7e578314 
name:ZooKeeperConnection Watcher:127.0.0.1:48499 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 310920 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 310921 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 310921 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 310926 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 310926 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 310928 INFO  (zkCallback-136-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@79b90d77 
name:ZooKeeperConnection Watcher:127.0.0.1:48499/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 310928 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 310928 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 310929 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf2/solrconfig.xml
   [junit4]   2> 310929 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 310935 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf2/schema.xml
   [junit4]   2> 310936 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/schema.xml
   [junit4]   2> 310937 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf2/enumsConfig.xml
   [junit4]   2> 310938 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/enumsConfig.xml
   [junit4]   2> 310939 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 310939 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: 
/configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 310941 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf2/stopwords.txt
   [junit4]   2> 310941 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 310943 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf2/protwords.txt
   [junit4]   2> 310943 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/protwords.txt
   [junit4]   2> 310944 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf2/currency.xml
   [junit4]   2> 310945 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/currency.xml
   [junit4]   2> 310946 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 310946 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 310948 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 310948 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 310950 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf2/old_synonyms.txt
   [junit4]   2> 310950 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 310954 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf2/synonyms.txt
   [junit4]   2> 310955 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 310957 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/elevate.xml
 to /configs/conf2/elevate.xml
   [junit4]   2> 310957 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient makePath: /configs/conf2/elevate.xml
   [junit4]   2> 311274 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/cores/collection1
   [junit4]   2> 311276 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 311299 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@5f2bf7a9{/m_jer/zx,null,AVAILABLE}
   [junit4]   2> 311300 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.e.j.s.ServerConnector Started 
ServerConnector@59dc664e{HTTP/1.1}{127.0.0.1:40681}
   [junit4]   2> 311300 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.e.j.s.Server Started @314727ms
   [junit4]   2> 311300 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:39986/hdfs__localhost_39986__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-trunk_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001_tempDir-002_control_data,
 hostContext=/m_jer/zx, hostPort=40681, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/cores}
   [junit4]   2> 311300 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): 
sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 311301 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/'
   [junit4]   2> 311316 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 311317 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 311319 INFO  (zkCallback-137-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@2db0b040 
name:ZooKeeperConnection Watcher:127.0.0.1:48499/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 311319 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 311320 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 311322 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 311322 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/solr.xml
   [junit4]   2> 311327 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.CoresLocator Config-defined core root directory: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/cores
   [junit4]   2> 311328 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.CoreContainer New CoreContainer 748327188
   [junit4]   2> 311328 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.CoreContainer Loading cores into CoreContainer 
[instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/]
   [junit4]   2> 311328 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.CoreContainer loading shared library: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/lib
   [junit4]   2> 311328 WARN  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to 
classloader: lib (resolved as: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/lib).
   [junit4]   2> 311335 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme 
: ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 
10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 
5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 311337 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 311337 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 311338 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.l.LogWatcher Registering Log Listener [Log4j 
(org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 311338 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48499/solr
   [junit4]   2> 311338 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 311338 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 311339 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 311341 INFO  (zkCallback-139-thread-1) [    ] 
o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@76d5c137 
name:ZooKeeperConnection Watcher:127.0.0.1:48499 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 311341 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 311341 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) [    ] 
o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 311344 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.ConnectionManager Waiting for 
client to connect to ZooKeeper
   [junit4]   2> 311345 INFO  
(zkCallback-140-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.ConnectionManager Watcher 
org.apache.solr.common.cloud.ConnectionManager@6a7d23a5 
name:ZooKeeperConnection Watcher:127.0.0.1:48499/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 311346 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.ConnectionManager Client is 
connected to ZooKeeper
   [junit4]   2> 311348 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/queue
   [junit4]   2> 311350 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-queue-work
   [junit4]   2> 311353 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-running
   [junit4]   2> 311355 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-completed
   [junit4]   2> 311357 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/collection-map-failure
   [junit4]   2> 311359 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 311361 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: 
/aliases.json
   [junit4]   2> 311362 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: 
/clusterstate.json
   [junit4]   2> 311364 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: 
/security.json
   [junit4]   2> 311365 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.ZkController Register node as live 
in ZooKeeper:/live_nodes/127.0.0.1:40681_m_jer%2Fzx
   [junit4]   2> 311365 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: 
/live_nodes/127.0.0.1:40681_m_jer%2Fzx
   [junit4]   2> 311367 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect
   [junit4]   2> 311368 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/election
   [junit4]   2> 311369 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 311370 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.LeaderElector Joined leadership 
election with path: 
/overseer_elect/election/94384892148121606-127.0.0.1:40681_m_jer%2Fzx-n_0000000000
   [junit4]   2> 311371 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.OverseerElectionContext I am going 
to be the leader 127.0.0.1:40681_m_jer%2Fzx
   [junit4]   2> 311371 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer_elect/leader
   [junit4]   2> 311373 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.Overseer Overseer 
(id=94384892148121606-127.0.0.1:40681_m_jer%2Fzx-n_0000000000) starting
   [junit4]   2> 311376 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.SolrZkClient makePath: 
/overseer/queue-work
   [junit4]   2> 311390 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.OverseerAutoReplicaFailoverThread 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=10000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 311392 INFO  
(OverseerStateUpdate-94384892148121606-127.0.0.1:40681_m_jer%2Fzx-n_0000000000) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.Overseer Starting to work on the 
main queue
   [junit4]   2> 311392 INFO  
(OverseerStateUpdate-94384892148121606-127.0.0.1:40681_m_jer%2Fzx-n_0000000000) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.ZkStateReader Updating cluster 
state from ZooKeeper... 
   [junit4]   2> 311396 INFO  
(OverseerCollectionProcessor-94384892148121606-127.0.0.1:40681_m_jer%2Fzx-n_0000000000)
 [n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.OverseerProcessor Process current 
queue of overseer operations
   [junit4]   2> 311402 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.ZkStateReader Updating cluster 
state from ZooKeeper... 
   [junit4]   2> 311416 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.CoreContainer Security conf doesn't 
exist. Skipping setup for authorization module.
   [junit4]   2> 311416 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.CoreContainer No authentication 
plugin used.
   [junit4]   2> 311417 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.CoresLocator Looking for core 
definitions underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/cores
   [junit4]   2> 311418 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.SolrCore Created CoreDescriptor: 
{name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, 
loadOnStartup=true, configSetProperties=configsetprops.json, 
instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/cores/collection1,
 collection=control_collection, 
absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/cores/collection1/,
 coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 311418 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.CoresLocator Found core collection1 
in 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/cores/collection1/
   [junit4]   2> 311419 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 311420 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.ZkController publishing state=down
   [junit4]   2> 311420 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.ZkController numShards not found on descriptor - reading it from system 
property
   [junit4]   2> 311421 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.ZkController look for our core node name
   [junit4]   2> 311421 INFO  
(OverseerStateUpdate-94384892148121606-127.0.0.1:40681_m_jer%2Fzx-n_0000000000) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.Overseer processMessage: queueSize: 
1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:40681/m_jer/zx";,
   [junit4]   2>   "node_name":"127.0.0.1:40681_m_jer%2Fzx",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 311422 INFO  
(OverseerStateUpdate-94384892148121606-127.0.0.1:40681_m_jer%2Fzx-n_0000000000) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.o.ReplicaMutator Update state 
numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:40681/m_jer/zx";,
   [junit4]   2>   "node_name":"127.0.0.1:40681_m_jer%2Fzx",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 311422 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.s.SolrDispatchFilter 
user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 311422 INFO  
(TEST-HdfsCollectionsAPIDistributedZkTest.test-seed#[BE7EDFB2FA45B731]) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.s.SolrDispatchFilter 
SolrDispatchFilter.init() done
   [junit4]   2> 311422 INFO  
(OverseerStateUpdate-94384892148121606-127.0.0.1:40681_m_jer%2Fzx-n_0000000000) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.o.ClusterStateMutator building a new 
cName: control_collection
   [junit4]   2> 311423 INFO  
(OverseerStateUpdate-94384892148121606-127.0.0.1:40681_m_jer%2Fzx-n_0000000000) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.o.ReplicaMutator Assigning new node 
to shard shard=shard1
   [junit4]   2> 311424 INFO  
(zkCallback-140-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.ZkStateReader A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 311426 INFO  
(zkCallback-140-thread-2-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx    ] o.a.s.c.c.ZkStateReader A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 312421 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 312421 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 312422 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 312422 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader Load collection config 
from:/collections/control_collection
   [junit4]   2> 312423 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 
specified config exists in ZooKeeper
   [junit4]   2> 312423 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: 
'/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/cores/collection1/'
   [junit4]   2> 312437 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 312446 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 312449 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 312457 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 312458 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 312463 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 312564 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Initialized with 
rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 312569 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 312570 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 312584 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 312586 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 312588 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 312589 WARN  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 312589 WARN  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 312589 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from 
open-exchange-rates.json
   [junit4]   2> 312590 WARN  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 312590 WARN  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 312591 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default 
properties: Can't find resource 'configsetprops.json' in classpath or 
'/configs/conf1', 
cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
   [junit4]   2> 312591 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection   x:collection1] 
o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from 
collection control_collection
   [junit4]   2> 312591 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 312591 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost:39986/solr_hdfs_home
   [junit4]   2> 312592 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication 
disabled
   [junit4]   2> 312592 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.HdfsCollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001/control-001/cores/collection1/],
 dataDir=[null]
   [junit4]   2> 312592 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr 
mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@224145b2
   [junit4]   2> 312592 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:39986/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 312625 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry 
hdfs://localhost:39986/solr_hdfs_home/control_collection/core_node1/data for 
locality metrics.
   [junit4]   2> 312625 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:39986/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 312638 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore New index directory detected: old=null 
new=hdfs://localhost:39986/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 312662 WARN  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 
'hdfs:/localhost:39986/solr_hdfs_home/control_collection/core_node1/data/index' 
doesn't exist. Creating new index...
   [junit4]   2> 312663 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:39986/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 312688 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.s.h.HdfsLocalityReporter Registering direcotry 
hdfs://localhost:39986/solr_hdfs_home/control_collection/core_node1/data/index 
for locality metrics.
   [junit4]   2> 312688 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 
hdfs://localhost:39986/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 312689 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=6, maxMergeAtOnceExplicit=8, maxMergedSegmentMB=81.607421875, 
floorSegmentMB=0.564453125, forceMergeDeletesPctAllowed=2.5288740596296586, 
segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.49783458588419716
   [junit4]   2> 312730 INFO  (IPC Server handler 4 on 39986) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:50456 is 
added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, 
primaryNodeIndex=-1, 
replicas=[ReplicaUnderConstruction[[DISK]DS-719275b0-1d0f-4951-a9fe-f5ab80500c2d:NORMAL:127.0.0.1:33502|RBW],
 
ReplicaUnderConstruction[[DISK]DS-36eb8c13-13b7-490f-9228-ee138b9a9130:NORMAL:127.0.0.1:50456|RBW]]}
 size 0
   [junit4]   2> 312741 INFO  (IPC Server handler 2 on 39986) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:33502 is 
added to blk_1073741825_1001 size 71
   [junit4]   2> 312743 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>        commit{dir=NRTCachingDirectory(HdfsDirectory@b6ce7920 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6e7769a1; 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 312743 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 312746 INFO  
(OldIndexDirectoryCleanupThreadForCore-collection1) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup 
for core collection1 in 
hdfs://localhost:39986/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 312754 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 312755 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 312755 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 312755 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 312755 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 312755 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 312756 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 312756 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 312756 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as 
default, creating implicit default
   [junit4]   2> 312759 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 312760 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 312761 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 312775 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 312778 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.RequestHandlers Registered paths: 
/admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 312778 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore Using default statsCache cache: 
org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 312783 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 312783 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.UpdateLog Initializing HdfsUpdateLog: dataDir= 
defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 
tlogDfsReplication=2
   [junit4]   2> 312796 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 312796 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 312798 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=40, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=17.12890625, 
floorSegmentMB=2.0322265625, forceMergeDeletesPctAllowed=6.868408355084656, 
segmentsPerTier=42.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.4686745390153142
   [junit4]   2> 312807 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>        commit{dir=NRTCachingDirectory(HdfsDirectory@b6ce7920 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6e7769a1; 
maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 312807 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 312807 INFO  
(coreLoadExecutor-564-thread-1-processing-n:127.0.0.1:40681_m_jer%2Fzx) 
[n:127.0.0.1:40681_m_jer%2Fzx c:control_collection s:shard1 r:core_node1 
x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@6d144e8d[collection1] 
main
   

[...truncated too long message...]

ache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:352)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
   [junit4]    >        at 
org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]    >        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:895)
   [junit4]    > Caused by: org.apache.solr.client.solrj.SolrServerException: 
Timeout occured while waiting response from server at: https://127.0.0.1:43201
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:572)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    >        ... 5 more
   [junit4]    > Caused by: java.net.SocketTimeoutException: Read timed out
   [junit4]    >        at java.net.SocketInputStream.socketRead0(Native Method)
   [junit4]    >        at 
java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
   [junit4]    >        at 
java.net.SocketInputStream.read(SocketInputStream.java:170)
   [junit4]    >        at 
java.net.SocketInputStream.read(SocketInputStream.java:141)
   [junit4]    >        at 
sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
   [junit4]    >        at 
sun.security.ssl.InputRecord.read(InputRecord.java:503)
   [junit4]    >        at 
sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:961)
   [junit4]    >        at 
sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:918)
   [junit4]    >        at 
sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
   [junit4]    >        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
   [junit4]    >        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
   [junit4]    >        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
   [junit4]    >        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
   [junit4]    >        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    >        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
   [junit4]    >        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
   [junit4]    >        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
   [junit4]    >        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
   [junit4]    >        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
   [junit4]    >        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
   [junit4]    >        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
   [junit4]    >        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
   [junit4]    >        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
   [junit4]    >        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    >        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
   [junit4]    >        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]    >        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:465)
   [junit4]    >        ... 9 more
   [junit4]   2> 4862348 INFO  
(SUITE-CollectionsAPIDistributedZkTest-seed#[BE7EDFB2FA45B731]-worker) 
[n:127.0.0.1:43201_ c:awholynewstresscollection_collection5_0 s:shard4 
r:core_node16 x:awholynewstresscollection_collection5_0_shard4_replica1] 
o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J2/temp/solr.cloud.CollectionsAPIDistributedZkTest_BE7EDFB2FA45B731-001
   [junit4]   2> Aug 21, 2015 8:35:11 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): 
{other_tl1=BlockTreeOrds(blocksize=128), range_facet_l_dv=FST50, 
_version_=BlockTreeOrds(blocksize=128), 
multiDefault=PostingsFormat(name=Asserting), a_t=BlockTreeOrds(blocksize=128), 
intDefault=BlockTreeOrds(blocksize=128), a_i1=BlockTreeOrds(blocksize=128), 
id=FST50, range_facet_i_dv=BlockTreeOrds(blocksize=128), 
text=PostingsFormat(name=Direct), range_facet_l=BlockTreeOrds(blocksize=128), 
timestamp=BlockTreeOrds(blocksize=128)}, 
docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), 
range_facet_i_dv=DocValuesFormat(name=Asserting), 
timestamp=DocValuesFormat(name=Asserting)}, 
sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=es_PE, 
timezone=Pacific/Chuuk
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 
1.8.0_45 (64-bit)/cpus=4,threads=1,free=180512328,total=533725184
   [junit4]   2> NOTE: All tests run in this JVM: [HdfsUnloadDistributedZkTest, 
TestNRTOpen, OpenExchangeRatesOrgProviderTest, CdcrRequestHandlerTest, 
XsltUpdateRequestHandlerTest, TestManagedSchema, DOMUtilTest, 
DirectSolrSpellCheckerTest, PolyFieldTest, TestMissingGroups, CircularListTest, 
QueryEqualityTest, TestReRankQParserPlugin, SolrIndexSplitterTest, 
RemoteQueryErrorTest, RegexBoostProcessorTest, TestReload, TestJsonRequest, 
TestImplicitCoreProperties, TestSolrDynamicMBean, TestCollationField, 
TestSortByMinMaxFunction, TestObjectReleaseTracker, TestSystemIdResolver, 
TestDistributedMissingSort, FacetPivotSmallTest, TestReloadAndDeleteDocs, 
TestHighlightDedupGrouping, PathHierarchyTokenizerFactoryTest, 
NumericFieldsTest, TestQueryUtils, TestSurroundQueryParser, TestSort, 
SegmentsInfoRequestHandlerTest, CustomCollectionTest, TestFastOutputStream, 
TestSolrCloudWithKerberosAlt, TestPseudoReturnFields, 
TestHighFrequencyDictionaryFactory, TestCollectionAPI, DeleteShardTest, 
CdcrVersionReplicationTest, CachingDirectoryFactoryTest, SearchHandlerTest, 
OverseerRolesTest, DistanceUnitsTest, MoreLikeThisHandlerTest, SOLR749Test, 
TestStressReorder, TestRestoreCore, TestRecovery, AssignTest, 
TestLuceneMatchVersion, BasicDistributedZk2Test, 
TestCopyFieldCollectionResource, TestFieldCollectionResource, 
SoftAutoCommitTest, TestStandardQParsers, 
TestManagedSchemaDynamicFieldResource, TestSolrXml, 
TestDownShardTolerantSearch, SampleTest, SecurityConfHandlerTest, 
SolrTestCaseJ4Test, TestSolrQueryParser, TestExactSharedStatsCache, 
AliasIntegrationTest, MigrateRouteKeyTest, ReplicationFactorTest, 
UUIDUpdateProcessorFallbackTest, TestSolrJ, HdfsThreadLeakTest, 
DistributedExpandComponentTest, MultiThreadedOCPTest, DistribCursorPagingTest, 
TestSolrConfigHandler, TestDocSet, FileBasedSpellCheckerTest, 
UnloadDistributedZkTest, SaslZkACLProviderTest, FullSolrCloudDistribCmdsTest, 
TestPartialUpdateDeduplication, TestBinaryResponseWriter, SuggesterTest, 
TestZkChroot, ResponseLogComponentTest, TestDocBasedVersionConstraints, 
HdfsChaosMonkeySafeLeaderTest, ChaosMonkeySafeLeaderTest, 
CollectionsAPIDistributedZkTest]
   [junit4] Completed [541/541] on J2 in 3264.31s, 1 test, 1 error <<< FAILURES!

[...truncated 1 lines...]
   [junit4] JVM J2: stdout was not empty, see: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/temp/junit4-J2-20150821_191405_728.sysout
   [junit4] >>> JVM J2: stdout (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] Dumping heap to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/heapdumps/java_pid19193.hprof
 ...
   [junit4] Heap dump file created [731435471 bytes in 5.970 secs]
   [junit4] <<< JVM J2: EOF ----

[...truncated 12 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:782:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:719:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:59:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:233:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:514:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1431:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:986:
 There were test failures: 541 suites, 2134 tests, 3 suite-level errors, 2 
errors, 409 ignored (15 assumptions)

Total time: 190 minutes 44 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
No prior successful build to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to