Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/637/

8 tests failed.
FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread 
Thread[id=6658, name=qtp1091572250-6658, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.

Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope 
SUITE failed to close. Resource was registered from thread Thread[id=6658, 
name=qtp1091572250-6658, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.
        at java.lang.Thread.getStackTrace(Thread.java:1589)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
        at 
org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:688)
        at 
org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1231)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1122)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1114)
        at 
org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:47)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:350)
        at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:275)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:487)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:793)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:651)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:466)
        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:575)
        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
        at 
org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:744)
        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:253)
        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:202)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
        at 
org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
        at org.eclipse.jetty.server.Server.handle(Server.java:368)
        at 
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
        at 
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
        at 
org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
        at 
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
        at 
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
        at 
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
        at 
org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:670)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: Directory not closed: 
MockDirectoryWrapper(NIOFSDirectory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/index-NIOFSDirectory-251
 
lockFactory=NativeFSLockFactory@/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/index-NIOFSDirectory-251)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:699)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:696)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:712)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        ... 1 more


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread 
Thread[id=6658, name=qtp1091572250-6658, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.

Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope 
SUITE failed to close. Resource was registered from thread Thread[id=6658, 
name=qtp1091572250-6658, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.
        at java.lang.Thread.getStackTrace(Thread.java:1589)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
        at 
org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:688)
        at 
org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1231)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1122)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1114)
        at 
org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:47)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:350)
        at 
org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:62)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:528)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:793)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:651)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:466)
        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:575)
        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
        at 
org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:744)
        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:253)
        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:202)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
        at 
org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
        at org.eclipse.jetty.server.Server.handle(Server.java:368)
        at 
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
        at 
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
        at 
org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
        at 
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
        at 
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
        at 
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
        at 
org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:670)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: Directory not closed: 
MockDirectoryWrapper(RAMDirectory(id=lucene-128dfd3c))
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:699)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:696)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:712)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        ... 1 more


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread 
Thread[id=993, name=qtp1091572250-993, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.

Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope 
SUITE failed to close. Resource was registered from thread Thread[id=993, 
name=qtp1091572250-993, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.
        at java.lang.Thread.getStackTrace(Thread.java:1589)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
        at 
org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:688)
        at 
org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1231)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1122)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1114)
        at 
org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:47)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:350)
        at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:275)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:487)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:793)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:651)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:466)
        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:575)
        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
        at 
org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:744)
        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:253)
        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:202)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
        at 
org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
        at org.eclipse.jetty.server.Server.handle(Server.java:368)
        at 
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
        at 
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
        at 
org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
        at 
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
        at 
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
        at 
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
        at 
org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:670)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: Directory not closed: 
MockDirectoryWrapper(RateLimitedDirectoryWrapper(RAMDirectory(id=lucene-66742886)))
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:699)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:696)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:712)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        ... 1 more


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
Resource in scope SUITE failed to close. Resource was registered from thread 
Thread[id=993, name=qtp1091572250-993, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.

Stack Trace:
com.carrotsearch.randomizedtesting.ResourceDisposalError: Resource in scope 
SUITE failed to close. Resource was registered from thread Thread[id=993, 
name=qtp1091572250-993, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest], registration stack trace below.
        at java.lang.Thread.getStackTrace(Thread.java:1589)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeAtEnd(RandomizedContext.java:166)
        at 
org.apache.lucene.util.LuceneTestCase.closeAfterSuite(LuceneTestCase.java:688)
        at 
org.apache.lucene.util.LuceneTestCase.wrapDirectory(LuceneTestCase.java:1225)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1122)
        at 
org.apache.lucene.util.LuceneTestCase.newDirectory(LuceneTestCase.java:1114)
        at 
org.apache.solr.core.MockDirectoryFactory.create(MockDirectoryFactory.java:47)
        at 
org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:350)
        at 
org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:62)
        at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:528)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:793)
        at org.apache.solr.core.SolrCore.<init>(SolrCore.java:651)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:491)
        at org.apache.solr.core.CoreContainer.create(CoreContainer.java:466)
        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:575)
        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:199)
        at 
org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:188)
        at 
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
        at 
org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:744)
        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:253)
        at 
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:202)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
        at 
org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:137)
        at 
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
        at 
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
        at 
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
        at 
org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
        at 
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
        at 
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
        at 
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
        at 
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
        at 
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
        at 
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
        at org.eclipse.jetty.server.Server.handle(Server.java:368)
        at 
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
        at 
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
        at 
org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
        at 
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
        at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
        at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240)
        at 
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
        at 
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
        at 
org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:670)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError: Directory not closed: 
BaseDirectoryWrapper(RAMDirectory(id=lucene-68e48466))
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.lucene.util.CloseableDirectory.close(CloseableDirectory.java:47)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:699)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2$1.apply(RandomizedRunner.java:696)
        at 
com.carrotsearch.randomizedtesting.RandomizedContext.closeResources(RandomizedContext.java:183)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2.afterAlways(RandomizedRunner.java:712)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        ... 1 more


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
1 thread leaked from SUITE scope at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest:     1) Thread[id=8231, 
name=Thread-649-SendThread(127.0.0.1:29674), state=TIMED_WAITING, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)    
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE 
scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 
   1) Thread[id=8231, name=Thread-649-SendThread(127.0.0.1:29674), 
state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
        at __randomizedtesting.SeedInfo.seed([7B54C811F17E9AF3]:0)


FAILED:  
junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=8231, name=Thread-649-SendThread(127.0.0.1:29674), state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]         at 
sun.nio.ch.IOUtil.drain(Native Method)         at 
sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:167)   
      at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:108)    
     at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=8231, name=Thread-649-SendThread(127.0.0.1:29674), 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.nio.ch.IOUtil.drain(Native Method)
        at 
sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:167)
        at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:108)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at 
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
        at __randomizedtesting.SeedInfo.seed([7B54C811F17E9AF3]:0)


REGRESSION:  
org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload

Error Message:
expected:<[{indexVersion=1412129110018,generation=2,filelist=[_5u.fdt, _5u.fdx, 
_5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Lucene41VarGapFixedInterval_0.doc, 
_5u_Lucene41VarGapFixedInterval_0.tib, _5u_Lucene41VarGapFixedInterval_0.tiv, 
_bo.fdt, _bo.fdx, _bo.fnm, _bo.nvd, _bo.nvm, _bo.si, 
_bo_Lucene41VarGapFixedInterval_0.doc, _bo_Lucene41VarGapFixedInterval_0.tib, 
_bo_Lucene41VarGapFixedInterval_0.tiv, _hi.cfe, _hi.cfs, _hi.si, _nc.cfe, 
_nc.cfs, _nc.si, _t6.cfe, _t6.cfs, _t6.si, _wu.cfe, _wu.cfs, _wu.si, _wv.cfe, 
_wv.cfs, _wv.si, _ww.cfe, _ww.cfs, _ww.si, _wx.cfe, _wx.cfs, _wx.si, _wy.cfe, 
_wy.cfs, _wy.si, _wz.cfe, _wz.cfs, _wz.si, _x0.cfe, _x0.cfs, _x0.si, _x1.cfe, 
_x1.cfs, _x1.si, _x2.cfe, _x2.cfs, _x2.si, _x3.cfe, _x3.cfs, _x3.si, _x4.cfe, 
_x4.cfs, _x4.si, _x5.cfe, _x5.cfs, _x5.si, segments_2]}]> but 
was:<[{indexVersion=1412129110018,generation=3,filelist=[_5u.fdt, _5u.fdx, 
_5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Lucene41VarGapFixedInterval_0.doc, 
_5u_Lucene41VarGapFixedInterval_0.tib, _5u_Lucene41VarGapFixedInterval_0.tiv, 
_bo.fdt, _bo.fdx, _bo.fnm, _bo.nvd, _bo.nvm, _bo.si, 
_bo_Lucene41VarGapFixedInterval_0.doc, _bo_Lucene41VarGapFixedInterval_0.tib, 
_bo_Lucene41VarGapFixedInterval_0.tiv, _hi.cfe, _hi.cfs, _hi.si, _nc.cfe, 
_nc.cfs, _nc.si, _t6.cfe, _t6.cfs, _t6.si, _x5.cfe, _x5.cfs, _x5.si, _x6.cfe, 
_x6.cfs, _x6.si, segments_3]}, 
{indexVersion=1412129110018,generation=2,filelist=[_5u.fdt, _5u.fdx, _5u.fnm, 
_5u.nvd, _5u.nvm, _5u.si, _5u_Lucene41VarGapFixedInterval_0.doc, 
_5u_Lucene41VarGapFixedInterval_0.tib, _5u_Lucene41VarGapFixedInterval_0.tiv, 
_bo.fdt, _bo.fdx, _bo.fnm, _bo.nvd, _bo.nvm, _bo.si, 
_bo_Lucene41VarGapFixedInterval_0.doc, _bo_Lucene41VarGapFixedInterval_0.tib, 
_bo_Lucene41VarGapFixedInterval_0.tiv, _hi.cfe, _hi.cfs, _hi.si, _nc.cfe, 
_nc.cfs, _nc.si, _t6.cfe, _t6.cfs, _t6.si, _wu.cfe, _wu.cfs, _wu.si, _wv.cfe, 
_wv.cfs, _wv.si, _ww.cfe, _ww.cfs, _ww.si, _wx.cfe, _wx.cfs, _wx.si, _wy.cfe, 
_wy.cfs, _wy.si, _wz.cfe, _wz.cfs, _wz.si, _x0.cfe, _x0.cfs, _x0.si, _x1.cfe, 
_x1.cfs, _x1.si, _x2.cfe, _x2.cfs, _x2.si, _x3.cfe, _x3.cfs, _x3.si, _x4.cfe, 
_x4.cfs, _x4.si, _x5.cfe, _x5.cfs, _x5.si, segments_2]}]>

Stack Trace:
java.lang.AssertionError: 
expected:<[{indexVersion=1412129110018,generation=2,filelist=[_5u.fdt, _5u.fdx, 
_5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Lucene41VarGapFixedInterval_0.doc, 
_5u_Lucene41VarGapFixedInterval_0.tib, _5u_Lucene41VarGapFixedInterval_0.tiv, 
_bo.fdt, _bo.fdx, _bo.fnm, _bo.nvd, _bo.nvm, _bo.si, 
_bo_Lucene41VarGapFixedInterval_0.doc, _bo_Lucene41VarGapFixedInterval_0.tib, 
_bo_Lucene41VarGapFixedInterval_0.tiv, _hi.cfe, _hi.cfs, _hi.si, _nc.cfe, 
_nc.cfs, _nc.si, _t6.cfe, _t6.cfs, _t6.si, _wu.cfe, _wu.cfs, _wu.si, _wv.cfe, 
_wv.cfs, _wv.si, _ww.cfe, _ww.cfs, _ww.si, _wx.cfe, _wx.cfs, _wx.si, _wy.cfe, 
_wy.cfs, _wy.si, _wz.cfe, _wz.cfs, _wz.si, _x0.cfe, _x0.cfs, _x0.si, _x1.cfe, 
_x1.cfs, _x1.si, _x2.cfe, _x2.cfs, _x2.si, _x3.cfe, _x3.cfs, _x3.si, _x4.cfe, 
_x4.cfs, _x4.si, _x5.cfe, _x5.cfs, _x5.si, segments_2]}]> but 
was:<[{indexVersion=1412129110018,generation=3,filelist=[_5u.fdt, _5u.fdx, 
_5u.fnm, _5u.nvd, _5u.nvm, _5u.si, _5u_Lucene41VarGapFixedInterval_0.doc, 
_5u_Lucene41VarGapFixedInterval_0.tib, _5u_Lucene41VarGapFixedInterval_0.tiv, 
_bo.fdt, _bo.fdx, _bo.fnm, _bo.nvd, _bo.nvm, _bo.si, 
_bo_Lucene41VarGapFixedInterval_0.doc, _bo_Lucene41VarGapFixedInterval_0.tib, 
_bo_Lucene41VarGapFixedInterval_0.tiv, _hi.cfe, _hi.cfs, _hi.si, _nc.cfe, 
_nc.cfs, _nc.si, _t6.cfe, _t6.cfs, _t6.si, _x5.cfe, _x5.cfs, _x5.si, _x6.cfe, 
_x6.cfs, _x6.si, segments_3]}, 
{indexVersion=1412129110018,generation=2,filelist=[_5u.fdt, _5u.fdx, _5u.fnm, 
_5u.nvd, _5u.nvm, _5u.si, _5u_Lucene41VarGapFixedInterval_0.doc, 
_5u_Lucene41VarGapFixedInterval_0.tib, _5u_Lucene41VarGapFixedInterval_0.tiv, 
_bo.fdt, _bo.fdx, _bo.fnm, _bo.nvd, _bo.nvm, _bo.si, 
_bo_Lucene41VarGapFixedInterval_0.doc, _bo_Lucene41VarGapFixedInterval_0.tib, 
_bo_Lucene41VarGapFixedInterval_0.tiv, _hi.cfe, _hi.cfs, _hi.si, _nc.cfe, 
_nc.cfs, _nc.si, _t6.cfe, _t6.cfs, _t6.si, _wu.cfe, _wu.cfs, _wu.si, _wv.cfe, 
_wv.cfs, _wv.si, _ww.cfe, _ww.cfs, _ww.si, _wx.cfe, _wx.cfs, _wx.si, _wy.cfe, 
_wy.cfs, _wy.si, _wz.cfe, _wz.cfs, _wz.si, _x0.cfe, _x0.cfs, _x0.si, _x1.cfe, 
_x1.cfs, _x1.si, _x2.cfe, _x2.cfs, _x2.si, _x3.cfe, _x3.cfs, _x3.si, _x4.cfe, 
_x4.cfs, _x4.si, _x5.cfe, _x5.cfs, _x5.si, segments_2]}]>
        at 
__randomizedtesting.SeedInfo.seed([7B54C811F17E9AF3:5E83D321813694F0]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.failNotEquals(Assert.java:647)
        at org.junit.Assert.assertEquals(Assert.java:128)
        at org.junit.Assert.assertEquals(Assert.java:147)
        at 
org.apache.solr.handler.TestReplicationHandler.doTestReplicateAfterCoreReload(TestReplicationHandler.java:1175)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
Captured an uncaught exception in thread: Thread[id=831, name=qtp81597283-831, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=831, name=qtp81597283-831, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.OutOfMemoryError: unable to create new native thread
        at __randomizedtesting.SeedInfo.seed([7B54C811F17E9AF3]:0)
        at java.lang.Thread.start0(Native Method)
        at java.lang.Thread.start(Thread.java:714)
        at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1047)
        at 
sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1312)
        at 
sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1339)
        at 
sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1323)
        at 
org.eclipse.jetty.server.ssl.SslSocketConnector$SslConnectorEndPoint.run(SslSocketConnector.java:665)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11590 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/init-core-data-001
   [junit4]   2> 371519 T750 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl 
(true) and clientAuth (true)
   [junit4]   2> 371519 T750 oas.BaseDistributedSearchTestCase.initHostContext 
Setting hostContext system property: /gnvi/
   [junit4]   2> 371527 T750 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 371528 T750 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 371529 T751 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 371629 T750 oasc.ZkTestServer.run start zk server on port:29674
   [junit4]   2> 371630 T750 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 371637 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 371642 T757 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@3a12e1e6 
name:ZooKeeperConnection Watcher:127.0.0.1:29674 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 371643 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 371643 T750 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 371644 T750 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 371648 T750 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 371649 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 371652 T759 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@3199ee4 name:ZooKeeperConnection 
Watcher:127.0.0.1:29674/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 371652 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 371652 T750 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 371653 T750 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 371657 T750 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 371659 T750 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 371661 T750 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 371665 T750 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 371666 T750 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 371671 T750 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 371672 T750 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 371676 T750 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 371677 T750 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 371681 T750 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 371682 T750 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 371687 T750 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 371688 T750 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 371691 T750 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 371692 T750 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 371696 T750 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 371697 T750 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 371700 T750 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 371701 T750 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 371705 T750 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 371706 T750 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 371709 T750 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 371711 T750 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 371714 T750 oasc.AbstractZkTestCase.putConfig put 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 371715 T750 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> 371719 T750 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 371721 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 371722 T761 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@5a56124c 
name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 371723 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 371723 T750 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> Using old style solr.xml
   [junit4]   2> 373447 T750 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 373452 T750 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 373456 T750 oejs.AbstractConnector.doStart Started 
SslSocketConnector@127.0.0.1:31406
   [junit4]   2> 373458 T750 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 373459 T750 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 373459 T750 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-002
   [junit4]   2> 373459 T750 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-002/'
   [junit4]   2> 373493 T750 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-002/solr.xml
   [junit4]   2> 373547 T750 oasc.CoreContainer.<init> New CoreContainer 
848254579
   [junit4]   2> 373547 T750 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-002/]
   [junit4]   2> 373548 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 120000
   [junit4]   2> 373548 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: null
   [junit4]   2> 373549 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 373549 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 373549 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 373549 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 373550 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 373550 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 373550 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 373552 T750 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 373554 T750 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 373554 T750 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 373555 T750 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 373555 T750 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:29674/solr
   [junit4]   2> 373555 T750 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 373555 T750 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 373556 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 373558 T772 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@5688e4ae 
name:ZooKeeperConnection Watcher:127.0.0.1:29674 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 373558 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 373559 T750 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 373560 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 373562 T774 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@34e09ae9 
name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 373562 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 373563 T750 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 373565 T750 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 373567 T750 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 373569 T750 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 373571 T750 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 373573 T750 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 373574 T750 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:31406_gnvi
   [junit4]   2> 373574 T750 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:31406_gnvi
   [junit4]   2> 373576 T750 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 373577 T750 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 373579 T750 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 373580 T750 oasc.OverseerElectionContext.runLeaderProcess I am 
going to be the leader 127.0.0.1:31406_gnvi
   [junit4]   2> 373580 T750 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 373581 T750 oasc.Overseer.start Overseer 
(id=92545190187958276-127.0.0.1:31406_gnvi-n_0000000000) starting
   [junit4]   2> 373583 T750 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 373590 T750 oasc.OverseerAutoReplicaFailoverThread.<init> 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 373590 T776 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 373591 T750 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 373592 T750 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 373594 T750 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 373596 T775 oasc.Overseer$ClusterStateUpdater.run Starting to 
work on the main queue
   [junit4]   2> 373598 T750 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 373599 T750 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 373602 T750 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 373603 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 373604 T780 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@5f8dedc name:ZooKeeperConnection 
Watcher:127.0.0.1:29674/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 373604 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 373604 T750 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 373605 T750 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 373607 T750 oasc.ChaosMonkey.monkeyLog monkey: init - expire 
sessions:false cause connection loss:false
   [junit4]   2> 374512 T750 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 374513 T750 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 374517 T750 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 374519 T750 oejs.AbstractConnector.doStart Started 
SslSocketConnector@127.0.0.1:31412
   [junit4]   2> 374521 T750 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 374522 T750 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 374522 T750 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-003
   [junit4]   2> 374522 T750 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-003/'
   [junit4]   2> 374552 T750 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-003/solr.xml
   [junit4]   2> 374620 T750 oasc.CoreContainer.<init> New CoreContainer 
334332667
   [junit4]   2> 374621 T750 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-003/]
   [junit4]   2> 374622 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 120000
   [junit4]   2> 374622 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: null
   [junit4]   2> 374622 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 374622 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 374623 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 374623 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 374623 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 374623 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 374624 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 374626 T750 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 374628 T750 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 374628 T750 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 374628 T750 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 374628 T750 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:29674/solr
   [junit4]   2> 374629 T750 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 374629 T750 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 374630 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 374631 T791 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2fe6db89 
name:ZooKeeperConnection Watcher:127.0.0.1:29674 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 374632 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 374632 T750 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 374634 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 374635 T793 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1042b366 
name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 374635 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 374640 T750 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 375643 T750 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:31412_gnvi
   [junit4]   2> 375644 T750 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:31412_gnvi
   [junit4]   2> 375647 T750 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 375653 T750 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 375653 T750 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 377283 T750 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 2
   [junit4]   2> 377284 T750 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 377289 T750 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 377290 T750 oejs.AbstractConnector.doStart Started 
SslSocketConnector@127.0.0.1:31420
   [junit4]   2> 377293 T750 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 377293 T750 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 377293 T750 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-004
   [junit4]   2> 377293 T750 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-004/'
   [junit4]   2> 377337 T750 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-004/solr.xml
   [junit4]   2> 377412 T750 oasc.CoreContainer.<init> New CoreContainer 
1770894633
   [junit4]   2> 377413 T750 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-004/]
   [junit4]   2> 377414 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 120000
   [junit4]   2> 377414 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: null
   [junit4]   2> 377414 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 377414 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 377415 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 377415 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 377415 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 377415 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 377416 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 377418 T750 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 377420 T750 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 377420 T750 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 377420 T750 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 377420 T750 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:29674/solr
   [junit4]   2> 377421 T750 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 377421 T750 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 377422 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 377423 T808 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2f8b95a3 
name:ZooKeeperConnection Watcher:127.0.0.1:29674 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 377424 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 377424 T750 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 377426 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 377427 T810 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@10a55706 
name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 377427 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 377431 T750 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 378433 T750 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:31420_gnvi
   [junit4]   2> 378434 T750 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:31420_gnvi
   [junit4]   2> 378437 T750 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 378442 T750 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 378442 T750 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 380311 T750 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 3
   [junit4]   2> 380312 T750 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 380318 T750 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 380322 T750 oejs.AbstractConnector.doStart Started 
SslSocketConnector@127.0.0.1:32994
   [junit4]   2> 380325 T750 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 380326 T750 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 380326 T750 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-005
   [junit4]   2> 380326 T750 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-005/'
   [junit4]   2> 380404 T750 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-005/solr.xml
   [junit4]   2> 380521 T750 oasc.CoreContainer.<init> New CoreContainer 
856264067
   [junit4]   2> 380522 T750 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-005/]
   [junit4]   2> 380524 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 120000
   [junit4]   2> 380524 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: null
   [junit4]   2> 380525 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 380525 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 380526 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 380526 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 380527 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 380527 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 380528 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 380532 T750 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 380536 T750 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 380537 T750 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 380537 T750 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 380538 T750 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:29674/solr
   [junit4]   2> 380538 T750 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 380539 T750 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 380540 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 380544 T823 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@3c466787 
name:ZooKeeperConnection Watcher:127.0.0.1:29674 got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 380549 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 380549 T750 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 380552 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 380554 T825 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@12901eaa 
name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 380555 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 380563 T750 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 381567 T750 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:32994_gnvi
   [junit4]   2> 381568 T750 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:32994_gnvi
   [junit4]   2> 381573 T750 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 381580 T750 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 381581 T750 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 383317 T750 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 4
   [junit4]   2> 383318 T750 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 383328 T750 oejus.SslContextFactory.doStart Enabled Protocols 
[SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, 
TLSv1.1, TLSv1.2]
   [junit4]   2> 383332 T750 oejs.AbstractConnector.doStart Started 
SslSocketConnector@127.0.0.1:37043
   [junit4]   2> 383340 T750 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 383340 T750 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 383341 T750 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-006
   [junit4]   2> 383341 T750 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-006/'
   [junit4]   2> 383396 T750 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-006/solr.xml
   [junit4]   2> 383537 T750 oasc.CoreContainer.<init> New CoreContainer 
598588302
   [junit4]   2> 383538 T750 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-006/]
   [junit4]   2> 383539 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
socketTimeout to: 120000
   [junit4]   2> 383540 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
urlScheme to: null
   [junit4]   2> 383541 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
connTimeout to: 15000
   [junit4]   2> 383541 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maxConnectionsPerHost to: 20
   [junit4]   2> 383541 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
corePoolSize to: 0
   [junit4]   2> 383542 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maximumPoolSize to: 2147483647
   [junit4]   2> 383542 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
maxThreadIdleTime to: 5
   [junit4]   2> 383543 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
sizeOfQueue to: -1
   [junit4]   2> 383543 T750 oashc.HttpShardHandlerFactory.getParameter Setting 
fairnessPolicy to: false
   [junit4]   2> 383547 T750 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=3400000&connTimeout=45000&retry=false
   [junit4]   2> 383550 T750 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 383551 T750 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 383551 T750 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 383551 T750 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:29674/solr
   [junit4]   2> 383552 T750 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 383553 T750 
oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default 
ZkCredentialsProvider
   [junit4]   2> 383554 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 383556 T838 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@7be768 name:ZooKeeperConnection 
Watcher:127.0.0.1:29674 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 383556 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 383557 T750 oascc.SolrZkClient.createZkACLProvider Using 
default ZkACLProvider
   [junit4]   2> 383560 T750 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 383562 T840 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2c3c8a6b 
name:ZooKeeperConnection Watcher:127.0.0.1:29674/solr got event WatchedEvent 
state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 383562 T750 oascc.ConnectionManager.waitForConnected Client is 
connected to ZooKeeper
   [junit4]   2> 383569 T750 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 384574 T750 oasc.ZkController.createEphemeralLiveNode Register 
node as live in ZooKeeper:/live_nodes/127.0.0.1:37043_gnvi
   [junit4]   2> 384577 T750 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:37043_gnvi
   [junit4]   2> 384585 T750 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 384591 T750 oass.SolrDispatchFilter.init 
user.dir=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3
   [junit4]   2> 384591 T750 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 384759 T789 oasha.CollectionsHandler.handleCreateAction 
Creating Collection : 
version=2&router.field=myOwnField&numShards=2&name=solrj_collection&collection.configName=conf1&wt=javabin&replicationFactor=2&action=CREATE
   [junit4]   2> 384761 T796 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/collection-queue-work state: 
SyncConnected type NodeChildrenChanged
   [junit4]   2> 384763 T776 oasc.OverseerCollectionProcessor.run Overseer 
Collection Processor: Get the message 
id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 384764 T844 oasc.OverseerCollectionProcessor.processMessage 
WARN OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2>          "operation":"create",
   [junit4]   2>          "fromApi":"true",
   [junit4]   2>          "name":"solrj_collection",
   [junit4]   2>          "replicationFactor":"2",
   [junit4]   2>          "collection.configName":"conf1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "router.field":"myOwnField"}
   [junit4]   2> 384765 T844 oasc.OverseerCollectionProcessor.createConfNode 
creating collections conf node /collections/solrj_collection 
   [junit4]   2> 384766 T844 oascc.SolrZkClient.makePath makePath: 
/collections/solrj_collection
   [junit4]   2> 384770 T796 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 384773 T775 oasc.Overseer$ClusterStateUpdater.buildCollection 
building a new collection: solrj_collection
   [junit4]   2> 384774 T775 oasc.Overseer$ClusterStateUpdater.createCollection 
Create collection solrj_collection with shards [shard1, shard2]
   [junit4]   2> 384774 T775 oasc.Overseer$ClusterStateUpdater.createCollection 
state version solrj_collection 1
   [junit4]   2> 384778 T826 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 384778 T841 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 384778 T811 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 384778 T794 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 384778 T795 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 384778 T796 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 384870 T844 oasc.OverseerCollectionProcessor.createCollection 
Creating SolrCores for new collection solrj_collection, shardNames [shard1, 
shard2] , replicationFactor : 2
   [junit4]   2> 384871 T844 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of 
collection solrj_collection on 127.0.0.1:31412_gnvi
   [junit4]   2> 384872 T844 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of 
collection solrj_collection on 127.0.0.1:31420_gnvi
   [junit4]   2> 384875 T844 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of 
collection solrj_collection on 127.0.0.1:37043_gnvi
   [junit4]   2> 384877 T844 oasc.OverseerCollectionProcessor.createCollection 
Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of 
collection solrj_collection on 127.0.0.1:32994_gnvi
   [junit4]   2> 385015 T788 oasha.CoreAdminHandler.handleCreateAction core 
create command 
version=2&shard=shard1&qt=/admin/cores&numShards=2&collection=solrj_collection&name=solrj_collection_shard1_replica1&collection.configName=conf1&wt=javabin&action=CREATE
   [junit4]   2> 385021 T788 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
   [junit4]   2> 385022 T788 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 385022 T796 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 385028 T815 oasha.CoreAdminHandler.handleCreateAction core 
create command 
version=2&shard=shard2&qt=/admin/cores&numShards=2&collection=solrj_collection&name=solrj_collection_shard2_replica2&collection.configName=conf1&wt=javabin&action=CREATE
   [junit4]   2> 385028 T801 oasha.CoreAdminHandler.handleCreateAction core 
create command 
version=2&shard=shard1&qt=/admin/cores&numShards=2&collection=solrj_collection&name=solrj_collection_shard1_replica2&collection.configName=conf1&wt=javabin&action=CREATE
   [junit4]   2> 385031 T775 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "core":"solrj_collection_shard1_replica1",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "base_url":"https://127.0.0.1:31412/gnvi";,
   [junit4]   2>          "node_name":"127.0.0.1:31412_gnvi"}
   [junit4]   2> 385034 T830 oasha.CoreAdminHandler.handleCreateAction core 
create command 
version=2&shard=shard2&qt=/admin/cores&numShards=2&collection=solrj_collection&name=solrj_collection_shard2_replica1&collection.configName=conf1&wt=javabin&action=CREATE
   [junit4]   2> 385036 T815 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
   [junit4]   2> 385036 T801 oasc.ZkController.publish publishing 
core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
   [junit4]   2> 385037 T815 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 385038 T801 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 385038 T775 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "core":"solrj_collection_shard2_replica2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "base_url":"https://127.0.0.1:32994/gnvi";,
   [junit4]   2>          "node_name":"127.0.0.1:32994_gnvi"}
   [junit4]   2> 385039 T796 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 385040 T830 oasc.ZkController.publish publishing 
core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
   [junit4]   2> 385042 T830 oasc.ZkController.waitForCoreNodeName look for our 
core node name
   [junit4]   2> 385043 T775 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "core":"solrj_collection_shard1_replica2",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "base_url":"https://127.0.0.1:31420/gnvi";,
   [junit4]   2>          "node_name":"127.0.0.1:31420_gnvi"}
   [junit4]   2> 385046 T796 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 385047 T775 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=2 message={
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "core":"solrj_collection_shard2_replica1",
   [junit4]   2>          "state":"down",
   [junit4]   2>          "shard":"shard2",
   [junit4]   2>          "numShards":"2",
   [junit4]   2>          "collection":"solrj_collection",
   [junit4]   2>          "base_url":"https://127.0.0.1:37043/gnvi";,
   [junit4]   2>          "node_name":"127.0.0.1:37043_gnvi"}
   [junit4]   2> 385153 T796 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 385153 T811 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 385153 T841 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 385153 T794 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 385153 T826 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 385153 T795 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 386023 T788 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 386024 T788 oasc.ZkController.createCollectionZkNode Check for 
collection zkNode:solrj_collection
   [junit4]   2> 386025 T788 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 386026 T788 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/solrj_collection
   [junit4]   2> 386027 T788 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 386027 T788 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-003/solrj_collection_shard1_replica1/'
   [junit4]   2> 386038 T815 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 386038 T801 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 386039 T815 oasc.ZkController.createCollectionZkNode Check for 
collection zkNode:solrj_collection
   [junit4]   2> 386040 T801 oasc.ZkController.createCollectionZkNode Check for 
collection zkNode:solrj_collection
   [junit4]   2> 386041 T815 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 386041 T801 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 386041 T815 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/solrj_collection
   [junit4]   2> 386042 T801 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/solrj_collection
   [junit4]   2> 386043 T815 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 386043 T801 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 386044 T815 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-005/solrj_collection_shard2_replica2/'
   [junit4]   2> 386043 T830 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 386044 T801 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-004/solrj_collection_shard1_replica2/'
   [junit4]   2> 386045 T830 oasc.ZkController.createCollectionZkNode Check for 
collection zkNode:solrj_collection
   [junit4]   2> 386046 T830 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 386047 T830 oascc.ZkStateReader.readConfigName Load collection 
config from:/collections/solrj_collection
   [junit4]   2> 386050 T830 oascc.ZkStateReader.readConfigName 
path=/collections/solrj_collection configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 386050 T830 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.CollectionsAPIDistributedZkTest-7B54C811F17E9AF3-001/tempDir-006/solrj_collection_shard2_replica1/'
   [junit4]   2> 386114 T788 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
5.0.0
   [junit4]   2> 386153 T815 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
5.0.0
   [junit4]   2> 386157 T801 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
5.0.0
   [junit4]   2> 386170 T830 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
5.0.0
   [junit4]   2> 386204 T788 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 386206 T788 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 386228 T815 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 386230 T815 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 386231 T801 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 386231 T788 oass.IndexSchema.readSchema 
[solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 386233 T801 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 386257 T830 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 386260 T830 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 386265 T815 oass.IndexSchema.readSchema 
[solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 386267 T801 oass.IndexSchema.readSchema 
[solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 386283 T830 oass.IndexSchema.readSchema 
[solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 386869 T788 oass.OpenExchangeRatesOrgProvider.init Initialized 
with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 386888 T788 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 386894 T801 oass.OpenExchangeRatesOrgProvider.init Initialized 
with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 386894 T788 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 386900 T815 oass.OpenExchangeRatesOrgProvider.init Initialized 
with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 386903 T801 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 386906 T801 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 386909 T815 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 386914 T815 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 386919 T788 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 386927 T788 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 386929 T801 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 386934 T788 oass.OpenExchangeRatesOrgProvider.reload Reloading 
exchange rates from open-exchange-rates.json
   [junit4]   2> 386937 T788 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 386939 T788 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 386940 T801 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 386940 T788 oass.OpenExchangeRatesOrgProvider.reload Reloading 
exchange rates from open-exchange-rates.json
   [junit4]   2> 386942 T788 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 386943 T788 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 386943 T815 oass.FileExchangeRateProvider.reload Reloadin

[...truncated too long message...]

junit4]   2> 2082279 T3909 C1128 oasc.SolrCore.execute [collection1] 
webapp=/solr path=/replication 
params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 
QTime=0 
   [junit4]   2> 2082280 T3928 oash.SnapPuller.fetchLatestIndex Slave in sync 
with master.
   [junit4]   2> 2083279 T3909 C1128 oasc.SolrCore.execute [collection1] 
webapp=/solr path=/replication 
params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 
QTime=0 
   [junit4]   2> 2083279 T3928 oash.SnapPuller.fetchLatestIndex Slave in sync 
with master.
   [junit4]   2> 2084279 T3909 C1128 oasc.SolrCore.execute [collection1] 
webapp=/solr path=/replication 
params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 
QTime=0 
   [junit4]   2> 2084281 T3928 oash.SnapPuller.fetchLatestIndex Slave in sync 
with master.
   [junit4]   2> 2084607 T2879 oas.SolrTestCaseJ4.tearDown ###Ending 
doTestDetails
   [junit4]   2> 2084608 T2879 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=1172815473
   [junit4]   2> 2084610 T2879 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@64ed108c
   [junit4]   2> 2084610 T2879 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=3,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=3,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2084611 T2879 oasu.SolrCoreState.decrefSolrCoreState Closing 
SolrCoreState
   [junit4]   2> 2084611 T2879 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2084612 T2879 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2084613 T2879 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
   [junit4]   2> 2084614 T2879 oasc.CachingDirectoryFactory.close Closing 
MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2084614 T2879 oasc.CachingDirectoryFactory.closeCacheValue 
looking to close 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-001/collection1/data/index
 
[CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-001/collection1/data/index;done=false>>]
   [junit4]   2> 2084614 T2879 oasc.CachingDirectoryFactory.close Closing 
directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-001/collection1/data/index
   [junit4]   2> 2084618 T2879 oasc.CachingDirectoryFactory.closeCacheValue 
looking to close 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-001/collection1/data
 
[CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-001/collection1/data;done=false>>]
   [junit4]   2> 2084618 T2879 oasc.CachingDirectoryFactory.close Closing 
directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-001/collection1/data
   [junit4]   2> 2084619 T2879 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 2089612 T2879 oasc.CoreContainer.shutdown Shutting down 
CoreContainer instance=1159813864
   [junit4]   2> 2089614 T2879 oasc.SolrCore.close [collection1]  CLOSING 
SolrCore org.apache.solr.core.SolrCore@7467b64c
   [junit4]   2> 2100277 T3928 oash.SnapPuller.fetchLatestIndex ERROR Master 
at: http://127.0.0.1:24557/solr is not available. Index fetch failed. 
Exception: IOException occured when talking to server at: 
http://127.0.0.1:24557/solr
   [junit4]   2> 2100279 T2879 oasu.DirectUpdateHandler2.close closing 
DirectUpdateHandler2{commits=0,autocommits=0,soft 
autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2100280 T2879 oasu.SolrCoreState.decrefSolrCoreState Closing 
SolrCoreState
   [junit4]   2> 2100280 T2879 oasu.DefaultSolrCoreState.closeIndexWriter 
SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2100281 T2879 oasu.DefaultSolrCoreState.closeIndexWriter 
closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2100281 T2879 oasc.SolrCore.closeSearcher [collection1] 
Closing main searcher on request.
   [junit4]   2> 2100282 T2879 oasc.CachingDirectoryFactory.close Closing 
MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2100282 T2879 oasc.CachingDirectoryFactory.closeCacheValue 
looking to close 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-002/collection1/data/index
 
[CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-002/collection1/data/index;done=false>>]
   [junit4]   2> 2100283 T2879 oasc.CachingDirectoryFactory.close Closing 
directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-002/collection1/data/index
   [junit4]   2> 2100288 T2879 oasc.CachingDirectoryFactory.closeCacheValue 
looking to close 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-002/collection1/data
 
[CachedDir<<refCount=0;path=/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-002/collection1/data;done=false>>]
   [junit4]   2> 2100288 T2879 oasc.CachingDirectoryFactory.close Closing 
directory: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001/solr-instance-002/collection1/data
   [junit4]   2> 2100289 T2879 oejsh.ContextHandler.doStop stopped 
o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 2104631 T2879 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.handler.TestReplicationHandler-7B54C811F17E9AF3-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): 
{id=PostingsFormat(name=Lucene41VarGapFixedInterval), 
newname=PostingsFormat(name=Lucene41VarGapFixedInterval), 
name=PostingsFormat(name=Lucene41VarGapFixedInterval)}, docValues:{}, 
sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar, 
timezone=Pacific/Kosrae
   [junit4]   2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 
(64-bit)/cpus=16,threads=1,free=75538232,total=281542656
   [junit4]   2> NOTE: All tests run in this JVM: 
[HdfsCollectionsAPIDistributedZkTest, LegacyHTMLStripCharFilterTest, 
CustomCollectionTest, TestDynamicFieldResource, BasicDistributedZk2Test, 
AtomicUpdatesTest, NumericFieldsTest, TestLuceneMatchVersion, 
DistributedExpandComponentTest, TestQueryUtils, XmlUpdateRequestHandlerTest, 
TestComplexPhraseQParserPlugin, MergeStrategyTest, SpellCheckCollatorTest, 
RollingRestartTest, CopyFieldTest, TestExpandComponent, InfoHandlerTest, 
TestSuggestSpellingConverter, TestReplicationHandler]
   [junit4] Completed on J2 in 974.85s, 14 tests, 1 failure <<< FAILURES!

[...truncated 201 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:531:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:472:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:189:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:496:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1360:
 The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:962:
 There were test failures: 431 suites, 1778 tests, 6 suite-level errors, 1 
error, 1 failure, 949 ignored (9 assumptions)

Total time: 147 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #632
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 322347717 bytes
Compression is 0.0%
Took 54 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to