Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Linux/10959/
Java: 32bit/jdk1.7.0_67 -server -XX:+UseConcMarkSweepGC

4 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ReplicationFactorTest

Error Message:
ERROR: SolrIndexSearcher opens=2 closes=1

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=2 closes=1
        at __randomizedtesting.SeedInfo.seed([D0119A168B52B27A]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at 
org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:426)
        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:185)
        at sun.reflect.GeneratedMethodAccessor28.invoke(Unknown Source)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ReplicationFactorTest

Error Message:
17 threads leaked from SUITE scope at 
org.apache.solr.cloud.ReplicationFactorTest:     1) Thread[id=1453, 
name=coreZkRegister-964-thread-1, state=WAITING, 
group=TGRP-ReplicationFactorTest]         at sun.misc.Unsafe.park(Native 
Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
        at java.lang.Thread.run(Thread.java:745)    2) Thread[id=1458, 
name=OverseerCollectionProcessor-92328575300861958-127.0.0.1:43356_uu-n_0000000001,
 state=TIMED_WAITING, group=Overseer collection creation process.]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:121)   
      at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:89)
         at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)        
 at 
org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:514)
         at 
org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:272)
         at java.lang.Thread.run(Thread.java:745)    3) Thread[id=1447, 
name=TEST-ReplicationFactorTest.testDistribSearch-seed#[D0119A168B52B27A]-EventThread,
 state=WAITING, group=TGRP-ReplicationFactorTest]         at 
sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)    
4) Thread[id=1450, name=searcherExecutor-969-thread-1, state=WAITING, 
group=TGRP-ReplicationFactorTest]         at sun.misc.Unsafe.park(Native 
Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
        at java.lang.Thread.run(Thread.java:745)    5) Thread[id=1437, 
name=qtp5087203-1437 Selector1, state=RUNNABLE, 
group=TGRP-ReplicationFactorTest]         at 
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at 
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at 
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at 
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at 
org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
         at 
org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)        
 at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) 
        at java.lang.Thread.run(Thread.java:745)    6) Thread[id=1435, 
name=HashSessionScavenger-40, state=TIMED_WAITING, 
group=TGRP-ReplicationFactorTest]         at java.lang.Object.wait(Native 
Method)         at java.util.TimerThread.mainLoop(Timer.java:552)         at 
java.util.TimerThread.run(Timer.java:505)    7) Thread[id=1446, 
name=TEST-ReplicationFactorTest.testDistribSearch-seed#[D0119A168B52B27A]-SendThread(127.0.0.1:55642),
 state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)    
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)    
8) Thread[id=1441, name=qtp5087203-1441, state=TIMED_WAITING, 
group=TGRP-ReplicationFactorTest]         at sun.misc.Unsafe.park(Native 
Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
         at 
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)     
    at 
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) 
        at java.lang.Thread.run(Thread.java:745)    9) Thread[id=1440, 
name=qtp5087203-1440, state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]    
     at sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
         at 
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)     
    at 
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) 
        at java.lang.Thread.run(Thread.java:745)   10) Thread[id=1451, 
name=Thread-596, state=WAITING, group=TGRP-ReplicationFactorTest]         at 
java.lang.Object.wait(Native Method)         at 
java.lang.Object.wait(Object.java:503)         at 
org.apache.solr.core.CloserThread.run(CoreContainer.java:905)   11) 
Thread[id=1442, name=qtp5087203-1442, state=TIMED_WAITING, 
group=TGRP-ReplicationFactorTest]         at sun.misc.Unsafe.park(Native 
Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
         at 
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)     
    at 
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) 
        at java.lang.Thread.run(Thread.java:745)   12) Thread[id=1457, 
name=OverseerStateUpdate-92328575300861958-127.0.0.1:43356_uu-n_0000000001, 
state=TIMED_WAITING, group=Overseer state updater.]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:121)   
      at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:89)
         at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)        
 at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:604) 
        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:209)       
  at java.lang.Thread.run(Thread.java:745)   13) Thread[id=1443, 
name=qtp5087203-1443, state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]    
     at sun.misc.Unsafe.park(Native Method)         at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         
at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
         at 
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)     
    at 
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) 
        at java.lang.Thread.run(Thread.java:745)   14) Thread[id=1438, 
name=qtp5087203-1438 Acceptor0 [email protected]:43356, 
state=BLOCKED, group=TGRP-ReplicationFactorTest]         at 
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)     
    at 
org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
         at 
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) 
        at java.lang.Thread.run(Thread.java:745)   15) Thread[id=1459, 
name=OverseerHdfsCoreFailoverThread-92328575300861958-127.0.0.1:43356_uu-n_0000000001,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:136)
         at java.lang.Thread.run(Thread.java:745)   16) Thread[id=1439, 
name=qtp5087203-1439 Acceptor1 [email protected]:43356, 
state=RUNNABLE, group=TGRP-ReplicationFactorTest]         at 
sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)         at 
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241)     
    at 
org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
         at 
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) 
        at java.lang.Thread.run(Thread.java:745)   17) Thread[id=1436, 
name=qtp5087203-1436 Selector0, state=RUNNABLE, 
group=TGRP-ReplicationFactorTest]         at 
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)         at 
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)         at 
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at 
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)         at 
org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
         at 
org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)        
 at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) 
        at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 17 threads leaked from 
SUITE scope at org.apache.solr.cloud.ReplicationFactorTest: 
   1) Thread[id=1453, name=coreZkRegister-964-thread-1, state=WAITING, 
group=TGRP-ReplicationFactorTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=1458, 
name=OverseerCollectionProcessor-92328575300861958-127.0.0.1:43356_uu-n_0000000001,
 state=TIMED_WAITING, group=Overseer collection creation process.]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:121)
        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:89)
        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
        at 
org.apache.solr.cloud.OverseerCollectionProcessor.amILeader(OverseerCollectionProcessor.java:514)
        at 
org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:272)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=1447, 
name=TEST-ReplicationFactorTest.testDistribSearch-seed#[D0119A168B52B27A]-EventThread,
 state=WAITING, group=TGRP-ReplicationFactorTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
   4) Thread[id=1450, name=searcherExecutor-969-thread-1, state=WAITING, 
group=TGRP-ReplicationFactorTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   5) Thread[id=1437, name=qtp5087203-1437 Selector1, state=RUNNABLE, 
group=TGRP-ReplicationFactorTest]
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at 
org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at 
org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)
   6) Thread[id=1435, name=HashSessionScavenger-40, state=TIMED_WAITING, 
group=TGRP-ReplicationFactorTest]
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        at java.util.TimerThread.run(Timer.java:505)
   7) Thread[id=1446, 
name=TEST-ReplicationFactorTest.testDistribSearch-seed#[D0119A168B52B27A]-SendThread(127.0.0.1:55642),
 state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   8) Thread[id=1441, name=qtp5087203-1441, state=TIMED_WAITING, 
group=TGRP-ReplicationFactorTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at 
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
        at java.lang.Thread.run(Thread.java:745)
   9) Thread[id=1440, name=qtp5087203-1440, state=TIMED_WAITING, 
group=TGRP-ReplicationFactorTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at 
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
        at java.lang.Thread.run(Thread.java:745)
  10) Thread[id=1451, name=Thread-596, state=WAITING, 
group=TGRP-ReplicationFactorTest]
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:503)
        at org.apache.solr.core.CloserThread.run(CoreContainer.java:905)
  11) Thread[id=1442, name=qtp5087203-1442, state=TIMED_WAITING, 
group=TGRP-ReplicationFactorTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at 
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
        at java.lang.Thread.run(Thread.java:745)
  12) Thread[id=1457, 
name=OverseerStateUpdate-92328575300861958-127.0.0.1:43356_uu-n_0000000001, 
state=TIMED_WAITING, group=Overseer state updater.]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:121)
        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:89)
        at 
org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:304)
        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:604)
        at 
org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:209)
        at java.lang.Thread.run(Thread.java:745)
  13) Thread[id=1443, name=qtp5087203-1443, state=TIMED_WAITING, 
group=TGRP-ReplicationFactorTest]
        at sun.misc.Unsafe.park(Native Method)
        at 
java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at 
org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
        at java.lang.Thread.run(Thread.java:745)
  14) Thread[id=1438, name=qtp5087203-1438 Acceptor0 
[email protected]:43356, state=BLOCKED, 
group=TGRP-ReplicationFactorTest]
        at 
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:225)
        at 
org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at 
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)
  15) Thread[id=1459, 
name=OverseerHdfsCoreFailoverThread-92328575300861958-127.0.0.1:43356_uu-n_0000000001,
 state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:136)
        at java.lang.Thread.run(Thread.java:745)
  16) Thread[id=1439, name=qtp5087203-1439 Acceptor1 
[email protected]:43356, state=RUNNABLE, 
group=TGRP-ReplicationFactorTest]
        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at 
sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241)
        at 
org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
        at 
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)
  17) Thread[id=1436, name=qtp5087203-1436 Selector0, state=RUNNABLE, 
group=TGRP-ReplicationFactorTest]
        at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
        at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
        at 
org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
        at 
org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)
        at __randomizedtesting.SeedInfo.seed([D0119A168B52B27A]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ReplicationFactorTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) 
Thread[id=1450, name=searcherExecutor-969-thread-1, state=WAITING, 
group=TGRP-ReplicationFactorTest]         at sun.misc.Unsafe.park(Native 
Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
        at java.lang.Thread.run(Thread.java:745)    2) Thread[id=1439, 
name=qtp5087203-1439 Acceptor1 [email protected]:43356, 
state=BLOCKED, group=TGRP-ReplicationFactorTest]         at 
org.eclipse.jetty.server.nio.SelectChannelConnector.getConnection(SelectChannelConnector.java:160)
         at 
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:934)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) 
        at java.lang.Thread.run(Thread.java:745)    3) Thread[id=1437, 
name=qtp5087203-1437 Selector1, state=RUNNABLE, 
group=TGRP-ReplicationFactorTest]         at 
sun.nio.ch.EPollArrayWrapper.interrupt(Native Method)         at 
sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:317)         at 
sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:193)         at 
java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)   
      at 
java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)         
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:78)         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)         at 
sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:106)         at 
org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:536)
         at 
org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)        
 at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) 
        at java.lang.Thread.run(Thread.java:745)    4) Thread[id=1438, 
name=qtp5087203-1438 Acceptor0 [email protected]:43356, 
state=RUNNABLE, group=TGRP-ReplicationFactorTest]         at 
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:956)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) 
        at java.lang.Thread.run(Thread.java:745)    5) Thread[id=1459, 
name=OverseerHdfsCoreFailoverThread-92328575300861958-127.0.0.1:43356_uu-n_0000000001,
 state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:136)
         at java.lang.Thread.run(Thread.java:745)    6) Thread[id=1453, 
name=coreZkRegister-964-thread-1, state=WAITING, 
group=TGRP-ReplicationFactorTest]         at sun.misc.Unsafe.park(Native 
Method)         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)     
    at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)   
      at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) 
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
        at java.lang.Thread.run(Thread.java:745)    7) Thread[id=1451, 
name=Thread-596, state=WAITING, group=TGRP-ReplicationFactorTest]         at 
java.lang.Object.wait(Native Method)         at 
java.lang.Object.wait(Object.java:503)         at 
org.apache.solr.core.CloserThread.run(CoreContainer.java:905)    8) 
Thread[id=1436, name=qtp5087203-1436 Selector0, state=RUNNABLE, 
group=TGRP-ReplicationFactorTest]         at 
org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)        
 at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) 
        at java.lang.Thread.run(Thread.java:745)    9) Thread[id=1435, 
name=HashSessionScavenger-40, state=TIMED_WAITING, 
group=TGRP-ReplicationFactorTest]         at java.lang.Object.wait(Native 
Method)         at java.util.TimerThread.mainLoop(Timer.java:552)         at 
java.util.TimerThread.run(Timer.java:505)   10) Thread[id=1446, 
name=TEST-ReplicationFactorTest.testDistribSearch-seed#[D0119A168B52B27A]-SendThread(127.0.0.1:55642),
 state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]         at 
java.lang.Thread.sleep(Native Method)         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)    
     at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   1) Thread[id=1450, name=searcherExecutor-969-thread-1, state=WAITING, 
group=TGRP-ReplicationFactorTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=1439, name=qtp5087203-1439 Acceptor1 
[email protected]:43356, state=BLOCKED, 
group=TGRP-ReplicationFactorTest]
        at 
org.eclipse.jetty.server.nio.SelectChannelConnector.getConnection(SelectChannelConnector.java:160)
        at 
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:934)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)
   3) Thread[id=1437, name=qtp5087203-1437 Selector1, state=RUNNABLE, 
group=TGRP-ReplicationFactorTest]
        at sun.nio.ch.EPollArrayWrapper.interrupt(Native Method)
        at sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:317)
        at sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:193)
        at 
java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
        at 
java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
        at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:78)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
        at sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:106)
        at 
org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:536)
        at 
org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)
   4) Thread[id=1438, name=qtp5087203-1438 Acceptor0 
[email protected]:43356, state=RUNNABLE, 
group=TGRP-ReplicationFactorTest]
        at 
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:956)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)
   5) Thread[id=1459, 
name=OverseerHdfsCoreFailoverThread-92328575300861958-127.0.0.1:43356_uu-n_0000000001,
 state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:136)
        at java.lang.Thread.run(Thread.java:745)
   6) Thread[id=1453, name=coreZkRegister-964-thread-1, state=WAITING, 
group=TGRP-ReplicationFactorTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
        at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
        at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
   7) Thread[id=1451, name=Thread-596, state=WAITING, 
group=TGRP-ReplicationFactorTest]
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:503)
        at org.apache.solr.core.CloserThread.run(CoreContainer.java:905)
   8) Thread[id=1436, name=qtp5087203-1436 Selector0, state=RUNNABLE, 
group=TGRP-ReplicationFactorTest]
        at 
org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
        at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
        at java.lang.Thread.run(Thread.java:745)
   9) Thread[id=1435, name=HashSessionScavenger-40, state=TIMED_WAITING, 
group=TGRP-ReplicationFactorTest]
        at java.lang.Object.wait(Native Method)
        at java.util.TimerThread.mainLoop(Timer.java:552)
        at java.util.TimerThread.run(Timer.java:505)
  10) Thread[id=1446, 
name=TEST-ReplicationFactorTest.testDistribSearch-seed#[D0119A168B52B27A]-SendThread(127.0.0.1:55642),
 state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]
        at java.lang.Thread.sleep(Native Method)
        at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
        at __randomizedtesting.SeedInfo.seed([D0119A168B52B27A]:0)


REGRESSION:  org.apache.solr.cloud.ReplicationFactorTest.testDistribSearch

Error Message:
Address already in use

Stack Trace:
java.net.BindException: Address already in use
        at 
__randomizedtesting.SeedInfo.seed([D0119A168B52B27A:51F7140EFC0DD246]:0)
        at java.net.PlainSocketImpl.socketBind(Native Method)
        at 
java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:376)
        at java.net.ServerSocket.bind(ServerSocket.java:376)
        at org.apache.solr.cloud.SocketProxy.open(SocketProxy.java:101)
        at org.apache.solr.cloud.SocketProxy.<init>(SocketProxy.java:79)
        at 
org.apache.solr.cloud.ReplicationFactorTest.createJetty(ReplicationFactorTest.java:119)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:381)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:325)
        at 
org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
        at 
org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
        at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11409 lines...]
   [junit4] Suite: org.apache.solr.cloud.ReplicationFactorTest
   [junit4]   2> Creating dataDir: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/init-core-data-001
   [junit4]   2> 488165 T1399 oas.BaseDistributedSearchTestCase.initHostContext 
Setting hostContext system property: /uu/
   [junit4]   2> 488172 T1399 oas.SolrTestCaseJ4.setUp ###Starting 
testDistribSearch
   [junit4]   2> 488173 T1399 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 488174 T1400 oasc.ZkTestServer$ZKServerMain.runFromConfig 
Starting server
   [junit4]   2> 488274 T1399 oasc.ZkTestServer.run start zk server on 
port:55642
   [junit4]   2> 488275 T1399 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 488277 T1406 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@176c98c name:ZooKeeperConnection 
Watcher:127.0.0.1:55642 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 488277 T1399 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 488277 T1399 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 488281 T1399 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 488281 T1408 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@13a0fdc name:ZooKeeperConnection 
Watcher:127.0.0.1:55642/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 488282 T1399 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 488282 T1399 oascc.SolrZkClient.makePath makePath: 
/collections/collection1
   [junit4]   2> 488286 T1399 oascc.SolrZkClient.makePath makePath: 
/collections/collection1/shards
   [junit4]   2> 488288 T1399 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection
   [junit4]   2> 488290 T1399 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/shards
   [junit4]   2> 488292 T1399 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 488292 T1399 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.xml
   [junit4]   2> 488295 T1399 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 488296 T1399 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/schema.xml
   [junit4]   2> 488298 T1399 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 488299 T1399 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 488301 T1399 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 488301 T1399 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/stopwords.txt
   [junit4]   2> 488303 T1399 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 488304 T1399 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/protwords.txt
   [junit4]   2> 488306 T1399 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 488306 T1399 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/currency.xml
   [junit4]   2> 488309 T1399 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 488309 T1399 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/enumsConfig.xml
   [junit4]   2> 488311 T1399 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 488312 T1399 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/open-exchange-rates.json
   [junit4]   2> 488314 T1399 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 488315 T1399 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 488317 T1399 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 488317 T1399 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/old_synonyms.txt
   [junit4]   2> 488320 T1399 oasc.AbstractZkTestCase.putConfig put 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 488320 T1399 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/synonyms.txt
   [junit4]   2> 488681 T1399 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 488685 T1399 oejs.AbstractConnector.doStart Started 
[email protected]:57577
   [junit4]   2> 488685 T1399 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 488686 T1399 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 488686 T1399 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-002
   [junit4]   2> 488686 T1399 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-002/'
   [junit4]   2> 488700 T1399 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-002/solr.xml
   [junit4]   2> 488732 T1399 oasc.CoreContainer.<init> New CoreContainer 
19712029
   [junit4]   2> 488732 T1399 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-002/]
   [junit4]   2> 488733 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 488734 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 488734 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 488734 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 488734 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 488735 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 488735 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 488735 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 488735 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 488736 T1399 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 488736 T1399 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 488736 T1399 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 488737 T1399 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 488737 T1399 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:55642/solr
   [junit4]   2> 488737 T1399 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 488738 T1399 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 488739 T1419 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@105f7e8 name:ZooKeeperConnection 
Watcher:127.0.0.1:55642 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 488739 T1399 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 488741 T1399 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 488742 T1421 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@2a0391 name:ZooKeeperConnection 
Watcher:127.0.0.1:55642/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 488743 T1399 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 488744 T1399 oascc.SolrZkClient.makePath makePath: 
/overseer/queue
   [junit4]   2> 488746 T1399 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-queue-work
   [junit4]   2> 488749 T1399 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-running
   [junit4]   2> 488752 T1399 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-completed
   [junit4]   2> 488754 T1399 oascc.SolrZkClient.makePath makePath: 
/overseer/collection-map-failure
   [junit4]   2> 488757 T1399 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 488759 T1399 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51517_uu
   [junit4]   2> 488760 T1399 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:51517_uu
   [junit4]   2> 488764 T1399 oascc.SolrZkClient.makePath makePath: 
/overseer_elect
   [junit4]   2> 488766 T1399 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/election
   [junit4]   2> 488768 T1399 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 488769 T1399 oasc.OverseerElectionContext.runLeaderProcess I 
am going to be the leader 127.0.0.1:51517_uu
   [junit4]   2> 488770 T1399 oascc.SolrZkClient.makePath makePath: 
/overseer_elect/leader
   [junit4]   2> 488772 T1399 oasc.Overseer.start Overseer 
(id=92328575300861955-127.0.0.1:51517_uu-n_0000000000) starting
   [junit4]   2> 488774 T1399 oascc.SolrZkClient.makePath makePath: 
/overseer/queue-work
   [junit4]   2> 488781 T1399 oasc.OverseerAutoReplicaFailoverThread.<init> 
Starting OverseerAutoReplicaFailoverThread 
autoReplicaFailoverWorkLoopDelay=10000 
autoReplicaFailoverWaitAfterExpiration=30000 
autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 488782 T1423 oasc.OverseerCollectionProcessor.run Process 
current queue of collection creations
   [junit4]   2> 488783 T1399 oascc.SolrZkClient.makePath makePath: 
/clusterstate.json
   [junit4]   2> 488785 T1399 oascc.SolrZkClient.makePath makePath: 
/aliases.json
   [junit4]   2> 488787 T1399 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 488796 T1422 oasc.Overseer$ClusterStateUpdater.run Starting to 
work on the main queue
   [junit4]   2> 488797 T1425 oasc.ZkController.publish publishing 
core=collection1 state=down collection=control_collection
   [junit4]   2> 488797 T1425 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 488798 T1425 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 488798 T1426 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 488801 T1422 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=1 message={
   [junit4]   2>          "shard":null,
   [junit4]   2>          "state":"down",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "numShards":"1",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "base_url":"http://127.0.0.1:51517/uu";,
   [junit4]   2>          "collection":"control_collection",
   [junit4]   2>          "node_name":"127.0.0.1:51517_uu"}
   [junit4]   2> 488801 T1422 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
control_collection with shards [shard1]
   [junit4]   2> 488801 T1422 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 488804 T1426 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 489798 T1425 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for collection1
   [junit4]   2> 489799 T1425 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:control_collection
   [junit4]   2> 489799 T1425 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 489799 T1425 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/control_collection
   [junit4]   2> 489800 T1425 oascc.ZkStateReader.readConfigName 
path=/collections/control_collection configName=conf1 specified config exists 
in ZooKeeper
   [junit4]   2> 489801 T1425 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-002/collection1/'
   [junit4]   2> 489801 T1425 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-002/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 489802 T1425 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-002/collection1/lib/classes/'
 to classloader
   [junit4]   2> 489802 T1425 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-002/collection1/lib/README'
 to classloader
   [junit4]   2> 489844 T1425 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
4.11.0
   [junit4]   2> 489887 T1425 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 489888 T1425 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 489895 T1425 oass.IndexSchema.readSchema [collection1] Schema 
name=test
   [junit4]   2> 490174 T1425 oass.ByteField.init WARN ByteField is deprecated 
and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 490174 T1425 oass.ShortField.init WARN ShortField is 
deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 490175 T1425 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 490185 T1425 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 490187 T1425 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 490197 T1425 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 490201 T1425 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 490204 T1425 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 490205 T1425 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 490205 T1425 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 490206 T1425 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 490206 T1425 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 490207 T1425 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 490207 T1425 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection control_collection
   [junit4]   2> 490207 T1425 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 490207 T1425 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-002/collection1/,
 
dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-001/control/data/
   [junit4]   2> 490208 T1425 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@23295a
   [junit4]   2> 490209 T1425 oasc.CachingDirectoryFactory.get return new 
directory for 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-001/control/data
   [junit4]   2> 490209 T1425 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-001/control/data/index/
   [junit4]   2> 490209 T1425 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-001/control/data/index'
 doesn't exist. Creating new index...
   [junit4]   2> 490210 T1425 oasc.CachingDirectoryFactory.get return new 
directory for 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-001/control/data/index
   [junit4]   2> 490210 T1425 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.AlcoholicMergePolicy: 
[AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1465672233, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.1]
   [junit4]   2> 490211 T1425 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory@16722f6 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb633b),segFN=segments_1,generation=1}
   [junit4]   2> 490211 T1425 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 490215 T1425 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 490216 T1425 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 490216 T1425 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 490216 T1425 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 490216 T1425 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 490217 T1425 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 490217 T1425 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 490218 T1425 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 490218 T1425 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 490218 T1425 oasc.RequestHandlers.initHandlersFromConfig 
created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 490219 T1425 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 490219 T1425 oasc.RequestHandlers.initHandlersFromConfig 
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 490220 T1425 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 490220 T1425 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 490221 T1425 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 490221 T1425 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 490221 T1425 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 490222 T1425 oasc.RequestHandlers.initHandlersFromConfig WARN 
Multiple requestHandler registered to the same name: /update ignoring: 
org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 490222 T1425 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 490222 T1425 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 490223 T1425 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 490227 T1425 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 490229 T1425 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 490230 T1425 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 490232 T1425 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 490233 T1425 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 490236 T1425 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 490236 T1425 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 490236 T1425 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=44, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=97.75, 
floorSegmentMB=1.4306640625, forceMergeDeletesPctAllowed=23.088374095148662, 
segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.35770447587707055
   [junit4]   2> 490237 T1425 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory@16722f6 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@eb633b),segFN=segments_1,generation=1}
   [junit4]   2> 490237 T1425 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 490237 T1425 oass.SolrIndexSearcher.<init> Opening 
Searcher@175b35d[collection1] main
   [junit4]   2> 490238 T1425 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/control_collection
   [junit4]   2> 490239 T1425 oascc.ZkStateReader.readConfigName 
path=/collections/control_collection configName=conf1 specified config exists 
in ZooKeeper
   [junit4]   2> 490239 T1425 oasr.ManagedResourceStorage.newStorageIO Setting 
up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 490239 T1425 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured 
ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 490239 T1425 oasr.RestManager.init Initializing RestManager 
with initArgs: {}
   [junit4]   2> 490240 T1425 oasr.ManagedResourceStorage.load Reading 
_rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 490240 T1425 
oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found 
for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 490240 T1425 oasr.ManagedResourceStorage.load Loaded null at 
path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 490241 T1425 oascc.SolrZkClient.makePath makePath: 
/configs/conf1/_rest_managed.json
   [junit4]   2> 490243 T1425 
oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new 
znode /configs/conf1/_rest_managed.json
   [junit4]   2> 490243 T1425 oasr.ManagedResourceStorage$JsonStorage.store 
Saved JSON object to path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 490243 T1425 oasr.RestManager.init Initializing 0 registered 
ManagedResources
   [junit4]   2> 490245 T1427 oasc.SolrCore.registerSearcher [collection1] 
Registered new searcher Searcher@175b35d[collection1] 
main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 490247 T1425 oasc.CoreContainer.registerCore registering core: 
collection1
   [junit4]   2> 490248 T1430 oasc.ZkController.register Register replica - 
core:collection1 address:http://127.0.0.1:51517/uu 
collection:control_collection shard:shard1
   [junit4]   2> 490248 T1399 oass.SolrDispatchFilter.init 
user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 490249 T1430 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 490249 T1399 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init() done
   [junit4]   2> 490252 T1399 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 490252 T1430 oasc.ShardLeaderElectionContext.runLeaderProcess 
Running the leader process for shard shard1
   [junit4]   2> 490254 T1433 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@197d35f name:ZooKeeperConnection 
Watcher:127.0.0.1:55642/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 490254 T1399 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 490254 T1426 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 490255 T1430 
oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found 
to continue.
   [junit4]   2> 490255 T1430 oasc.ShardLeaderElectionContext.runLeaderProcess 
I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C890 name=collection1 
org.apache.solr.core.SolrCore@1ed3ff9 url=http://127.0.0.1:51517/uu/collection1 
node=127.0.0.1:51517_uu C890_STATE=coll:control_collection core:collection1 
props:{state=down, core=collection1, base_url=http://127.0.0.1:51517/uu, 
node_name=127.0.0.1:51517_uu}
   [junit4]   2> 490255 T1430 C890 P51517 oasc.SyncStrategy.sync Sync replicas 
to http://127.0.0.1:51517/uu/collection1/
   [junit4]   2> 490255 T1399 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 490255 T1430 C890 P51517 oasc.SyncStrategy.syncReplicas Sync 
Success - now sync replicas to me
   [junit4]   2> 490256 T1430 C890 P51517 oasc.SyncStrategy.syncToMe 
http://127.0.0.1:51517/uu/collection1/ has no replicas
   [junit4]   2> 490256 T1430 oasc.ShardLeaderElectionContext.runLeaderProcess 
I am the new leader: http://127.0.0.1:51517/uu/collection1/ shard1
   [junit4]   2> 490256 T1430 oascc.SolrZkClient.makePath makePath: 
/collections/control_collection/leaders/shard1
   [junit4]   2> 490258 T1399 oasc.ChaosMonkey.monkeyLog monkey: init - expire 
sessions:false cause connection loss:false
   [junit4]   2> 490264 T1426 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 490368 T1426 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 490368 T1434 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 490416 T1430 oasc.ZkController.register We are 
http://127.0.0.1:51517/uu/collection1/ and leader is 
http://127.0.0.1:51517/uu/collection1/
   [junit4]   2> 490416 T1430 oasc.ZkController.register No LogReplay needed 
for core=collection1 baseURL=http://127.0.0.1:51517/uu
   [junit4]   2> 490416 T1430 oasc.ZkController.checkRecovery I am the leader, 
no recovery necessary
   [junit4]   2> 490417 T1430 oasc.ZkController.publish publishing 
core=collection1 state=active collection=control_collection
   [junit4]   2> 490417 T1430 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 490418 T1426 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 490420 T1422 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "shard":"shard1",
   [junit4]   2>          "state":"active",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "base_url":"http://127.0.0.1:51517/uu";,
   [junit4]   2>          "collection":"control_collection",
   [junit4]   2>          "core_node_name":"core_node1",
   [junit4]   2>          "node_name":"127.0.0.1:51517_uu"}
   [junit4]   2> 490523 T1434 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 490523 T1426 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 490551 T1399 oasc.AbstractFullDistribZkTestBase.createJettys 
create jetty 1
   [junit4]   2> 490552 T1399 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 490553 T1399 oejs.AbstractConnector.doStart Started 
[email protected]:43356
   [junit4]   2> 490554 T1399 oass.SolrDispatchFilter.init 
SolrDispatchFilter.init()
   [junit4]   2> 490554 T1399 oasc.SolrResourceLoader.locateSolrHome JNDI not 
configured for solr (NoInitialContextEx)
   [junit4]   2> 490555 T1399 oasc.SolrResourceLoader.locateSolrHome using 
system property solr.solr.home: 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-003
   [junit4]   2> 490555 T1399 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-003/'
   [junit4]   2> 490568 T1399 oasc.ConfigSolr.fromFile Loading container 
configuration from 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-003/solr.xml
   [junit4]   2> 490601 T1399 oasc.CoreContainer.<init> New CoreContainer 
14020748
   [junit4]   2> 490602 T1399 oasc.CoreContainer.load Loading cores into 
CoreContainer 
[instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-003/]
   [junit4]   2> 490603 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting socketTimeout to: 90000
   [junit4]   2> 490603 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting urlScheme to: 
   [junit4]   2> 490603 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting connTimeout to: 15000
   [junit4]   2> 490603 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting maxConnectionsPerHost to: 20
   [junit4]   2> 490604 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting corePoolSize to: 0
   [junit4]   2> 490604 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting maximumPoolSize to: 2147483647
   [junit4]   2> 490604 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting maxThreadIdleTime to: 5
   [junit4]   2> 490604 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting sizeOfQueue to: -1
   [junit4]   2> 490605 T1399 oashc.HttpShardHandlerFactory.getParameter 
Setting fairnessPolicy to: false
   [junit4]   2> 490605 T1399 oasu.UpdateShardHandler.<init> Creating 
UpdateShardHandler HTTP client with params: 
socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 490605 T1399 oasl.LogWatcher.createWatcher SLF4J impl is 
org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 490606 T1399 oasl.LogWatcher.newRegisteredLogWatcher 
Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 490606 T1399 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 490606 T1399 oasc.ZkContainer.initZooKeeper Zookeeper 
client=127.0.0.1:55642/solr
   [junit4]   2> 490607 T1399 oasc.ZkController.checkChrootPath zkHost includes 
chroot
   [junit4]   2> 490607 T1399 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 490608 T1445 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@1a38411 name:ZooKeeperConnection 
Watcher:127.0.0.1:55642 got event WatchedEvent state:SyncConnected type:None 
path:null path:null type:None
   [junit4]   2> 490609 T1399 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 490610 T1399 oascc.ConnectionManager.waitForConnected Waiting 
for client to connect to ZooKeeper
   [junit4]   2> 490611 T1447 oascc.ConnectionManager.process Watcher 
org.apache.solr.common.cloud.ConnectionManager@ea9594 name:ZooKeeperConnection 
Watcher:127.0.0.1:55642/solr got event WatchedEvent state:SyncConnected 
type:None path:null path:null type:None
   [junit4]   2> 490611 T1399 oascc.ConnectionManager.waitForConnected Client 
is connected to ZooKeeper
   [junit4]   2> 490617 T1399 
oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state 
from ZooKeeper... 
   [junit4]   2> 491620 T1399 oasc.ZkController.createEphemeralLiveNode 
Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43356_uu
   [junit4]   2> 491621 T1399 oascc.SolrZkClient.makePath makePath: 
/live_nodes/127.0.0.1:43356_uu
   [junit4]   2> 491625 T1399 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 491636 T1449 oasc.ZkController.publish publishing 
core=collection1 state=down collection=collection1
   [junit4]   2> 491636 T1449 oasc.ZkController.publish numShards not found on 
descriptor - reading it from system property
   [junit4]   2> 491643 T1426 oasc.DistributedQueue$LatchChildWatcher.process 
LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type 
NodeChildrenChanged
   [junit4]   2> 491643 T1449 oasc.ZkController.waitForCoreNodeName look for 
our core node name
   [junit4]   2> 491644 T1422 oasc.Overseer$ClusterStateUpdater.updateState 
Update state numShards=3 message={
   [junit4]   2>          "shard":null,
   [junit4]   2>          "state":"down",
   [junit4]   2>          "operation":"state",
   [junit4]   2>          "numShards":"3",
   [junit4]   2>          "roles":null,
   [junit4]   2>          "core":"collection1",
   [junit4]   2>          "base_url":"http://127.0.0.1:43356/uu";,
   [junit4]   2>          "collection":"collection1",
   [junit4]   2>          "node_name":"127.0.0.1:43356_uu"}
   [junit4]   2> 491645 T1422 
oasc.Overseer$ClusterStateUpdater.createCollection Create collection 
collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 491645 T1422 oasc.Overseer$ClusterStateUpdater.updateState 
Assigning new node to shard shard=shard1
   [junit4]   2> 491748 T1434 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 491748 T1426 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 491748 T1448 oascc.ZkStateReader$2.process A cluster state 
change: WatchedEvent state:SyncConnected type:NodeDataChanged 
path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 492643 T1449 oasc.ZkController.waitForShardId waiting to find 
shard id in clusterstate for collection1
   [junit4]   2> 492643 T1449 oasc.ZkController.createCollectionZkNode Check 
for collection zkNode:collection1
   [junit4]   2> 492646 T1449 oasc.ZkController.createCollectionZkNode 
Collection zkNode exists
   [junit4]   2> 492646 T1449 oascc.ZkStateReader.readConfigName Load 
collection config from:/collections/collection1
   [junit4]   2> 492647 T1449 oascc.ZkStateReader.readConfigName 
path=/collections/collection1 configName=conf1 specified config exists in 
ZooKeeper
   [junit4]   2> 492647 T1449 oasc.SolrResourceLoader.<init> new 
SolrResourceLoader for directory: 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-003/collection1/'
   [junit4]   2> 492648 T1449 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-003/collection1/lib/.svn/'
 to classloader
   [junit4]   2> 492648 T1449 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-003/collection1/lib/classes/'
 to classloader
   [junit4]   2> 492649 T1449 oasc.SolrResourceLoader.replaceClassLoader Adding 
'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-003/collection1/lib/README'
 to classloader
   [junit4]   2> 492691 T1449 oasc.SolrConfig.<init> Using Lucene MatchVersion: 
4.11.0
   [junit4]   2> 492733 T1449 oasc.SolrConfig.<init> Loaded SolrConfig: 
solrconfig.xml
   [junit4]   2> 492734 T1449 oass.IndexSchema.readSchema Reading Solr Schema 
from schema.xml
   [junit4]   2> 492743 T1449 oass.IndexSchema.readSchema [collection1] Schema 
name=test
   [junit4]   2> 493084 T1449 oass.ByteField.init WARN ByteField is deprecated 
and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 493085 T1449 oass.ShortField.init WARN ShortField is 
deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 493085 T1449 oass.OpenExchangeRatesOrgProvider.init 
Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 493096 T1449 oass.IndexSchema.readSchema default search field 
in schema is text
   [junit4]   2> 493099 T1449 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 493112 T1449 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 493116 T1449 oass.FileExchangeRateProvider.reload Reloading 
exchange rates from file currency.xml
   [junit4]   2> 493119 T1449 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 493121 T1449 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 493121 T1449 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 493121 T1449 oass.OpenExchangeRatesOrgProvider.reload 
Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 493122 T1449 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key 
IMPORTANT NOTE
   [junit4]   2> 493122 T1449 
oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, 
got STRING
   [junit4]   2> 493123 T1449 oasc.CoreContainer.create Creating SolrCore 
'collection1' using configuration from collection collection1
   [junit4]   2> 493123 T1449 oasc.SolrCore.initDirectoryFactory 
org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 493123 T1449 oasc.SolrCore.<init> [collection1] Opening new 
SolrCore at 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-003/collection1/,
 
dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-001/jetty1/
   [junit4]   2> 493123 T1449 oasc.JmxMonitoredMap.<init> JMX monitoring is 
enabled. Adding Solr mbeans to JMX Server: 
com.sun.jmx.mbeanserver.JmxMBeanServer@23295a
   [junit4]   2> 493124 T1449 oasc.CachingDirectoryFactory.get return new 
directory for 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-001/jetty1
   [junit4]   2> 493124 T1449 oasc.SolrCore.getNewIndexDir New index directory 
detected: old=null 
new=/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-001/jetty1/index/
   [junit4]   2> 493125 T1449 oasc.SolrCore.initIndex WARN [collection1] Solr 
index directory 
'/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-001/jetty1/index'
 doesn't exist. Creating new index...
   [junit4]   2> 493125 T1449 oasc.CachingDirectoryFactory.get return new 
directory for 
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.ReplicationFactorTest-D0119A168B52B27A-001/tempDir-001/jetty1/index
   [junit4]   2> 493126 T1449 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.AlcoholicMergePolicy: 
[AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1465672233, 
maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, 
maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.1]
   [junit4]   2> 493127 T1449 oasc.SolrDeletionPolicy.onCommit 
SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory@8896d5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2b3c63),segFN=segments_1,generation=1}
   [junit4]   2> 493127 T1449 oasc.SolrDeletionPolicy.updateCommits newest 
commit generation = 1
   [junit4]   2> 493132 T1449 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "nodistrib"
   [junit4]   2> 493133 T1449 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "dedupe"
   [junit4]   2> 493133 T1449 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 493133 T1449 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "stored_sig"
   [junit4]   2> 493133 T1449 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 493134 T1449 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 493134 T1449 oasup.UpdateRequestProcessorChain.init creating 
updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 493135 T1449 oasup.UpdateRequestProcessorChain.init inserting 
DistributedUpdateProcessorFactory into updateRequestProcessorChain 
"distrib-dup-test-chain-implicit"
   [junit4]   2> 493135 T1449 oasc.SolrCore.loadUpdateProcessorChains no 
updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 493135 T1449 oasc.RequestHandlers.initHandlersFromConfig 
created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 493136 T1449 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 493137 T1449 oasc.RequestHandlers.initHandlersFromConfig 
created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 493137 T1449 oasc.RequestHandlers.initHandlersFromConfig 
created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 493138 T1449 oasc.RequestHandlers.initHandlersFromConfig 
created standard: solr.StandardRequestHandler
   [junit4]   2> 493138 T1449 oasc.RequestHandlers.initHandlersFromConfig 
created /get: solr.RealTimeGetHandler
   [junit4]   2> 493138 T1449 oasc.RequestHandlers.initHandlersFromConfig 
adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 493139 T1449 oasc.RequestHandlers.initHandlersFromConfig 
created /replication: solr.ReplicationHandler
   [junit4]   2> 493139 T1449 oasc.RequestHandlers.initHandlersFromConfig WARN 
Multiple requestHandler registered to the same name: /update ignoring: 
org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 493140 T1449 oasc.RequestHandlers.initHandlersFromConfig 
created /update: solr.UpdateRequestHandler
   [junit4]   2> 493140 T1449 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 493141 T1449 oasc.RequestHandlers.initHandlersFromConfig 
created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 493145 T1449 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 493146 T1449 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 493148 T1449 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 493149 T1449 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 493150 T1449 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 493153 T1449 oasu.CommitTracker.<init> Hard AutoCommit: 
disabled
   [junit4]   2> 493153 T1449 oasu.CommitTracker.<init> Soft AutoCommit: 
disabled
   [junit4]   2> 493154 T1449 oasu.RandomMergePolicy.<init> RandomMergePolicy 
wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=44, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=97.75, 
floorSegmentMB=1.4306640625, forceMergeDeletesPctAllowed=23.088374095148662, 
segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.35770447587707055
   [junit4]   2> 493154 T1449 oasc.SolrDeletionPolicy.onInit 
SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2>                
commit{dir=MockDirectoryWrapper(RAMDirectory@8896d5 
lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2b3c63),segFN=segments_1,generation=1}
   [junit4]   2> 493155 T1449 oasc.SolrDeletionPolicy.updateCommits n

[...truncated too long message...]

pt(ServerSocketChannelImpl.java:241)
   [junit4]    >         at 
org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
   [junit4]    >         at 
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
   [junit4]    >         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]    >         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >   17) Thread[id=1436, name=qtp5087203-1436 Selector0, 
state=RUNNABLE, group=TGRP-ReplicationFactorTest]
   [junit4]    >         at sun.nio.ch.EPollArrayWrapper.epollWait(Native 
Method)
   [junit4]    >         at 
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
   [junit4]    >         at 
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
   [junit4]    >         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
   [junit4]    >         at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
   [junit4]    >         at 
org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
   [junit4]    >         at 
org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
   [junit4]    >         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]    >         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([D0119A168B52B27A]:0)Throwable #3: 
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie 
threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=1450, name=searcherExecutor-969-thread-1, 
state=WAITING, group=TGRP-ReplicationFactorTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    2) Thread[id=1439, name=qtp5087203-1439 Acceptor1 
[email protected]:43356, state=BLOCKED, 
group=TGRP-ReplicationFactorTest]
   [junit4]    >         at 
org.eclipse.jetty.server.nio.SelectChannelConnector.getConnection(SelectChannelConnector.java:160)
   [junit4]    >         at 
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:934)
   [junit4]    >         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]    >         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    3) Thread[id=1437, name=qtp5087203-1437 Selector1, 
state=RUNNABLE, group=TGRP-ReplicationFactorTest]
   [junit4]    >         at sun.nio.ch.EPollArrayWrapper.interrupt(Native 
Method)
   [junit4]    >         at 
sun.nio.ch.EPollArrayWrapper.interrupt(EPollArrayWrapper.java:317)
   [junit4]    >         at 
sun.nio.ch.EPollSelectorImpl.wakeup(EPollSelectorImpl.java:193)
   [junit4]    >         at 
java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
   [junit4]    >         at 
java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
   [junit4]    >         at 
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:78)
   [junit4]    >         at 
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
   [junit4]    >         at 
sun.nio.ch.SelectorImpl.selectNow(SelectorImpl.java:106)
   [junit4]    >         at 
org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:536)
   [junit4]    >         at 
org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
   [junit4]    >         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]    >         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    4) Thread[id=1438, name=qtp5087203-1438 Acceptor0 
[email protected]:43356, state=RUNNABLE, 
group=TGRP-ReplicationFactorTest]
   [junit4]    >         at 
org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:956)
   [junit4]    >         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]    >         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    5) Thread[id=1459, 
name=OverseerHdfsCoreFailoverThread-92328575300861958-127.0.0.1:43356_uu-n_0000000001,
 state=RUNNABLE, group=Overseer Hdfs SolrCore Failover Thread.]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:136)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    6) Thread[id=1453, name=coreZkRegister-964-thread-1, 
state=WAITING, group=TGRP-ReplicationFactorTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at 
java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]    >         at 
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]    >         at 
java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    7) Thread[id=1451, name=Thread-596, state=WAITING, 
group=TGRP-ReplicationFactorTest]
   [junit4]    >         at java.lang.Object.wait(Native Method)
   [junit4]    >         at java.lang.Object.wait(Object.java:503)
   [junit4]    >         at 
org.apache.solr.core.CloserThread.run(CoreContainer.java:905)
   [junit4]    >    8) Thread[id=1436, name=qtp5087203-1436 Selector0, 
state=RUNNABLE, group=TGRP-ReplicationFactorTest]
   [junit4]    >         at 
org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
   [junit4]    >         at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]    >         at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    9) Thread[id=1435, name=HashSessionScavenger-40, 
state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]
   [junit4]    >         at java.lang.Object.wait(Native Method)
   [junit4]    >         at java.util.TimerThread.mainLoop(Timer.java:552)
   [junit4]    >         at java.util.TimerThread.run(Timer.java:505)
   [junit4]    >   10) Thread[id=1446, 
name=TEST-ReplicationFactorTest.testDistribSearch-seed#[D0119A168B52B27A]-SendThread(127.0.0.1:55642),
 state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at 
org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
   [junit4]    >         at 
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([D0119A168B52B27A]:0)
   [junit4] Completed on J0 in 156.53s, 1 test, 1 failure, 3 errors <<< 
FAILURES!

[...truncated 1021 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:485: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:465: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/build.xml:48: The following 
error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/extra-targets.xml:37: The 
following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/build.xml:189: The 
following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/solr/common-build.xml:494: The 
following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:1343: 
The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-4.x-Linux/lucene/common-build.xml:958: 
There were test failures: 419 suites, 1733 tests, 3 suite-level errors, 1 
error, 1110 ignored (16 assumptions)

Total time: 70 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_67 -server 
-XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to