Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-6.x/182/

5 tests failed.
FAILED:  org.apache.lucene.search.TestFuzzyQuery.testRandom

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
        at __randomizedtesting.SeedInfo.seed([C9BA1A19CF61CE25]:0)


FAILED:  junit.framework.TestSuite.org.apache.lucene.search.TestFuzzyQuery

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
        at __randomizedtesting.SeedInfo.seed([C9BA1A19CF61CE25]:0)


FAILED:  
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterRestart

Error Message:
Timeout waiting for CDCR replication to complete @source_collection:shard1

Stack Trace:
java.lang.RuntimeException: Timeout waiting for CDCR replication to complete 
@source_collection:shard1
        at 
__randomizedtesting.SeedInfo.seed([D2DA772529CDA0CA:8EC790A4E7ED14FC]:0)
        at 
org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForReplicationToComplete(BaseCdcrDistributedZkTest.java:795)
        at 
org.apache.solr.cloud.CdcrReplicationDistributedZkTest.testReplicationAfterRestart(CdcrReplicationDistributedZkTest.java:235)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.hdfs.StressHdfsTest.test

Error Message:
Could not find collection:delete_data_dir

Stack Trace:
java.lang.AssertionError: Could not find collection:delete_data_dir
        at 
__randomizedtesting.SeedInfo.seed([D2DA772529CDA0CA:5A8E48FF8731CD32]:0)
        at org.junit.Assert.fail(Assert.java:93)
        at org.junit.Assert.assertTrue(Assert.java:43)
        at org.junit.Assert.assertNotNull(Assert.java:526)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:153)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:138)
        at 
org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:133)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:856)
        at 
org.apache.solr.cloud.hdfs.StressHdfsTest.test(StressHdfsTest.java:112)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:992)
        at 
org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:967)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
        at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
        at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
        at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
        at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
        at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
        at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
        at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
        at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=15038, name=collection2, 
state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught 
exception in thread: Thread[id=15038, name=collection2, state=RUNNABLE, 
group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: java.lang.RuntimeException: 
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting 
response from server at: http://127.0.0.1:41861/_/a
        at __randomizedtesting.SeedInfo.seed([D2DA772529CDA0CA]:0)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:997)
Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured 
while waiting response from server at: http://127.0.0.1:41861/_/a
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:604)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:262)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:251)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:435)
        at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:387)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1292)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:1062)
        at 
org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:1004)
        at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1599)
        at 
org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1620)
        at 
org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:987)
Caused by: java.net.SocketTimeoutException: Read timed out
        at java.net.SocketInputStream.socketRead0(Native Method)
        at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
        at java.net.SocketInputStream.read(SocketInputStream.java:170)
        at java.net.SocketInputStream.read(SocketInputStream.java:141)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
        at 
org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
        at 
org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
        at 
org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
        at 
org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
        at 
org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
        at 
org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
        at 
org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
        at 
org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
        at 
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
        at 
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
        at 
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
        at 
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
        at 
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
        at 
org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:498)
        ... 11 more




Build Log:
[...truncated 1785 lines...]
   [junit4] Suite: org.apache.lucene.search.TestFuzzyQuery
   [junit4]   2> oct 22, 2016 1:36:04 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl$2 evaluate
   [junit4]   2> WARNING: Suite execution timed out: 
org.apache.lucene.search.TestFuzzyQuery
   [junit4]   2>    1) Thread[id=5526, 
name=TEST-TestFuzzyQuery.testRandom-seed#[C9BA1A19CF61CE25], state=RUNNABLE, 
group=TGRP-TestFuzzyQuery]
   [junit4]   2>         at java.lang.System.identityHashCode(Native Method)
   [junit4]   2>         at 
java.util.IdentityHashMap.hash(IdentityHashMap.java:294)
   [junit4]   2>         at 
java.util.IdentityHashMap.get(IdentityHashMap.java:328)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:239)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
   [junit4]   2>         at 
org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:729)
   [junit4]   2>         at 
org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
   [junit4]   2>         at 
org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
   [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>         at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>         at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>         at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2>    2) Thread[id=9, name=JUnit4-serializer-daemon, 
state=TIMED_WAITING, group=main]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at 
com.carrotsearch.ant.tasks.junit4.events.Serializer$1.run(Serializer.java:50)
   [junit4]   2>    3) Thread[id=5525, 
name=SUITE-TestFuzzyQuery-seed#[C9BA1A19CF61CE25], state=RUNNABLE, 
group=TGRP-TestFuzzyQuery]
   [junit4]   2>         at java.lang.Thread.getStackTrace(Thread.java:1556)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:690)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$4.run(ThreadLeakControl.java:687)
   [junit4]   2>         at java.security.AccessController.doPrivileged(Native 
Method)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.getStackTrace(ThreadLeakControl.java:687)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.getThreadsWithTraces(ThreadLeakControl.java:703)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.formatThreadStacksFull(ThreadLeakControl.java:683)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.access$1000(ThreadLeakControl.java:64)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$2.evaluate(ThreadLeakControl.java:415)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:678)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.access$200(RandomizedRunner.java:140)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$2.run(RandomizedRunner.java:598)
   [junit4]   2>    4) Thread[id=1, name=main, state=WAITING, group=main]
   [junit4]   2>         at java.lang.Object.wait(Native Method)
   [junit4]   2>         at java.lang.Thread.join(Thread.java:1249)
   [junit4]   2>         at java.lang.Thread.join(Thread.java:1323)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSuite(RandomizedRunner.java:608)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.run(RandomizedRunner.java:457)
   [junit4]   2>         at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.execute(SlaveMain.java:243)
   [junit4]   2>         at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMain.main(SlaveMain.java:354)
   [junit4]   2>         at 
com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe.main(SlaveMainSafe.java:10)
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFuzzyQuery 
-Dtests.method=testRandom -Dtests.seed=C9BA1A19CF61CE25 -Dtests.multiplier=2 
-Dtests.nightly=true -Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt
 -Dtests.locale=es-PR -Dtests.timezone=Europe/Brussels -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] ERROR   7200s J2 | TestFuzzyQuery.testRandom <<<
   [junit4]    > Throwable #1: java.lang.Exception: Test abandoned because 
suite timeout was reached.
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([C9BA1A19CF61CE25]:0)
   [junit4]   2> oct 22, 2016 1:36:04 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked 
thread(s).
   [junit4]   2> oct 22, 2016 1:36:24 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at 
org.apache.lucene.search.TestFuzzyQuery: 
   [junit4]   2>    1) Thread[id=5526, 
name=TEST-TestFuzzyQuery.testRandom-seed#[C9BA1A19CF61CE25], state=RUNNABLE, 
group=TGRP-TestFuzzyQuery]
   [junit4]   2>         at java.util.WeakHashMap.getTable(WeakHashMap.java:350)
   [junit4]   2>         at java.util.WeakHashMap.getEntry(WeakHashMap.java:427)
   [junit4]   2>         at 
java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
   [junit4]   2>         at 
org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:729)
   [junit4]   2>         at 
org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
   [junit4]   2>         at 
org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
   [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>         at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>         at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>         at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> oct 22, 2016 1:36:24 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=5526, 
name=TEST-TestFuzzyQuery.testRandom-seed#[C9BA1A19CF61CE25], state=RUNNABLE, 
group=TGRP-TestFuzzyQuery]
   [junit4]   2> oct 22, 2016 1:36:27 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be 
terminated:
   [junit4]   2>    1) Thread[id=5526, 
name=TEST-TestFuzzyQuery.testRandom-seed#[C9BA1A19CF61CE25], state=RUNNABLE, 
group=TGRP-TestFuzzyQuery]
   [junit4]   2>         at java.lang.Object.hashCode(Native Method)
   [junit4]   2>         at java.util.WeakHashMap.hash(WeakHashMap.java:298)
   [junit4]   2>         at java.util.WeakHashMap.getEntry(WeakHashMap.java:426)
   [junit4]   2>         at 
java.util.WeakHashMap.containsKey(WeakHashMap.java:417)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedContext.context(RandomizedContext.java:258)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedContext.current(RandomizedContext.java:134)
   [junit4]   2>         at 
org.apache.lucene.util.LuceneTestCase.random(LuceneTestCase.java:729)
   [junit4]   2>         at 
org.apache.lucene.search.TestFuzzyQuery.randomSimpleString(TestFuzzyQuery.java:506)
   [junit4]   2>         at 
org.apache.lucene.search.TestFuzzyQuery.testRandom(TestFuzzyQuery.java:517)
   [junit4]   2>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]   2>         at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2>         at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2>         at java.lang.reflect.Method.invoke(Method.java:498)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:811)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:462)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
   [junit4]   2>         at 
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
   [junit4]   2>         at 
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2>         at 
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene62): 
{field=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))},
 docValues:{}, maxPointsInLeafNode=498, maxMBSortInHeap=7.645477083263929, 
sim=ClassicSimilarity, locale=es-PR, timezone=Europe/Brussels
   [junit4]   2> NOTE: Linux 3.13.0-85-generic amd64/Oracle Corporation 
1.8.0_102 (64-bit)/cpus=4,threads=2,free=253467920,total=353370112
   [junit4]   2> NOTE: All tests run in this JVM: [TestCharTermAttributeImpl, 
TestSparseFixedBitDocIdSet, TestSpanExplanations, TestLongPostings, 
TestNeedsScores, TestSpanNearQuery, TestSetOnce, TestOperations, 
TestDisjunctionMaxQuery, TestLucene50StoredFieldsFormatHighCompression, 
TestBM25Similarity, TestAllFilesCheckIndexHeader, TestSort, 
FiniteStringsIteratorTest, TestMergePolicyWrapper, TestOfflineSorter, 
TestNamedSPILoader, TestSpanTermQuery, TestIndexWriterDeleteByQuery, 
TestTimeLimitingCollector, TestSameScoresWithThreads, 
TestMergeSchedulerExternal, TestForceMergeForever, 
TestReaderWrapperDVTypeCheck, Test2BPostingsBytes, TestVirtualMethod, 
TestDocInverterPerFieldErrorInfo, TestCharsRef, TestIndexWriterMaxDocs, 
TestExceedMaxTermLength, TestMultiCollector, TestLucene62SegmentInfoFormat, 
TestSynonymQuery, TestNRTThreads, TestIndexWriterThreadsToSegments, 
Test2BPoints, TestTermVectorsWriter, TestIndexCommit, TestSimpleFSLockFactory, 
TestIntroSelector, TestNativeFSLockFactory, TestGeoUtils, Test2BPostings, 
TestPositionIncrement, TestSpanSearchEquivalence, 
TestRecyclingIntBlockAllocator, TestNRTCachingDirectory, TestByteBlockPool, 
TestRollingUpdates, TestMultiLevelSkipList, TestTopDocsCollector, 
TestOrdinalMap, TestReqExclBulkScorer, TestCachingTokenFilter, 
TestLazyProxSkipping, TestSortedNumericSortField, 
TestSpanExplanationsOfNonMatches, TestTieredMergePolicy, TestNoMergePolicy, 
TestWildcard, TestStressNRT, TestMultiValuedNumericRangeQuery, 
TestPayloadsOnVectors, TestIndexWriterMerging, TestToken, TestIOUtils, 
TestNorms, TestDocumentWriter, TestSentinelIntSet, TestLRUQueryCache, TestBKD, 
TestIndexWriterReader, TestDeletionPolicy, TestBooleanOr, TestBasics, 
TestSloppyPhraseQuery, TestIndexWriterMergePolicy, 
TestPersistentSnapshotDeletionPolicy, TestAtomicUpdate, TestStressAdvance, 
TestStandardAnalyzer, TestIndexWriterCommit, TestSearchWithThreads, 
TestSearchAfter, TestConcurrentMergeScheduler, TestHighCompressionMode, 
TestDocumentsWriterStallControl, TestCustomSearcherSort, TestTermsEnum2, 
TestSpans, TestPostingsOffsets, TestMixedCodecs, TestDeterminism, 
TestDocsAndPositions, TestBagOfPostings, TestIndexInput, TestOmitTf, 
TestMultiFields, TestMultiTermConstantScore, TestFuzzyQuery]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 
'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestFuzzyQuery 
-Dtests.seed=C9BA1A19CF61CE25 -Dtests.multiplier=2 -Dtests.nightly=true 
-Dtests.slow=true 
-Dtests.linedocsfile=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/test-data/enwiki.random.lines.txt
 -Dtests.locale=es-PR -Dtests.timezone=Europe/Brussels -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J2 | TestFuzzyQuery (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 
7200000 msec).
   [junit4]    >        at 
__randomizedtesting.SeedInfo.seed([C9BA1A19CF61CE25]:0)
   [junit4] Completed [439/439 (1!)] on J2 in 7223.19s, 9 tests, 2 errors <<< 
FAILURES!

[...truncated 9468 lines...]
   [junit4] Suite: org.apache.solr.cloud.hdfs.StressHdfsTest
   [junit4]   2> Creating dataDir: 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/init-core-data-001
   [junit4]   2> 77303 INFO  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] 
o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: 
@org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 77303 INFO  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] 
o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 77938 WARN  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] 
o.a.h.u.NativeCodeLoader Unable to load native-hadoop library for your 
platform... using builtin-java classes where applicable
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 78610 WARN  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] 
o.a.h.m.i.MetricsConfig Cannot locate configuration: tried 
hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 78773 INFO  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] o.m.log Logging to 
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
   [junit4]   2> 78791 WARN  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 78847 INFO  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] o.m.log 
jetty-6.1.26
   [junit4]   2> 78887 INFO  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/hdfs
 to ./temp/Jetty_localhost_35621_hdfs____.ck4q9v/webapp
   [junit4]   2> 79784 INFO  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35621
   [junit4]   2> 81037 WARN  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 81045 INFO  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] o.m.log 
jetty-6.1.26
   [junit4]   2> 81061 INFO  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_35651_datanode____.jjxfu1/webapp
   [junit4]   2> 81517 INFO  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35651
   [junit4]   2> 82211 WARN  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] 
o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 82212 INFO  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] o.m.log 
jetty-6.1.26
   [junit4]   2> 82237 INFO  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] o.m.log Extract 
jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.7.2-tests.jar!/webapps/datanode
 to ./temp/Jetty_localhost_58292_datanode____3wyxwv/webapp
   [junit4]   2> 83102 INFO  
(SUITE-StressHdfsTest-seed#[D2DA772529CDA0CA]-worker) [    ] o.m.log Started 
HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:58292
   [junit4]   2> 84270 INFO  (IPC Server handler 6 on 48602) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-deb7c69a-f4e0-445d-b900-1989d3b06c5d node 
DatanodeRegistration(127.0.0.1:51251, 
datanodeUuid=044e2ad9-77cd-4f9b-b617-2c44ddd36195, infoPort=50966, 
infoSecurePort=0, ipcPort=47888, 
storageInfo=lv=-56;cid=testClusterID;nsid=850042227;c=0), blocks: 0, 
hasStaleStorage: true, processing time: 3 msecs
   [junit4]   2> 84270 INFO  (IPC Server handler 6 on 48602) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-da34d1a6-5483-4412-b482-e8e07fcb2a74 node 
DatanodeRegistration(127.0.0.1:51251, 
datanodeUuid=044e2ad9-77cd-4f9b-b617-2c44ddd36195, infoPort=50966, 
infoSecurePort=0, ipcPort=47888, 
storageInfo=lv=-56;cid=testClusterID;nsid=850042227;c=0), blocks: 0, 
hasStaleStorage: false, processing time: 1 msecs
   [junit4]   2> 84271 INFO  (IPC Server handler 7 on 48602) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-b03408a3-f225-42a4-869a-5da64299fc1b node 
DatanodeRegistration(127.0.0.1:57053, 
datanodeUuid=2127a5bf-7c8a-4e42-9039-46928478e735, infoPort=57491, 
infoSecurePort=0, ipcPort=49698, 
storageInfo=lv=-56;cid=testClusterID;nsid=850042227;c=0), blocks: 0, 
hasStaleStorage: true, processing time: 0 msecs
   [junit4]   2> 84271 INFO  (IPC Server handler 7 on 48602) [    ] 
BlockStateChange BLOCK* processReport: from storage 
DS-49ab18b3-3912-4392-93eb-b8c1a65e5059 node 
DatanodeRegistration(127.0.0.1:57053, 
datanodeUuid=2127a5bf-7c8a-4e42-9039-46928478e735, infoPort=57491, 
infoSecurePort=0, ipcPort=49698, 
storageInfo=lv=-56;cid=testClusterID;nsid=850042227;c=0), blocks: 0, 
hasStaleStorage: false, processing time: 0 msecs
   [junit4]   2> 84572 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 84587 INFO  (Thread-214) [    ] o.a.s.c.ZkTestServer client 
port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 84587 INFO  (Thread-214) [    ] o.a.s.c.ZkTestServer Starting 
server
   [junit4]   2> 84687 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.ZkTestServer start zk server on port:38882
   [junit4]   2> 84731 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
 to /configs/conf1/solrconfig.xml
   [junit4]   2> 84733 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/schema.xml
 to /configs/conf1/schema.xml
   [junit4]   2> 84736 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
 to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 84737 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
 to /configs/conf1/stopwords.txt
   [junit4]   2> 84739 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/protwords.txt
 to /configs/conf1/protwords.txt
   [junit4]   2> 84741 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/currency.xml
 to /configs/conf1/currency.xml
   [junit4]   2> 84744 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
 to /configs/conf1/enumsConfig.xml
   [junit4]   2> 84745 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
 to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 84746 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
 to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 84747 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
 to /configs/conf1/old_synonyms.txt
   [junit4]   2> 84748 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractZkTestCase put 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
 to /configs/conf1/synonyms.txt
   [junit4]   2> 84836 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/control-001/cores/collection1
   [junit4]   2> 84838 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 84848 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@129c3964{/,null,AVAILABLE}
   [junit4]   2> 84855 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.e.j.s.ServerConnector Started 
ServerConnector@17b48b{HTTP/1.1,[http/1.1]}{127.0.0.1:37879}
   [junit4]   2> 84855 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.e.j.s.Server Started @87385ms
   [junit4]   2> 84855 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:48602/hdfs__localhost_48602__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001_tempDir-002_control_data,
 hostContext=/, hostPort=37879, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/control-001/cores}
   [junit4]   2> 84855 ERROR (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging 
may be missing or incomplete.
   [junit4]   2> 84855 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? 
version 6.3.0
   [junit4]   2> 84856 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on 
port null
   [junit4]   2> 84856 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 84856 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2016-10-22T13:30:53.799Z
   [junit4]   2> 84865 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 84865 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/control-001/solr.xml
   [junit4]   2> 84880 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 84880 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38882/solr
   [junit4]   2> 84912 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[n:127.0.0.1:37879_    ] o.a.s.c.OverseerElectionContext I am going to be the 
leader 127.0.0.1:37879_
   [junit4]   2> 84913 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[n:127.0.0.1:37879_    ] o.a.s.c.Overseer Overseer 
(id=96806047156273156-127.0.0.1:37879_-n_0000000000) starting
   [junit4]   2> 84921 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[n:127.0.0.1:37879_    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:37879_
   [junit4]   2> 84923 INFO  
(zkCallback-108-thread-1-processing-n:127.0.0.1:37879_) [n:127.0.0.1:37879_    
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 84934 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[n:127.0.0.1:37879_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions 
underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/control-001/cores
   [junit4]   2> 84934 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[n:127.0.0.1:37879_    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 84963 INFO  
(OverseerStateUpdate-96806047156273156-127.0.0.1:37879_-n_0000000000) 
[n:127.0.0.1:37879_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard 
shard=shard1
   [junit4]   2> 85988 WARN  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection   x:collection1] o.a.s.c.Config 
Beginning with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> 
instead.
   [junit4]   2> 85988 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection   x:collection1] o.a.s.c.SolrConfig 
Using Lucene MatchVersion: 6.3.0
   [junit4]   2> 86003 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
[collection1] Schema name=test
   [junit4]   2> 86087 WARN  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
[collection1] default search field in schema is text. WARNING: Deprecated, 
please use 'df' on request instead.
   [junit4]   2> 86092 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection   x:collection1] o.a.s.s.IndexSchema 
Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 86104 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection   x:collection1] o.a.s.c.CoreContainer 
Creating SolrCore 'collection1' using configuration from collection 
control_collection
   [junit4]   2> 86109 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost:48602/solr_hdfs_home
   [junit4]   2> 86109 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 86110 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/control-001/cores/collection1],
 
dataDir=[hdfs://localhost:48602/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 86110 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b015906
   [junit4]   2> 86110 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:48602/solr_hdfs_home/control_collection/core_node1/data/snapshot_metadata
   [junit4]   2> 86128 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 86128 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 86129 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 87338 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 87343 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:48602/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 87393 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:48602/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 87409 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 87409 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 87409 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 87423 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 87423 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=50, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=21.2705078125, 
floorSegmentMB=1.9169921875, forceMergeDeletesPctAllowed=3.8468100692602833, 
segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 87633 INFO  (IPC Server handler 6 on 48602) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57053 is 
added to blk_1073741825_1001{UCState=COMMITTED, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-b03408a3-f225-42a4-869a-5da64299fc1b:NORMAL:127.0.0.1:57053|RBW],
 
ReplicaUC[[DISK]DS-da34d1a6-5483-4412-b482-e8e07fcb2a74:NORMAL:127.0.0.1:51251|RBW]]}
 size 71
   [junit4]   2> 87634 INFO  (IPC Server handler 9 on 48602) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51251 is 
added to blk_1073741825_1001 size 71
   [junit4]   2> 88063 WARN  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 88076 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 88076 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 88076 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
   [junit4]   2> 88088 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 88088 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 88090 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=37, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=73.0458984375, 
floorSegmentMB=1.1533203125, forceMergeDeletesPctAllowed=22.549457164613965, 
segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.2531707549830936
   [junit4]   2> 88165 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@684a457f[collection1] main]
   [junit4]   2> 88166 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 88166 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 88168 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 88170 INFO  
(searcherExecutor-207-thread-1-processing-n:127.0.0.1:37879_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37879_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore 
[collection1] Registered new searcher Searcher@684a457f[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 88170 INFO  
(coreLoadExecutor-206-thread-1-processing-n:127.0.0.1:37879_) 
[n:127.0.0.1:37879_ c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1548896758255321088
   [junit4]   2> 88177 INFO  
(coreZkRegister-199-thread-1-processing-n:127.0.0.1:37879_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37879_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 88177 INFO  
(coreZkRegister-199-thread-1-processing-n:127.0.0.1:37879_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37879_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 88178 INFO  
(coreZkRegister-199-thread-1-processing-n:127.0.0.1:37879_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37879_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync replicas to http://127.0.0.1:37879/collection1/
   [junit4]   2> 88178 INFO  
(coreZkRegister-199-thread-1-processing-n:127.0.0.1:37879_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37879_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
Sync Success - now sync replicas to me
   [junit4]   2> 88178 INFO  
(coreZkRegister-199-thread-1-processing-n:127.0.0.1:37879_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37879_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
http://127.0.0.1:37879/collection1/ has no replicas
   [junit4]   2> 88182 INFO  
(coreZkRegister-199-thread-1-processing-n:127.0.0.1:37879_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37879_ 
c:control_collection s:shard1 r:core_node1 x:collection1] 
o.a.s.c.ShardLeaderElectionContext I am the new leader: 
http://127.0.0.1:37879/collection1/ shard1
   [junit4]   2> 88333 INFO  
(coreZkRegister-199-thread-1-processing-n:127.0.0.1:37879_ x:collection1 
s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:37879_ 
c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController 
I am the leader, no recovery necessary
   [junit4]   2> 88472 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 88473 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause 
connection loss:false
   [junit4]   2> 88473 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with 
stateFormat=2
   [junit4]   2> 88546 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/shard-1-001/cores/collection1
   [junit4]   2> 88547 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/shard-1-001
   [junit4]   2> 88548 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 88549 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@1f303c18{/,null,AVAILABLE}
   [junit4]   2> 88550 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.e.j.s.ServerConnector Started 
ServerConnector@3941de25{HTTP/1.1,[http/1.1]}{127.0.0.1:52002}
   [junit4]   2> 88550 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.e.j.s.Server Started @91079ms
   [junit4]   2> 88550 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:48602/hdfs__localhost_48602__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001_tempDir-002_jetty1,
 solrconfig=solrconfig.xml, hostContext=/, hostPort=52002, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/shard-1-001/cores}
   [junit4]   2> 88550 ERROR (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging 
may be missing or incomplete.
   [junit4]   2> 88551 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? 
version 6.3.0
   [junit4]   2> 88551 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on 
port null
   [junit4]   2> 88551 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 88551 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2016-10-22T13:30:57.494Z
   [junit4]   2> 88554 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 88554 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/shard-1-001/solr.xml
   [junit4]   2> 88560 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 88560 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38882/solr
   [junit4]   2> 88568 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[n:127.0.0.1:52002_    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (1)
   [junit4]   2> 88571 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[n:127.0.0.1:52002_    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:52002_
   [junit4]   2> 88572 INFO  
(zkCallback-108-thread-3-processing-n:127.0.0.1:37879_) [n:127.0.0.1:37879_    
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 88573 INFO  (zkCallback-112-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 88574 INFO  
(zkCallback-118-thread-1-processing-n:127.0.0.1:52002_) [n:127.0.0.1:52002_    
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 88588 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[n:127.0.0.1:52002_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions 
underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/../../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/shard-1-001/cores
   [junit4]   2> 88588 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[n:127.0.0.1:52002_    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 88590 INFO  
(OverseerStateUpdate-96806047156273156-127.0.0.1:37879_-n_0000000000) 
[n:127.0.0.1:37879_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard 
shard=shard1
   [junit4]   2> 88697 WARN  
(OverseerStateUpdate-96806047156273156-127.0.0.1:37879_-n_0000000000) 
[n:127.0.0.1:37879_    ] o.a.s.c.Overseer Bad version writing to ZK using 
compare-and-set, will force refresh cluster state: KeeperErrorCode = BadVersion 
for /collections/collection1/state.json
   [junit4]   2> 88701 INFO  
(zkCallback-118-thread-1-processing-n:127.0.0.1:52002_) [n:127.0.0.1:52002_    
] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [2])
   [junit4]   2> 88702 INFO  
(OverseerStateUpdate-96806047156273156-127.0.0.1:37879_-n_0000000000) 
[n:127.0.0.1:37879_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard 
shard=shard1
   [junit4]   2> 88703 INFO  
(zkCallback-118-thread-1-processing-n:127.0.0.1:52002_) [n:127.0.0.1:52002_    
] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [2])
   [junit4]   2> 89617 WARN  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1   x:collection1] o.a.s.c.Config Beginning 
with Solr 5.5, <mergePolicy> is deprecated, use <mergePolicyFactory> instead.
   [junit4]   2> 89618 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1   x:collection1] o.a.s.c.SolrConfig Using 
Lucene MatchVersion: 6.3.0
   [junit4]   2> 89630 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1   x:collection1] o.a.s.s.IndexSchema 
[collection1] Schema name=test
   [junit4]   2> 89712 WARN  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1   x:collection1] o.a.s.s.IndexSchema 
[collection1] default search field in schema is text. WARNING: Deprecated, 
please use 'df' on request instead.
   [junit4]   2> 89714 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1   x:collection1] o.a.s.s.IndexSchema Loaded 
schema test/1.0 with uniqueid field id
   [junit4]   2> 89724 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1   x:collection1] o.a.s.c.CoreContainer 
Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 89725 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory 
solr.hdfs.home=hdfs://localhost:48602/solr_hdfs_home
   [junit4]   2> 89725 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 89725 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at 
[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/shard-1-001/cores/collection1],
 dataDir=[hdfs://localhost:48602/solr_hdfs_home/collection1/core_node1/data/]
   [junit4]   2> 89725 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX 
Server: com.sun.jmx.mbeanserver.JmxMBeanServer@b015906
   [junit4]   2> 89725 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:48602/solr_hdfs_home/collection1/core_node1/data/snapshot_metadata
   [junit4]   2> 89734 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 89734 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 89734 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 89742 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 89743 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:48602/solr_hdfs_home/collection1/core_node1/data
   [junit4]   2> 89783 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory creating directory factory for path 
hdfs://localhost:48602/solr_hdfs_home/collection1/core_node1/data/index
   [junit4]   2> 89791 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct 
memory allocation set to [true]
   [junit4]   2> 89791 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of 
[8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 89791 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 89800 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 89800 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=50, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=21.2705078125, 
floorSegmentMB=1.9169921875, forceMergeDeletesPctAllowed=3.8468100692602833, 
segmentsPerTier=24.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 89846 INFO  (IPC Server handler 0 on 48602) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:57053 is 
added to blk_1073741826_1002{UCState=UNDER_CONSTRUCTION, truncateBlock=null, 
primaryNodeIndex=-1, 
replicas=[ReplicaUC[[DISK]DS-da34d1a6-5483-4412-b482-e8e07fcb2a74:NORMAL:127.0.0.1:51251|RBW],
 
ReplicaUC[[DISK]DS-49ab18b3-3912-4392-93eb-b8c1a65e5059:NORMAL:127.0.0.1:57053|FINALIZED]]}
 size 0
   [junit4]   2> 89850 INFO  (IPC Server handler 1 on 48602) [    ] 
BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51251 is 
added to blk_1073741826_1002 size 71
   [junit4]   2> 89875 WARN  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = 
requestHandler,name = /dump,class = DumpRequestHandler,args = 
{defaults={a=A,b=B}}}
   [junit4]   2> 89942 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateHandler Using UpdateLog implementation: 
org.apache.solr.update.HdfsUpdateLog
   [junit4]   2> 89942 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH 
numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 89942 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.u.HdfsUpdateLog Initializing HdfsUpdateLog: tlogDfsReplication=2
   [junit4]   2> 89955 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 89955 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 89961 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class 
org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: 
maxMergeAtOnce=37, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=73.0458984375, 
floorSegmentMB=1.1533203125, forceMergeDeletesPctAllowed=22.549457164613965, 
segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, 
noCFSRatio=0.2531707549830936
   [junit4]   2> 89987 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.s.SolrIndexSearcher Opening [Searcher@237d98b8[collection1] main]
   [junit4]   2> 89991 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: 
/configs/conf1
   [junit4]   2> 89991 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using 
ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 89992 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 89994 INFO  
(searcherExecutor-218-thread-1-processing-n:127.0.0.1:52002_ x:collection1 
s:shard1 c:collection1 r:core_node1) [n:127.0.0.1:52002_ c:collection1 s:shard1 
r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new 
searcher Searcher@237d98b8[collection1] 
main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 89994 INFO  
(coreLoadExecutor-217-thread-1-processing-n:127.0.0.1:52002_) 
[n:127.0.0.1:52002_ c:collection1 s:shard1 r:core_node1 x:collection1] 
o.a.s.u.UpdateLog Could not find max version in index or recent updates, using 
new clock 1548896760167923712
   [junit4]   2> 90007 INFO  
(coreZkRegister-212-thread-1-processing-n:127.0.0.1:52002_ x:collection1 
s:shard1 c:collection1 r:core_node1) [n:127.0.0.1:52002_ c:collection1 s:shard1 
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas 
found to continue.
   [junit4]   2> 90007 INFO  
(coreZkRegister-212-thread-1-processing-n:127.0.0.1:52002_ x:collection1 
s:shard1 c:collection1 r:core_node1) [n:127.0.0.1:52002_ c:collection1 s:shard1 
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new 
leader - try and sync
   [junit4]   2> 90007 INFO  
(coreZkRegister-212-thread-1-processing-n:127.0.0.1:52002_ x:collection1 
s:shard1 c:collection1 r:core_node1) [n:127.0.0.1:52002_ c:collection1 s:shard1 
r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to 
http://127.0.0.1:52002/collection1/
   [junit4]   2> 90007 INFO  
(coreZkRegister-212-thread-1-processing-n:127.0.0.1:52002_ x:collection1 
s:shard1 c:collection1 r:core_node1) [n:127.0.0.1:52002_ c:collection1 s:shard1 
r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync 
replicas to me
   [junit4]   2> 90007 INFO  
(coreZkRegister-212-thread-1-processing-n:127.0.0.1:52002_ x:collection1 
s:shard1 c:collection1 r:core_node1) [n:127.0.0.1:52002_ c:collection1 s:shard1 
r:core_node1 x:collection1] o.a.s.c.SyncStrategy 
http://127.0.0.1:52002/collection1/ has no replicas
   [junit4]   2> 90011 INFO  
(coreZkRegister-212-thread-1-processing-n:127.0.0.1:52002_ x:collection1 
s:shard1 c:collection1 r:core_node1) [n:127.0.0.1:52002_ c:collection1 s:shard1 
r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new 
leader: http://127.0.0.1:52002/collection1/ shard1
   [junit4]   2> 90112 INFO  
(zkCallback-118-thread-1-processing-n:127.0.0.1:52002_) [n:127.0.0.1:52002_    
] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [2])
   [junit4]   2> 90162 INFO  
(coreZkRegister-212-thread-1-processing-n:127.0.0.1:52002_ x:collection1 
s:shard1 c:collection1 r:core_node1) [n:127.0.0.1:52002_ c:collection1 s:shard1 
r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery 
necessary
   [junit4]   2> 90170 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/shard-2-001/cores/collection1
   [junit4]   2> 90170 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/shard-2-001
   [junit4]   2> 90171 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.e.j.s.Server jetty-9.3.8.v20160314
   [junit4]   2> 90172 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.e.j.s.h.ContextHandler Started 
o.e.j.s.ServletContextHandler@119d3f5a{/,null,AVAILABLE}
   [junit4]   2> 90173 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.e.j.s.ServerConnector Started 
ServerConnector@36391eeb{HTTP/1.1,[http/1.1]}{127.0.0.1:60060}
   [junit4]   2> 90173 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.e.j.s.Server Started @92703ms
   [junit4]   2> 90173 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: 
{solr.data.dir=hdfs://localhost:48602/hdfs__localhost_48602__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-6.x_checkout_solr_build_solr-core_test_J1_temp_solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001_tempDir-002_jetty2,
 solrconfig=solrconfig.xml, hostContext=/, hostPort=60060, 
coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/shard-2-001/cores}
   [junit4]   2> 90173 ERROR (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging 
may be missing or incomplete.
   [junit4]   2> 90173 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? 
version 6.3.0
   [junit4]   2> 90173 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on 
port null
   [junit4]   2> 90173 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 90173 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 
2016-10-22T13:30:59.116Z
   [junit4]   2> 90184 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in 
ZooKeeper)
   [junit4]   2> 90184 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.SolrXmlConfig Loading container configuration from 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/shard-2-001/solr.xml
   [junit4]   2> 90189 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with 
params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 90190 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38882/solr
   [junit4]   2> 90198 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[n:127.0.0.1:60060_    ] o.a.s.c.c.ZkStateReader Updated live nodes from 
ZooKeeper... (0) -> (2)
   [junit4]   2> 90206 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[n:127.0.0.1:60060_    ] o.a.s.c.ZkController Register node as live in 
ZooKeeper:/live_nodes/127.0.0.1:60060_
   [junit4]   2> 90207 INFO  (zkCallback-112-thread-1) [    ] 
o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 90211 INFO  
(zkCallback-118-thread-1-processing-n:127.0.0.1:52002_) [n:127.0.0.1:52002_    
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 90211 INFO  
(zkCallback-108-thread-2-processing-n:127.0.0.1:37879_) [n:127.0.0.1:37879_    
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 90212 INFO  
(zkCallback-124-thread-1-processing-n:127.0.0.1:60060_) [n:127.0.0.1:60060_    
] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 90215 INFO  
(zkCallback-118-thread-1-processing-n:127.0.0.1:52002_) [n:127.0.0.1:52002_    
] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent 
state:SyncConnected type:NodeDataChanged 
path:/collections/collection1/state.json] for collection [collection1] has 
occurred - updating... (live nodes size: [3])
   [junit4]   2> 90221 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[n:127.0.0.1:60060_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions 
underneath 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/J1/temp/solr.cloud.hdfs.StressHdfsTest_D2DA772529CDA0CA-001/shard-2-001/cores
   [junit4]   2> 90221 INFO  (TEST-StressHdfsTest.test-seed#[D2DA772529CDA0CA]) 
[n:127.0.0.1:60060_    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 90224 INFO  
(OverseerStateUpdate-96806047156273156-127.0.0.1:37879_-n_0000000000) 
[n:127.0.0.1:37879_    ] o.a.s.c.o.ReplicaMutator Assigning new node 

[...truncated too long message...]

cheds-interceptors-authz-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/hadoop-common-2.7.2-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/hadoop-hdfs-2.7.2-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/hadoop-minikdc-2.7.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/htrace-core-3.2.0-incubating.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/mockito-core-1.9.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/netty-all-4.0.36.Final.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/presto-parser-0.122.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/core/test-lib/slice-0.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/analysis/icu/lucene-analyzers-icu-6.3.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/build/queryparser/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/contrib/analysis-extras/lib/icu4j-56.1.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_102/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.4.0.jar
 com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile 
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/temp/junit4-J0-20161022_132926_361.events
 
@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build/solr-core/test/temp/junit4-J0-20161022_132926_361.suites
 -stdin
   [junit4] ERROR: JVM J0 ended with an exception: Quit event not received from 
the forked process? This may indicate JVM crash or runner bugs.
   [junit4]     at 
com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1501)
   [junit4]     at 
com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:121)
   [junit4]     at 
com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:955)
   [junit4]     at 
com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:952)
   [junit4]     at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]     at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]     at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]     at java.lang.Thread.run(Thread.java:745)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:773:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:709:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/build.xml:59:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/build.xml:252:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/solr/common-build.xml:536:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/common-build.xml:1443:
 The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-6.x/checkout/lucene/common-build.xml:984:
 At least one slave process threw an exception, first: Quit event not received 
from the forked process? This may indicate JVM crash or runner bugs.

Total time: 351 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to