[
https://issues.apache.org/jira/browse/LUCENE-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15561799#comment-15561799
]
Andy Hind commented on LUCENE-7476:
-----------------------------------
I spotted this running org.apache.lucene.analysis.core.TestFactories with
@Repeat (iterations = 100) from eclipse
I just got 9 failures running this again. It is odd that I do not see them in
the build failures.
I believe the 9 fails are all the same
{code}
java.lang.IllegalStateException: incrementToken() called while in wrong state:
INCREMENT_FALSE
at
__randomizedtesting.SeedInfo.seed([18C3960FB72D4F07:2AB7AA6A139D55E3]:0)
at org.apache.lucene.analysis.MockTokenizer.fail(MockTokenizer.java:125)
at
org.apache.lucene.analysis.MockTokenizer.incrementToken(MockTokenizer.java:136)
at
org.apache.lucene.analysis.ja.JapaneseNumberFilter.incrementToken(JapaneseNumberFilter.java:152)
at
org.apache.lucene.analysis.BaseTokenStreamTestCase.checkAnalysisConsistency(BaseTokenStreamTestCase.java:716)
at
org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:627)
at
org.apache.lucene.analysis.BaseTokenStreamTestCase.checkRandomData(BaseTokenStreamTestCase.java:525)
at
org.apache.lucene.analysis.core.TestFactories.doTestTokenFilter(TestFactories.java:108)
at
org.apache.lucene.analysis.core.TestFactories.test(TestFactories.java:61)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
at
org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
at
com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
at
com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
at
org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at
org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at
org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at
org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at
com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at
com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
at java.lang.Thread.run(Thread.java:745)
{code}
The log gives:
{code}
TEST FAIL: useCharFilter=false text='1'
NOTE: reproduce with: ant test -Dtestcase=TestFactories -Dtests.method=test
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=false text='2'
NOTE: reproduce with: ant test -Dtestcase=TestFactories -Dtests.method=test
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=false
text='\ufe0f\ufe06\ufe03\ufe04\ufe0c\ufe0f\ufe08\ufe06\ufe04 7'
NOTE: reproduce with: ant test -Dtestcase=TestFactories -Dtests.method=test
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=true text='\u7e08\uda09\udd65\u0cc2=
\u04cd\u3bc3\uc780lW 39'
NOTE: reproduce with: ant test -Dtestcase=TestFactories -Dtests.method=test
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=true text='ell'emendamento n. 8'
NOTE: reproduce with: ant test -Dtestcase=TestFactories -Dtests.method=test
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=true text='uaoqfm \ue274\ud98f\udce3\ud771\ufd82\ub336
8'
NOTE: reproduce with: ant test -Dtestcase=TestFactories -Dtests.method=test
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=false text='\u06c1L 1'
NOTE: reproduce with: ant test -Dtestcase=TestFactories -Dtests.method=test
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=true text='R\u06b0\u4410\u03a1\u03d4 205'
NOTE: reproduce with: ant test -Dtestcase=TestFactories -Dtests.method=test
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
TEST FAIL: useCharFilter=true text='etaan huomenna klo 1'
NOTE: reproduce with: ant test -Dtestcase=TestFactories -Dtests.method=test
-Dtests.seed=18C3960FB72D4F07 -Dtests.locale=uk
-Dtests.timezone=Atlantic/Jan_Mayen -Dtests.asserts=true
-Dtests.file.encoding=UTF-8
NOTE: leaving temporary files on disk at:
/tmp/lucene.analysis.core.TestFactories_18C3960FB72D4F07-001
NOTE: test params are:
codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST,
chunkSize=17439, maxDocsPerChunk=83, blockSize=212),
termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST,
chunkSize=17439, blockSize=212)), sim=ClassicSimilarity, locale=uk,
timezone=Atlantic/Jan_Mayen
NOTE: Linux 4.4.0-38-generic amd64/Oracle Corporation 1.8.0_91
(64-bit)/cpus=4,threads=1,free=34383216,total=359661568
NOTE: All tests run in this JVM: [TestFactories]
{code}
> Fix transient failure in JapaneseNumberFilter run from TestFactories
> --------------------------------------------------------------------
>
> Key: LUCENE-7476
> URL: https://issues.apache.org/jira/browse/LUCENE-7476
> Project: Lucene - Core
> Issue Type: Bug
> Components: core/other
> Affects Versions: 6.2.1
> Reporter: Andy Hind
> Priority: Trivial
> Attachments: LUCENE-7476.patch
>
>
> Repeatedly running TestFactories show this test to fail ~10% of the time.
> I believe the fix is trivial and related to loosing the state of the
> underlying input stream when testing some analyzer life cycle flows.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
