It was a real bug -- DrilDown.query did not set disableCoord=true on the
result BooleanQuery, and RandomSimProvider caught that !

Committed a fix.

Shai

On Tue, Dec 4, 2012 at 2:05 PM, Shai Erera <ser...@gmail.com> wrote:

> It looks to be caused by the random IndexSearcher that's created. I'm
> still checking if it can alter the scoring, since that test verifies that
> scores between two invocations of IndexSearcher.search() do not change.
>
> Anyway, this looks like a test issue.
>
> Shai
>
> On Tue, Dec 4, 2012 at 1:45 PM, Policeman Jenkins Server <
> jenk...@sd-datasolutions.de> wrote:
>
>> Build:
>> http://jenkins.sd-datasolutions.de/job/Lucene-Solr-trunk-Linux/3055/
>> Java: 64bit/jdk1.7.0_09 -XX:+UseConcMarkSweepGC
>>
>> 1 tests failed.
>> REGRESSION:  org.apache.lucene.facet.search.DrillDownTest.testScoring
>>
>> Error Message:
>> score of doc=4 modified expected:<0.804885745048523> but
>> was:<0.5365905165672302>
>>
>> Stack Trace:
>> java.lang.AssertionError: score of doc=4 modified
>> expected:<0.804885745048523> but was:<0.5365905165672302>
>>         at
>> __randomizedtesting.SeedInfo.seed([3C984CDCB25F27BB:1EBA4BE3B82B45EA]:0)
>>         at org.junit.Assert.fail(Assert.java:93)
>>         at org.junit.Assert.failNotEquals(Assert.java:647)
>>         at org.junit.Assert.assertEquals(Assert.java:443)
>>         at
>> org.apache.lucene.facet.search.DrillDownTest.testScoring(DrillDownTest.java:208)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:601)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>>         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>>         at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>>         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>>         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>>         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>>         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>>         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>>         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>>         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>>         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>>         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>>         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>>         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>>         at java.lang.Thread.run(Thread.java:722)
>>
>>
>>
>>
>> Build Log:
>> [...truncated 6528 lines...]
>> [junit4:junit4] Suite: org.apache.lucene.facet.search.DrillDownTest
>> [junit4:junit4]   2> NOTE: reproduce with: ant test
>>  -Dtestcase=DrillDownTest -Dtests.method=testScoring
>> -Dtests.seed=3C984CDCB25F27BB -Dtests.multiplier=3 -Dtests.slow=true
>> -Dtests.locale=fr_LU -Dtests.timezone=Pacific/Tongatapu
>> -Dtests.file.encoding=US-ASCII
>> [junit4:junit4] FAILURE 0.04s J1 | DrillDownTest.testScoring <<<
>> [junit4:junit4]    > Throwable #1: java.lang.AssertionError: score of
>> doc=4 modified expected:<0.804885745048523> but was:<0.5365905165672302>
>> [junit4:junit4]    >    at
>> __randomizedtesting.SeedInfo.seed([3C984CDCB25F27BB:1EBA4BE3B82B45EA]:0)
>> [junit4:junit4]    >    at org.junit.Assert.fail(Assert.java:93)
>> [junit4:junit4]    >    at org.junit.Assert.failNotEquals(Assert.java:647)
>> [junit4:junit4]    >    at org.junit.Assert.assertEquals(Assert.java:443)
>> [junit4:junit4]    >    at
>> org.apache.lucene.facet.search.DrillDownTest.testScoring(DrillDownTest.java:208)
>> [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> [junit4:junit4]    >    at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> [junit4:junit4]    >    at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> [junit4:junit4]    >    at
>> java.lang.reflect.Method.invoke(Method.java:601)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>> [junit4:junit4]    >    at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>> [junit4:junit4]    >    at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>> [junit4:junit4]    >    at java.lang.Thread.run(Thread.java:722)
>> [junit4:junit4]   2> NOTE: test params are: codec=Lucene40,
>> sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {content=IB
>> SPL-L2, $facets=IB SPL-DZ(0.3)}, locale=fr_LU, timezone=Pacific/Tongatapu
>> [junit4:junit4]   2> NOTE: Linux 3.2.0-34-generic amd64/Oracle
>> Corporation 1.7.0_09 (64-bit)/cpus=8,threads=1,free=38445328,total=126484480
>> [junit4:junit4]   2> NOTE: All tests run in this JVM:
>> [AssociationPropertyTest, ArrayHashMapTest, TestCategoryListCache,
>> TestAssociationExample, IntToIntMapTest, UnsafeByteArrayInputStreamTest,
>> CategoryListParamsTest, OrdinalPolicyTest, EncodingTest, IntHashSetTest,
>> SamplingAccumulatorTest, Vint8Test, OversampleWithDepthTest,
>> CategoryAttributeImplTest, TestScoredDocIdCollector, TestTaxonomyCombined,
>> TestCharBlockArray, TestTopKInEachNodeResultHandler, PathPolicyTest,
>> TestScoredDocIDsUtils, TestTopKResultsHandler, DrillDownTest]
>> [junit4:junit4] Completed on J1 in 0.12s, 6 tests, 1 failure <<< FAILURES!
>>
>> [...truncated 64 lines...]
>> BUILD FAILED
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:335: The
>> following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The
>> following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build.xml:520:
>> The following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1692:
>> The following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/module-build.xml:61:
>> The following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1163:
>> The following error occurred while executing this line:
>> /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:827:
>> There were test failures: 65 suites, 274 tests, 1 failure, 1 ignored (1
>> assumption)
>>
>> Total time: 11 minutes 47 seconds
>> Build step 'Invoke Ant' marked build as failure
>> Archiving artifacts
>> Recording test results
>> Description set: Java: 64bit/jdk1.7.0_09 -XX:+UseConcMarkSweepGC
>> Email was triggered for: Failure
>> Sending email for trigger: Failure
>>
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
>> For additional commands, e-mail: dev-h...@lucene.apache.org
>>
>
>

Reply via email to