[ https://issues.apache.org/jira/browse/LUCENE-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860173#comment-16860173 ]
Hoss Man commented on LUCENE-8757: ---------------------------------- another similar failure... http://fucit.org/solr-jenkins-reports/job-data/thetaphi/Lucene-Solr-8.x-Linux/677/ https://jenkins.thetaphi.de/view/Lucene-Solr/job/Lucene-Solr-8.x-Linux/677/ {noformat} [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestRegexpRandom2 -Dtests.method=testRegexps -Dtests.seed=A993DB1E59F6C2DC -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=rn -D tests.timezone=Africa/El_Aaiun -Dtests.asserts=true -Dtests.file.encoding=US-ASCII [junit4] FAILURE 0.06s J2 | TestRegexpRandom2.testRegexps <<< [junit4] > Throwable #1: junit.framework.AssertionFailedError: Hit 9 docnumbers don't match [junit4] > Hits length1=25 length2=25 [junit4] > hit=0: doc3=1.0 shardIndex=0, doc3=1.0 shardIndex=0 [junit4] > hit=1: doc18=1.0 shardIndex=0, doc18=1.0 shardIndex=0 [junit4] > hit=2: doc40=1.0 shardIndex=0, doc40=1.0 shardIndex=0 [junit4] > hit=3: doc81=1.0 shardIndex=0, doc81=1.0 shardIndex=0 [junit4] > hit=4: doc85=1.0 shardIndex=0, doc85=1.0 shardIndex=0 [junit4] > hit=5: doc150=1.0 shardIndex=0, doc150=1.0 shardIndex=0 [junit4] > hit=6: doc159=1.0 shardIndex=0, doc159=1.0 shardIndex=0 [junit4] > hit=7: doc165=1.0 shardIndex=0, doc165=1.0 shardIndex=0 [junit4] > hit=8: doc175=1.0 shardIndex=0, doc175=1.0 shardIndex=0 [junit4] > hit=9: doc208=1.0 shardIndex=0, doc180=1.0 shardIndex=0 [junit4] > hit=10: doc256=1.0 shardIndex=0, doc181=1.0 shardIndex=0 [junit4] > hit=11: doc270=1.0 shardIndex=0, doc208=1.0 shardIndex=0 [junit4] > hit=12: doc295=1.0 shardIndex=0, doc256=1.0 shardIndex=0 [junit4] > hit=13: doc300=1.0 shardIndex=0, doc270=1.0 shardIndex=0 [junit4] > hit=14: doc331=1.0 shardIndex=0, doc295=1.0 shardIndex=0 [junit4] > hit=15: doc347=1.0 shardIndex=0, doc300=1.0 shardIndex=0 [junit4] > hit=16: doc357=1.0 shardIndex=0, doc331=1.0 shardIndex=0 [junit4] > hit=17: doc363=1.0 shardIndex=0, doc347=1.0 shardIndex=0 [junit4] > hit=18: doc366=1.0 shardIndex=0, doc357=1.0 shardIndex=0 [junit4] > hit=19: doc385=1.0 shardIndex=0, doc363=1.0 shardIndex=0 [junit4] > hit=20: doc459=1.0 shardIndex=0, doc366=1.0 shardIndex=0 [junit4] > hit=21: doc464=1.0 shardIndex=0, doc385=1.0 shardIndex=0 [junit4] > hit=22: doc467=1.0 shardIndex=0, doc459=1.0 shardIndex=0 [junit4] > hit=23: doc489=1.0 shardIndex=0, doc464=1.0 shardIndex=0 [junit4] > hit=24: doc514=1.0 shardIndex=0, doc467=1.0 shardIndex=0 [junit4] > for query:field:// [junit4] > at __randomizedtesting.SeedInfo.seed([A993DB1E59F6C2DC:48CF9A0F875C9554]:0) [junit4] > at junit.framework.Assert.fail(Assert.java:57) [junit4] > at org.apache.lucene.search.CheckHits.checkEqual(CheckHits.java:205) [junit4] > at org.apache.lucene.search.TestRegexpRandom2.assertSame(TestRegexpRandom2.java:178) [junit4] > at org.apache.lucene.search.TestRegexpRandom2.testRegexps(TestRegexpRandom2.java:164) [junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:567) [junit4] > at java.base/java.lang.Thread.run(Thread.java:835) [junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=5, maxDocsPerChunk=8, blockSize=1), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=5, blockSize=1)), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1c32fc08), locale=rn, timezone=Africa/El_Aaiun {noformat} ---- ...note that in both of these builds, TestFieldCacheRewriteMethod (which subclasses TestRegexpRandom2) also failed w/similar errors and the same master seeds .. suggesting it's probably related to one of the persistent options chosen by the random master seed (codec, similarity, locale, etc....) /cc [~jpountz] > Better Segment To Thread Mapping Algorithm > ------------------------------------------ > > Key: LUCENE-8757 > URL: https://issues.apache.org/jira/browse/LUCENE-8757 > Project: Lucene - Core > Issue Type: Improvement > Reporter: Atri Sharma > Assignee: Simon Willnauer > Priority: Major > Fix For: master (9.0), 8.2 > > Attachments: LUCENE-8757.patch, LUCENE-8757.patch, LUCENE-8757.patch, > LUCENE-8757.patch, LUCENE-8757.patch, LUCENE-8757.patch, LUCENE-8757.patch, > LUCENE-8757.patch, LUCENE-8757.patch, LUCENE-8757.patch > > > The current segments to threads allocation algorithm always allocates one > thread per segment. This is detrimental to performance in case of skew in > segment sizes since small segments also get their dedicated thread. This can > lead to performance degradation due to context switching overheads. > > A better algorithm which is cognizant of size skew would have better > performance for realistic scenarios -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org